The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
All of a sudden, there was all this freedom: David Winer on the origins of blogging, the self-publishing technology that has profoundly shaped the first quarter of the 21st century
If Life isn't a Movie, then How Should We Make Movies about Life? Olivia Rutigliano on Jean-Luc Godard's 1963 controversial film, "Le Mepris" (Contempt)
The Terrifyingly Exciting Promise of Nuclear Fusion: Matthew Moynihan on radically disruptive technology that, he promises, can conquer climate change and take us to Mars in a month
The Future of Money, Jobs, Climate and Failure: Andrew Hill on the Financial Times' best 15 business books from 2023
Dry Powder for a Dying Digital Economy? Keith Teare on the deepening venture capital crisis, how the innovators dilemma holds back Big Tech innovation, and why Substack is trying to reinvent the online media ecosystem
Did MTV Kill American Democracy? Kathryn Cramer Brownell on cable television and the fragmenting of America from Watergate to Fox News
Literary Insurrections and Memetic Apocalypses : Rion Amilcar Scott on the rise and (perhaps) fall of Black Twitter
The Scottish Coal-Miner's Daughter Who Took on the Bulgarian Cryptoqueen: Jennifer McAdam on her battle to take down Ruja Ignatova and her $27 Billion OneCoin Scam
The Seven Best Novels of the Summer: Bethanne Patrick on the literature of love, nostalgia, young call girls and valiant women
The Subversive Story of the B-52s: Scott Creney on one of the most iconic bands in American popular musical history
Feeding the AI Beast: Michael Wooldridge on the vast quantities of online data that have trained ChatGPT to mimic human language
Why America is Facing its greatest "Moral Moment "since the Civil War: Peter Wehner on the accountability of the Republican Party for Trump
Why We Need to Reoccupy Reality: Douglas Rushkoff on the Untethering of America between 2013 and 2023