The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
How to direct the power of digital technology into economic and political progress: Simon Johnson on what we can learn from our 1000-year struggle over technology and prosperity to make our age of Generative AI more equitable
On the science of failing well: Amy Edmondson explains why we need to take smart risks which will result in more, rather than fewer, failures
Don't Look Away: Alexander Batthyany on terminal lucidity, the "soul" and our final journey when we cross over the border from life to death
Extremely Socially Online: Taylor Lorenz on the untold story of fame, influence, and power on the internet
How to break free of "equality feminism": Marcie Bianco on the lie of equality and the feminist fight for freedom
Taming the Street then and now: Diana Henriques on the New Deal, FDR's fight to regulate American capitalism and its relevance in Joe Biden's America today
Was Richard Nixon really a Southern Californian paragon of cheerfulness , hard work and decency? Paul Carter's defense of the only US President born and raised in California
The Dirty Secrets of our Material World: Ed Conway on the six physical commodities underpinning the global extractive economy
An Un-Whitewashed Story of America: Michael Harriot on AF History, Black Twitter and how he "discovered" America at 8.00 pm on November 4, 1980
Eight great non-fiction reads for the Fall: LA Times book critic Bethanne Patrick on new books about video-gaming writers, Roman emperors, Rastafarian fathers, Jerusalem murders, American guns and the genealogy of the female body
Why money now is the most valuable commodity in Silicon Valley: Keith Teare explains how cash has become king for both tech investors and entrepreneurs
When fictional characters turn out to be more authentic than real people: Lang Leav on anti Asian racism in Australia and her love of the early internet as a place where she could escape how she looks
How Bill Clinton betrayed progressive ideas and capitulated to the right: Nelson Lichtenstein on the failure of the Clinton presidency and the transformation of American capitalism