The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
In defense of literary flyover country: Peter Slen on Willa Cather's "My Antonia", the 1918 novel that captured the ideal of immigrant middle America
Orwell and his women: Bethanne Patrick on new feminist takes on George Orwell - the man , the husband and the writer.
Guilty by seven crimes and death by a thousand verticals: Keith Teare on Sam Bankman-Fried and Palo Alto, Elon Musk and Rishi Sunak, and Space X and X
How to get more women in science right now: Lisa Munoz on implicit bias, leaky pipelines, tokenization and other explanations for the persistent gender gap in science
Did the KGB really invent the idea of the Palestinian nation in the 1960s? Pierre Rehov on Iranian financed sleeper-cells in US universities and why he admires Hamas' "evil mind"
Overcoming the politics of black grief and white grievance in America today: Juliet Hooker on why American democracy is in desperate need of an radical expansion of its political imagination
A remarkable American hero at a time in which many Americans are no longer comfortable with the heroic ideal: Ronald C. White on the life of Joshua Lawrence Chamberlain, the unlikely hero of Gettysburg
The problem with stories about the Holocaust is that they are told by the survivors: Daniel Finkelstein on the extraordinary coincidences enabling the survival of his mum and dad from both Hitler and Stalin
Zero to Zero: William Deresiewicz on what happens when the price of online content is driven down to zero
Where have all the Democrats gone? Ruy Teixeira on why the Democratic Party needs to tone down the volume on cultural issues if it's to rediscover its soul
How this month's "almost miraculous" Polish election might be a hopeful sign for democracy everywhere: Maciej Kisilowski on the promise and peril of representative democracy in a post authoritarian Poland
Does today's climate change crisis represent an existential threat to humanity? Antonello Provenzale contextualizes the contemporary crisis within a history of climate change from the earth origins to the Anthropocene
An enigmatic city teetering on the edge of the world: John Kampfner on Berlin, a city of ghosts and memories where he can still smell the Wall