The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
Eight literary tricks and treats to scare you this Halloween: Bethanne Patrick on "app-aritions", cultural ghosts and unfamiliarly familiar haunted houses
Why our cyborg AI future may already have arrived in the trained-on-jargon "person" of Sam Bankman-Fried: Hito Steyerl on pyramid schemes, on-boarding tools and the "mean" creativity of our AI age
Is the venture capital industry a big ponzi scheme? Keith Teare separates the hyperbole from the hysteria of VC techno-optimism
The American Shakespeare or trash of the veriest sort? Peter Slen on Mark Twain's ADVENTURES OF HUCKLEBERRY FINN, the adventurous story of a young man and young nation on a great and not-so-great adventure
A Graphic Diary of the War in Ukraine: Nora Krug on the contrasting realities of a Ukrainian journalist and a Russian artist in the first year of Russian invasion
The Dismal Science investigates that most dismal of things - economic inequality: Branko Milanovic on visions of inequality from the French Revolution to the end of the Cold War
That Sinking Feeling of Falling Out of the Middle Class: Ray Suarez on his fear of being poor in the America of the inegalitarian Twenties
Celebrating a transcendental photography of nature that blurs art and science: Photographer Anand Varma on his lifelong wonder with the natural world
How to stand up to the apocalypse: Peter Sarris on Justinian, the 6th century Byzantine ruler who confounded a narrative of decline
The Fruit of the Gods or of the Devil? Alexander Sammon on the sordid history of the avocado, the thirstiest fruit on the planet
Why Nineteen Eighty-Four wasn't really like Nineteen-Eighty Four: Sandra Newman on Julia, Winston Smith and the totalitarianism of gender that George Orwell ignored in his masculine dystopia
How to Reawaken the American Dream: David Leonhardt on unions, constitutional reform, immigration and the need for a progressive populism
Why Generative AI could make artists extinct: Karla Ortiz warns about the existential "theft" at the heart of the AI revolution