The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
Five of the Non-Fictional Best: Bethanne Patrick picks her favorite non-fiction books for 2023
How Not To Age: Dr Michael Greger offers a simple dietary approach to getting healthier as we get older
Why it's time stop declaring war on everything: David Keen on the "Wreckonomics" of how we now find ourselves locked into so many failed economic, environmental and political policies
How our brains mirror the history of human evolution: Min W. Jung on the neuroscience of imagination and abstract thinking
A Return to Normal Abnormality in Silicon Valley: Keith Teare on why even some of the most highly capitalized AI start-ups are now running out of runway and will not survive
In Praise of Ineffective Altruism: Amy Schiller on how philanthropy went wrong and how to fix it
Should we let go of Philip Roth? Hannah Gold gets into Roth's mind, his hands and his followers
In Defense of Trash Talk: Rafi Kohan on Muhammed Ali, Babe Ruth, Michael Jordan, Elon Musk and why talking smack is as old as the Bible
Why even the smartest machine vision won't eliminate bias: Jill Walker Rettberg on how algorithms are changing the way we see and are seen by the world
When Language Was Up For Grabs: Ben Lerner warns against falling in love once again with the promise of digital technology to democratize language
The First Neo-Liberal or the Last Conservative? Jennifer Burns on Milton Friedman, the most controversial American economist of the 20th century
Why American humor isn't really being cancelled by the woke police: Kliph Nesteroff's history of showbiz and its perennial culture wars
Why all great geniuses are also rebels: Bulent Atalay on how Shakespeare, Da Vinci, Newton, Beethoven and Einstein all shared similarly transgressive minds