The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
Brad Feld: The Tech Community Needs To Be Humble to Survive With What Will Be a "Challenging" 2023
Beezy Marsh: Remembering a London of 1946 in Which Fearsome Female Gangsters Ran the Show
Leigh Goodmark on the Case for Abolition Feminism: Why We Need to Decriminalize Domestic Violence
Frank Smyth: Don't Shoot Me, I'm Only the Messenger: Why the Bad 2022 News About Gun Proliferation and Violence in America Will Probably Only Get Worse in 2023
Peter Pomerantsev: Why the "Evil" Russian Invasion of Ukraine Will Only End When the West Arms Ukraine With Missiles That Can Reach Russian Cities
Kevin Boyle: How to Escape the Culture-War Paranoia That Has Infected American Politics Since the Sixties
William Deresiewicz: Why 2022 Was a Good Year For American Liberals Fighting Against the Fundamentalism of Both Left- and Right-Wing Intolerance
Chris Schroeder: How to Read 100 Books in 2023 Without Going to Live in a Library or a Bookstore
Rick Wartzman: How Joe Biden Has Done More For Labor Unions Than Any President Since FDR and What to Hope For in 2023 to Maintain This Progress
Jenny Kleeman on Humanity's Fate in 2022: Have We All Become Frogs Being Slowly Boiled Alive in the Pot of Technological "Progress"?
Soli Özel on the Middle East in 2022: Iran, Israel, Turkey, the Gulf, and the Other Asymmetries of a Multi-Polar Region
Gary Gerstle: How Liz Truss, The Russian Invasion of Ukraine, and Joe Biden's Economic Policies Have All Contributed to the Decline, and Perhaps Even Death, of Neo-Liberalism in 2022
Christopher Leonard: Why Our Inflationary Crisis Might Not Be Over and How This Could Trigger a Broader Economic Collapse in 2023