The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
Larry Downes on How the Federal Government Failed to Rein in Big Tech in 2022: Expect the Same Inaction in 2023
Peter Wehner: Why 2022 Might Represent the End of the Trump Era and What Might Replace It in 2023
Elissa Epel: More Empathy, More Psychedelics, or More Grapefruit? How to Best Relieve Stress in 2023
Matthew Krogh on Why Watergate Will Never Die: The Moral Lessons of One of Nixon's White House Plumbers
Chris Miller: Why 2022 Was the Year of the Chip and the Three Great Unanswered Questions That Will Bedevil Us in 2023
Peter Coy: Why Inflation Dominated Our 2022 Economy and Why Everything Might Change in 2023
Martin Rees: Why 2022 Was a Triumphant Year for Science and What Needs to Happen in 2023 to Build Upon These Advances
Vivek Wadhwa on Modi, Indian Tech, and Kashmir: What America Gets Wrong About India
Rob Reich and Jeremy Weinstein on Political Regulation and a Moral Education: What Needs to Happen in 2023 to Reign in Big Tech
Jonathan Rauch: Why We Should Be Cautiously Optimistic About the Future of American Democracy, Especially If Joe Biden Doesn't Stand Again For President
Joanne McNeil: What Can We Learn About the AOL Experience of the 1990s to Make Today's Internet More User-Friendly and Civil?
Tony Hiss: No, We Aren't on the Verge of an Environmental Apocalypse: Why 2022 Was a Promising Year For the Planet and What We Need to Do in 2023 to Maintain This Progress
Maciej Kisilowski: How the 2022 Russian Invasion of Ukraine Could Trigger a Nuclear Apocalypse and What We Need to Do in 2023 to Avert This Catastrophe