The Idiocracy Trap: Why Smart Machines are making Humans Dumb & Dumber
Jacob Ward warned us. Back in January 2022, the Oakland-based tech journalist published The Loop, a warning about how AI is creating a world without choices. He even came on this show to warn about AI’s threat to humanity. Three years later, we’ve all caught up with Ward. So where is he now on AI? Moderately vindicated but more pessimistic. His original thesis has proven disturbingly accurate - we’re outsourcing decisions to AI at an accelerating pace. But he admits his book’s weakest section was “how to fight back,” and he still lacks concrete solutions. His fear has evolved: less worried about robot overlords, he is now more concerned about an “Idiocracy” of AI human serfs. It’s a dystopian scenario where humans become so stupid that they won’t even be able to appreciate Gore Vidal’s quip that “I told you so” are the four most beautiful words in the English language.
I couldn’t resist asking Anthropic’s Claude about Ward’s conclusions (not, of course, that I rely on it for anything). “Anecdotal” is how it countered with characteristic coolness. Well Claude wouldn’t say that, wouldn’t it?
1. The “Idiocracy” threat is more immediate than AGI concerns Ward argues we should fear humans becoming cognitively dependent rather than superintelligent machines taking over. He’s seeing this now - Berkeley students can’t distinguish between reading books and AI summaries.
2. AI follows market incentives, not ethical principles Despite early rhetoric about responsible development, Ward observes the industry prioritizing profit over principles. Companies are openly betting on when single-person billion-dollar businesses will emerge, signaling massive job displacement.
3. The resistance strategy remains unclear Ward admits his book’s weakness was the “how to fight back” section, and he still lacks concrete solutions. The few examples of resistance he cites - like Signal’s president protecting user data from training algorithms - require significant financial sacrifice.
4. Economic concentration creates systemic risk The massive capital investments (Nvidia’s $100 billion into OpenAI) create dangerous loops where AI companies essentially invest in themselves. Ward warns this resembles classic bubble dynamics that could crash the broader economy.
5. “Weak perfection” is necessary for human development Ward argues we need friction and inefficiency in our systems to maintain critical thinking skills. AI’s promise to eliminate all cognitive work may eliminate the mental exercise that keeps humans intellectually capable.
Keen On America is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit keenon.substack.com/subscribe
Is Web3 technology - Blockchain, Cryptocurrency, DAOs, NFTs et al - just the latest Silicon Valley hype? Alex Tapscott separates the signal from the noise on the internet's next economic and cultural frontier
Tyranny of an Ethnocratic Minority: Steven Levitsky on what an increasingly broken American political system has to learn from the democracies of Brazil and Argentina
When the stink became overwhelming: Corban Addison tells the true story of when large-scale farming went on trial in North Carolina
Your Face Belongs to Us: Kashmir Hill on a secretive startup's quest to end privacy as we know it
Eight novels to take to a desert island this Fall: Bethanne Patrick on new fiction about Haiti, Jamestown, 1984, Malaysia and women on the margins of the Vietnam war
On the Awesomeness of Globalization: Keith Teare explains why the next chapter of globalized technology will undermine the economic and political power of the nation-state
The Economic and Moral Case for Good Jobs: Zeynep Ton on why companies need to bring dignity, pay and meaning to everyone's work
How to stand up to a dictator: Maria Ressa on courage, honesty, perseverance and why must all fight for our future
The shocking saga of big media malfeasance rivaling Succession for its sex, lies and betrayals: Rachel Abrams on the Redstone dynastic struggle, former CBS executive Les Moonves and their significance to the Me Too movement
Why AI threatens not just writing, creativity and thinking, but also democracy: Naomi S. Baron on how new tools like Chat GPT are stopping us knowing who we really are as individuals
The Long Life of a Radical Gerontologist: Ken Dychtwald on how to age with purpose
The $100 Trillion Wealth Transfer: Ken Costa explains why the handover of wealth from Boomers to Gen Z must revolutionize capitalism
Why digital transformation isn't about technology: David Rogers on how to rebuild organizations in our age of continuous change