#242 – Will MacAskill on how we survive the 'intelligence explosion,' AI character, and the case for 'viatopia'

#242 – Will MacAskill on how we survive the 'intelligence explosion,' AI character, and the case for 'viatopia'

Author: The 80,000 Hours team April 22, 2026 Duration: 3:14:54

Hundreds of millions already turn to AI on the most personal of topics — therapy, political opinions, and how to treat others. And as AI takes over more of the economy, the character of these systems will shape culture on an even grander scale, ultimately becoming “the personality of most of the world’s workforce.”

So… should they be designed to push us towards the better angels of our nature? Or simply do as we ask? Will MacAskill, philosopher and senior research fellow at Forethought, has been thinking through that and the other thorniest issues that come up in designing an AI personality.

---

Our new book is "a ridiculously in-depth guide to finding a fulfilling career that does good" and is out now! Order from your local bookstore, or online at https://80k.info/career-guide

---

He’s also been exploring how we might coexist peacefully with the ‘superintelligent AI’ companies are racing to build. He concludes that we should train such systems to be very risk averse, pay them for their work, and build institutions that enable humans to make credible contracts with AIs themselves.

Will and host Rob Wiblin also discuss what a good world after superintelligence would actually look like — a subject that has received surprisingly little attention from the people working to make it. Will argues that we shouldn’t aim for a specific utopian vision: we don’t know enough about what the best possible future actually is to aim directly for it, and trying to lock in today’s best guesses forever risks baking in errors we can’t yet see.

Will and Rob explore what we can do to steer towards a good future instead, along with why a coalition of democracies building superintelligence together is safer than any single actor, how absurdly useful ChatGPT is for analytic philosophy, and more.


Learn more, video, and full transcript: https://80k.info/wm26

This episode was recorded on February 6, 2026.

Chapters:

  • Cold open (00:00:00)
  • Will MacAskill is back — for a 6th time! (00:00:29)
  • AIs’ “characters” could be vital to securing a good future (00:00:59)
  • The panic over sychophancy is justified (00:08:11)
  • How opinionated should AI be about ethics? (00:13:24)
  • Commercial pressures won’t fully determine AI character (00:30:54)
  • Risk-averse AI would rather strike a deal than attempt a coup (00:38:13)
  • A coalition of democracies building superintelligence is safer than one doing it alone (01:09:26)
  • How selfish agents could fund the common good (01:22:19)
  • Why not push for pausing AI development? (01:42:17)
  • Effective altruism is making a comeback post-SBF (01:52:19)
  • EA in the age of AGI (02:00:28)
  • Viatopia: an alternative to utopia (02:09:30)
  • The least bad alternative to total utilitarianism? (02:39:35)
  • How AI could kickstart a golden age of philosophy (03:03:35)

Video and audio editing: Dominic Armstrong, Milo McGuire, Luke Monsour, and Simon Monsour
Music: CORBIT
Camera operator: Alex Miles
Production: Elizabeth Cox, Nick Stockton, and Katy Moore


The 80,000 Hours Podcast, from The 80,000 Hours team, digs into the complex and often overlooked questions surrounding how we can best use our careers to tackle the world's most pressing problems. While artificial intelligence is a recurring and critical theme, framing some of the most important conversations you won't hear elsewhere, the discussions range far wider into the intersections of technology, policy, philosophy, and global priorities. Hosts Rob Wiblin, Luisa Rodriguez, and Zershaaneh Qureshi guide in-depth interviews with researchers, policymakers, and practitioners, breaking down daunting ideas into actionable insights. You'll hear nuanced analyses of career paths, ethical dilemmas in emerging tech, and evidence-based strategies for creating a positive impact. This isn't about quick tips; it's about deep, substantive exploration of how specific choices and systemic changes can lead to a better future. The podcast lives in the Education and Technology categories because it fundamentally aims to equip listeners with the knowledge and perspective to navigate a rapidly changing world thoughtfully. Each episode is built on rigorous research, challenging assumptions while maintaining a conversational and accessible tone. Tune in for a consistently engaging and intellectually honest look at the forces shaping our century and the practical steps individuals can take within their own 80,000-hour working lives to make a meaningful difference.
Author: Language: English Episodes: 100

80,000 Hours Podcast
Podcast Episodes
What makes for a dream job? | Benjamin Todd [not-audio_url] [/not-audio_url]

Duration: 28:18
What actually makes a job fulfilling? It's not what most career advice tells you. "Follow your passion" sounds inspiring, but it's misleading — and the research backs that up.Drawing on hundreds of studies, we’ve identif…
How scary is Claude Mythos? 303 pages in 21 minutes [not-audio_url] [/not-audio_url]

Duration: 21:27
With Claude Mythos we have an AI that knows when it's being tested, can obscure its reasoning when it wants, and is better at breaking into (and out of) computers than any human alive. Rob Wiblin works through its 244-pa…