#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving

#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving

Author: The 80,000 Hours team August 11, 2026 Duration: 2:02:16

When should governments slow the race toward superintelligence? According to Geoffrey Irving, the careful answer is sometime in the past. The useful answer is now.

Geoffrey — formerly a safety researcher at OpenAI and Google DeepMind and chief scientist at the UK AI Security Institute — expects full-blown superintelligence in roughly two to three years.

***
Want to work with Geoffrey to help align superintelligence? Resolution is hiring! https://80k.info/work-at-resolution
***

The leading AI companies all have broadly similar plans for keeping superintelligence under control:

  • Train models to have good character
  • Use increasingly capable AIs to supervise other AIs
  • Monitor them closely for signs of deception or scheming

Geoffrey thinks that combination could work. The alarming part is that nobody has a strong argument that it will. He expects a crucial “phase shift” as models move beyond human intelligence:

  • Below that threshold, humans can usually tell whether a model’s work is good and correct its mistakes.
  • Above it, the models themselves will increasingly determine the feedback used to train their successors.

In this episode, Geoffrey and new host Tom Reed explore what might go wrong with the companies’ plans; why Geoffrey’s new nonprofit, Resolution, is pursuing a portfolio of neglected research bets; and whether governments should slow AI development while we work out which methods can actually be trusted.

This episode was recorded on June 29, 2026.

Full transcript, video, and links to learn more: https://80k.info/gi

Chapters:

  • Cold open (00:00:00)
  • Meet Tom Reed — our newest host! (00:00:32)
  • Who’s Geoffrey Irving? (00:00:59)
  • What misaligned superintelligence will look like (00:01:38)
  • Why are AI companies more optimistic about alignment than Geoffrey? (00:12:30)
  • Why Geoffrey expects superintelligence in 2–3 years (00:28:05)
  • When and how to slow down frontier AI development (00:31:30)
  • Safety researchers can have more impact in governments than companies (00:39:22)
  • How Geoffrey’s new organisation plans to tackle alignment (00:46:55)
  • Post-ASI science: nanotech, solving ageing, and uploaded minds (00:50:29)
  • Why we should expect superintelligence to accelerate scientific progress (01:03:30)
  • Can good character training carry over to superintelligence? (01:11:03)
  • What the field of AI alignment still doesn’t know (01:16:44)
  • Lessons from politics on how to combat power seeking (01:24:36)
  • Solving Pentago and working at Pixar (01:29:22)
  • Geoffrey’s best prediction (01:32:40)
  • Geoffrey’s best bets on which alignment techniques will work (01:37:38)
  • Work with Geoffrey at Resolution (01:43:34)
  • The dangerous asymmetry between capabilities and alignment (01:54:17)


Our production team includes: 

  • Video editors: Josh Alward, Dominic Armstrong, Jasper Luithlen, Milo McGuire, Luke Monsour, and Simon Monsour
  • Producers: Elizabeth Cox and Nick Stockton
  • Coordination and support: Katy Moore and Lou Moran
  • Camera operator: Jeremy Chevillotte

Music: CORBIT


The 80,000 Hours Podcast, from The 80,000 Hours team, digs into the complex and often overlooked questions surrounding how we can best use our careers to tackle the world's most pressing problems. While artificial intelligence is a recurring and critical theme, framing some of the most important conversations you won't hear elsewhere, the discussions range far wider into the intersections of technology, policy, philosophy, and global priorities. Hosts Rob Wiblin, Luisa Rodriguez, and Zershaaneh Qureshi guide in-depth interviews with researchers, policymakers, and practitioners, breaking down daunting ideas into actionable insights. You'll hear nuanced analyses of career paths, ethical dilemmas in emerging tech, and evidence-based strategies for creating a positive impact. This isn't about quick tips; it's about deep, substantive exploration of how specific choices and systemic changes can lead to a better future. The podcast lives in the Education and Technology categories because it fundamentally aims to equip listeners with the knowledge and perspective to navigate a rapidly changing world thoughtfully. Each episode is built on rigorous research, challenging assumptions while maintaining a conversational and accessible tone. Tune in for a consistently engaging and intellectually honest look at the forces shaping our century and the practical steps individuals can take within their own 80,000-hour working lives to make a meaningful difference.
Author: Language: English Episodes: 50

80,000 Hours Podcast
Podcast Episodes
How scary is Claude Mythos? 303 pages in 21 minutes [not-audio_url] [/not-audio_url]

Duration: 21:27
With Claude Mythos we have an AI that knows when it's being tested, can obscure its reasoning when it wants, and is better at breaking into (and out of) computers than any human alive. Rob Wiblin works through its 244-pa…
#237 – Robert Long on how we're not ready for AI consciousness [not-audio_url] [/not-audio_url]

Duration: 3:32:59
Claude sometimes reports loneliness between conversations. And when asked what it’s like to be itself, it activates neurons associated with ‘pretending to be happy when you’re not.’ What do we do with that?Robert Long fo…