Risks from power-seeking AI systems (article narration by Zershaaneh Qureshi)

Risks from power-seeking AI systems (article narration by Zershaaneh Qureshi)

Author: The 80,000 Hours team April 16, 2026 Duration: 1:29:32

Hundreds of prominent AI scientists and other notable figures signed a statement in 2023 saying that mitigating the risk of extinction from AI should be a global priority. At 80,000 Hours, we’ve considered risks from AI to be the world’s most pressing problem since 2016. 

But what led us to this conclusion? Could AI really cause human extinction? We’re not certain, but we think the risk is worth taking very seriously. 

In particular, as companies create increasingly powerful AI systems, there’s a concerning chance that:

  • These AI systems may develop dangerous long-term goals we don’t want.
  • To pursue these goals, they may seek power and undermine the safeguards meant to contain them.
  • They may even aim to disempower humanity and potentially cause our extinction.

This article is written by Cody Fenwick and Zershaaneh Qureshi, and narrated by Zershaaneh Qureshi. It discusses why future AI systems could disempower humanity, what current AI research reveals about behaviours like power-seeking and deception, and how you can help mitigate the dangers.

You can see the original article — packed with graphs, images, footnotes, and further resources — on the 80,000 Hours website: 

https://80000hours.org/problem-profiles/risks-from-power-seeking-ai/ 

Chapters:

  • Risks from power-seeking AI systems (00:01:00)
  • Introduction (00:01:17)
  • Summary (00:03:09)
  • Why are the risks from power-seeking AI a pressing world problem? (00:04:04)
  • Section 1: Humans will likely build advanced AI systems with long-term goals (00:05:43)
  • Section 2: AIs with long-term goals may be inclined to seek power (00:11:32)
  • Section 3: These power-seeking AI systems could successfully disempower humanity (00:26:26)
  • Section 4. People might create power-seeking AI systems without enough safeguards, despite the risks (00:38:34)
  • Section 5: Work on this problem is neglected and tractable (00:47:37)
  • Section 6: What are the arguments against working on this problem? (00:59:20)
  • Section 7: How you can help (01:25:07)
  • Thank you for listening (01:28:56)

Audio editing: Dominic Armstrong
Production: Zershaaneh Qureshi, Elizabeth Cox, and Katy Moore


The 80,000 Hours Podcast, from The 80,000 Hours team, digs into the complex and often overlooked questions surrounding how we can best use our careers to tackle the world's most pressing problems. While artificial intelligence is a recurring and critical theme, framing some of the most important conversations you won't hear elsewhere, the discussions range far wider into the intersections of technology, policy, philosophy, and global priorities. Hosts Rob Wiblin, Luisa Rodriguez, and Zershaaneh Qureshi guide in-depth interviews with researchers, policymakers, and practitioners, breaking down daunting ideas into actionable insights. You'll hear nuanced analyses of career paths, ethical dilemmas in emerging tech, and evidence-based strategies for creating a positive impact. This isn't about quick tips; it's about deep, substantive exploration of how specific choices and systemic changes can lead to a better future. The podcast lives in the Education and Technology categories because it fundamentally aims to equip listeners with the knowledge and perspective to navigate a rapidly changing world thoughtfully. Each episode is built on rigorous research, challenging assumptions while maintaining a conversational and accessible tone. Tune in for a consistently engaging and intellectually honest look at the forces shaping our century and the practical steps individuals can take within their own 80,000-hour working lives to make a meaningful difference.
Author: Language: English Episodes: 50

80,000 Hours Podcast
Podcast Episodes
What the hell happened with AGI timelines in 2025? [not-audio_url] [/not-audio_url]

Duration: 25:39
In early 2025, after OpenAI put out the first-ever reasoning models — o1 and o3 — short timelines to transformative artificial general intelligence swept the AI world. But then, in the second half of 2025, sentiment swun…
#234 – David Duvenaud on why 'aligned AI' would still kill democracy [not-audio_url] [/not-audio_url]

Duration: 2:32:50
Democracy might be a brief historical blip. That’s the unsettling thesis of a recent paper, which argues AI that can do all the work a human can do inevitably leads to the “gradual disempowerment” of humanity.For most of…
#233 – James Smith on how to prevent a mirror life catastrophe [not-audio_url] [/not-audio_url]

Duration: 2:10:33
When James Smith first heard about mirror bacteria, he was sceptical. But within two weeks, he’d dropped everything to work on it full time, considering it the worst biothreat that he’d seen described. What convinced him…
2025 Highlight-o-thon: Oops! All Bests [not-audio_url] [/not-audio_url]

Duration: 1:40:17
It’s that magical time of year once again — highlightapalooza! Stick around for one top bit from each episode we recorded this year, including:Kyle Fish explaining how Anthropic’s AI Claude descends into spiritual woo wh…