80,000 Hours Podcast
In 1983, Stanislav Petrov, a Soviet lieutenant colonel, sat in a bunker watching a red screen flash “MISSILE LAUNCH.” Protocol demanded he report it to superiors, which would very likely trigger a retaliatory nuclear strike. Petrov didn’t. He reasoned that if the US were actually attacking, they wouldn’t fire just 5 missiles — they’d empty the silos. He bet the fate of the world on a hunch that his machine was broken. He was right.
Paul Scharre, the former Army Ranger who led the Pentagon team that wrote the US military’s first policy on autonomous weapons, has a question: What would an AI have done in Petrov’s shoes? Would an AI system have been flexible and wise enough to make the same judgement? Or would it immediately launch a counterattack?
Paul joins host Luisa Rodriguez to explain why we are hurtling toward a “battlefield singularity” — a tipping point where AI increasingly replaces humans in much of the military, changing the way war is fought with speed and complexity that outpaces humans’ ability to keep up.
Links to learn more, video, and full transcript: https://80k.info/ps
Militaries don’t necessarily want to take humans out of the loop. But Paul argues that the competitive pressure of warfare creates a “use it or lose it” dynamic. As former Deputy Secretary of Defense Bob Work put it: “If our competitors go to Terminators, and their decisions are bad, but they’re faster, how would we respond?”
Once that line is crossed, Paul warns we might enter an era of “flash wars” — conflicts that spiral out of control as quickly and inexplicably as a flash crash in the stock market, with no way for humans to call a timeout.
In this episode, Paul and Luisa dissect what this future looks like:
Paul also shares a personal story from his time as a sniper in Afghanistan — watching a potential target through his scope — that fundamentally shaped his view on why human judgement, with all its flaws, is the only thing keeping war from losing its humanity entirely.
This episode was recorded on October 23-24, 2025.
Chapters:
• Cold open (00:00:00)
• Who’s Paul Scharre? (00:00:45)
• How will AI and automation transform the nature of war? (00:01:18)
• Why would militaries take humans out of the loop? (00:12:26)
• AI in nuclear command, control, and communications (00:19:02)
• Nuclear stability and deterrence (00:36:33)
• What to expect over the next few decades (00:46:58)
• Financial and human costs of future “hyperwar” scenarios (00:51:18)
• AI warfare and the balance of power (01:07:31)
• Barriers to getting to automated war (01:12:04)
• Failure modes of autonomous weapons systems (01:17:33)
• Could autonomous weapons systems actually make us safer? (01:31:01)
• Is Paul overall optimistic or pessimistic about increasing automation in the military? (01:36:55)
• Paul’s takes on AGI’s transformative potential and whether natsec people buy it (01:39:15)
• Cyberwarfare (01:48:33)
• US-China balance of power and surveillance with AI (02:04:33)
• Policy and governance that could make us safer (02:31:22)
• How Paul’s experience in the Army informed his feelings on military automation (02:43:24)
Video and audio editing: Dominic Armstrong, Milo McGuire, Luke Monsour, and Simon Monsour
Music: CORBIT
Coordination, transcripts, and web: Katy Moore