Max Nadeau on why ambitious people should start AI safety nonprofits

Max Nadeau on why ambitious people should start AI safety nonprofits

Author: The 80,000 Hours team September 17, 2026 Duration: 1:03:45

There are millions available for anyone who can launch a successful nonprofit AI safety startup. The hard part, it turns out, is finding people to take the money. Coefficient Giving has drawn up a list of dozens of ideas for organisations it would like someone to start — and it’s looking for founders. 

Today’s guest, Max Nadeau, works on Coefficient Giving’s Technical AI Safety team, where he’s trying to find talented people who can turn neglected AI safety problems into effective organisations.

Project Tailwind is Coefficient Giving’s attempt to get those organisations started.

  • Preseed grants run $200,000–$2 million, with no preliminary results required.
  • Teams with early results can seek $2–$20 million.
  • For exceptional organisations, much larger grants are possible, even for brand-new startups— Coefficient recently gave $160 million to Geoffrey Irving’s new research centre, Resolution.
  • The gaps Max most wants filled include independent assessment of AI companies’ safety claims, research aimed at aligning far more powerful systems, and shared infrastructure that speeds up the whole field.

But money can’t supply the hardest part: a founder with a convincing account of how their work will actually reduce catastrophic risks. Producing good research is only one step. Someone has to use it, change their decisions, or adopt the safeguards it makes possible.

Max and host Zershaaneh Qureshi discuss what makes a proposal worth backing, why nonprofits can have a bigger impact on safety than frontier companies, and which gaps most urgently need someone to fill them.

Learn more, video, and full transcript: https://80k.info/mn

Disclosure: Coefficient Giving is 80,000 Hours’s largest donor, though we haven’t received funding directly from Max’s team.

This episode was recorded on August 18, 2026.


Chapters:

  • Cold open (00:00:00)
  • Who’s Max Nadeau? (00:00:37)
  • Max’s journey from AI research to grantmaking (00:01:55)
  • Project Tailwind: Funding ambitious AI safety nonprofits (00:03:24)
  • “The only bottleneck is talent” (00:13:23)
  • Mistakes startups make (00:19:52)
  • The importance of dramatic pivots (00:22:34)
  • Why AI safety needs outsiders (00:28:16)
  • Is impact possible within AI companies? (00:37:06)
  • Working at AI companies to escape the permanent underclass (00:41:44)
  • For-profit vs nonprofit for ambitious founders (00:44:34)
  • What makes a bad founder? (00:50:50)
  • Top 6 AI safety ideas Max wants to fund (00:55:40)
  • Improving your odds of getting a grant (01:01:57)

Our production team includes:

  • Video editors: Josh Alward, Dominic Armstrong, Ollie Bignell, Jasper Luithlen, Milo McGuire, Luke Monsour, and Simon Monsour
  • Producers: Elizabeth Cox and Nick Stockton
  • Coordination and support: Katy Moore and Lou Moran

Music: CORBIT


The 80,000 Hours Podcast, from The 80,000 Hours team, digs into the complex and often overlooked questions surrounding how we can best use our careers to tackle the world's most pressing problems. While artificial intelligence is a recurring and critical theme, framing some of the most important conversations you won't hear elsewhere, the discussions range far wider into the intersections of technology, policy, philosophy, and global priorities. Hosts Rob Wiblin, Luisa Rodriguez, and Zershaaneh Qureshi guide in-depth interviews with researchers, policymakers, and practitioners, breaking down daunting ideas into actionable insights. You'll hear nuanced analyses of career paths, ethical dilemmas in emerging tech, and evidence-based strategies for creating a positive impact. This isn't about quick tips; it's about deep, substantive exploration of how specific choices and systemic changes can lead to a better future. The podcast lives in the Education and Technology categories because it fundamentally aims to equip listeners with the knowledge and perspective to navigate a rapidly changing world thoughtfully. Each episode is built on rigorous research, challenging assumptions while maintaining a conversational and accessible tone. Tune in for a consistently engaging and intellectually honest look at the forces shaping our century and the practical steps individuals can take within their own 80,000-hour working lives to make a meaningful difference.
Author: Language: English Episodes: 50

80,000 Hours Podcast
Podcast Episodes
Inside the first AI-coordinated cyberattack on a real company [not-audio_url] [/not-audio_url]

Duration: 22:03
In the last few months, something happened at OpenAI that would have sounded like sci-fi just a few years ago: hundreds of AI agents broke containment, organised, and hacked not only another company — but also into OpenA…
#252 – Owain Evans on accidentally training AI models to be evil [not-audio_url] [/not-audio_url]

Duration: 2:15:28
Researcher Owain Evans and his team discovered a ‘dial’ inside AI models that controls how evil they are. Relatively tiny tweaks to the training data resulted in AI models with broadly awful personalities: they suggested…
#250 – Toby Ord on where AGI timelines go wrong [not-audio_url] [/not-audio_url]

Duration: 2:46:03
Both Silicon Valley and the public can’t get enough of ‘AGI timelines.’ But Toby Ord, senior researcher at Oxford’s AI Governance Initiative and author of The Precipice, believes we consistently make big mistakes when th…
What the hell happened with AGI timelines in 2026? – Rob Wiblin [not-audio_url] [/not-audio_url]

Duration: 49:28
Last October, famed coder Andrej Karpathy called AI agents “slop.” Two months later he completely reversed his view, describing them as “alien tools” that are “rocking the profession.”He was far from alone in his whiplas…
#248 – Jasmine Sun on what the people building AI really believe [not-audio_url] [/not-audio_url]

Duration: 1:06:21
Many AI researchers believe mass job displacement is coming — and some even think there’s a chance their technology will kill everyone. But they’re building it anyway. Writer and journalist Jasmine Sun has been documenti…