FBL91: Connor Leahy - The Existential Risk of AI Alignment

FBL91: Connor Leahy - The Existential Risk of AI Alignment

Author: Singularity University February 20, 2023 Duration: 53:40

This week our guest is AI researcher and founder of Conjecture, Connor Leahy, who is dedicated to studying AI alignment. Alignment research focuses on gaining an increased understanding of how to build advanced AI systems that pursue the goals they were designed for instead of engaging in undesired behavior. Sometimes, this means just ensuring they share the values and ethics we have as humans so that our machines don’t cause serious harm to humanity.

In this episode, Connor provides candid insights into the current state of the field, including the very concerning lack of funding and human resources that are currently going into alignment research. Amongst many other things, we discuss how the research is conducted, the lessons we can learn from animals, and the kind of policies and processes humans need to put into place if we are to prevent what Connor currently sees as a highly plausible existential threat. 

Find out more about Conjecture at conjecture.dev or follow Connor and his work at twitter.com/NPCollapse

**

Apply for registration to our exclusive South By Southwest event on March 14th @ www.su.org/basecamp-sxsw

Apply for an Executive Program Scholarship at su.org/executive-program/ep-scholarship

Learn more about Singularity: su.org

Host: Steven Parton - LinkedIn / Twitter

Music by: Amine el Filali


Hosted by Singularity University, The Singularity Discussion Series is a deep and ongoing conversation about the forces that will define tomorrow. Rather than offering quick tech news, this podcast creates a space for sustained exploration. Each episode features leading thinkers and practitioners who examine exponential technologies like artificial intelligence, biotechnology, blockchain, and quantum computing. The discussions go beyond isolated innovations to focus on their powerful convergence-the point where these fields intersect to reshape everything from global industries and economic models to the fabric of our daily lives. You’ll hear nuanced analysis on both the immediate implications and the long-term trajectories of these changes. The goal is to unpack the breakthroughs that are actively redefining the boundaries of the possible, providing listeners with a clearer, more thoughtful understanding of the complex future we are building together. Tune in for a consistently insightful and forward-looking dialogue that challenges assumptions and illuminates the path ahead.
Author: Language: en-us Episodes: 100

The Singularity Discussion Series
Podcast Episodes
FBL64: Susan Schneider - Philosophy of the Future Mind [not-audio_url] [/not-audio_url]

Duration: 41:13
This week our guest academic philosopher, Susan Schneider, who is the founding director for the Center for the Future Mind at Florida Atlantic University, as well as the author of the 2019 book, Artificial You: AI and th…
FBL63: Isabel Millar - Sex, Psychoanalysis, Film, and A.I. [not-audio_url] [/not-audio_url]

Duration: 47:40
This week our guest is philosopher and psychoanalytic theorist, Isabel Millar, who recently released her book, The Psychoanalysis of Artificial Intelligence, in which she explores the much neglected role of enjoyment and…
FBL62: Stefan Sorgner - Data & Culture in the Transhuman Future [not-audio_url] [/not-audio_url]

Duration: 1:12:01
This week our guest is German professor and philosopher, Stefan Sorgner, who has extensively studied and written about the topic of transhumanism–which is commonly defined as a movement that promotes the use of technolog…
FBL61: Jim Rutt - Engineering a Better Society With Game B [not-audio_url] [/not-audio_url]

Duration: 52:59
This week our guest is businessman and entrepreneur, Jim Rutt, who you may know as the former chairman of the Sante Fe Institute or from his own podcast, The Jim Rutt show. Jim is also arguably the founding spearhead for…
FBL60: Bunnie the Hacktivist - Restoring Our Power Over Technology [not-audio_url] [/not-audio_url]

Duration: 51:43
This week our guest is hacker, Andrew “Bunnie” Huang, who is well known for clashing with Microsoft in the early 2000s when he taught others how to hack and modify the Xbox. Nearly twenty years later, and Bunnie is suing…
FBL59: Todd Rose - Navigating Collective Illusions Online [not-audio_url] [/not-audio_url]

Duration: 55:21
This week our guest is Todd Rose, who was previously a professor at Harvard University where he led the Laboratory for the Science of Individuality and was the faculty director of the Mind, Brain, and Education program.…
FBL58: Yanis Varoufakis - Techno-Feudalism & the Death of Capitalism [not-audio_url] [/not-audio_url]

Duration: 37:49
This week my guest is Yanis Varoufakis, a Greek economist and politician who was the acting Minister of Finance in Greece during their debt crises in 2015. Since then, he founded the political party Mera25, and now sits…
FBL57: Bernardo Kastrup - The Nature of Reality & AI [not-audio_url] [/not-audio_url]

Duration: 1:19:36
This week my guest is Bernardo Kastrup, who has an impressive background of working for CERN, the world’s largest and most advanced particle physics laboratory, has written 10 books, and holds a PhD in both computer engi…
FBL56: Looking back at... Academics of the Singularity [not-audio_url] [/not-audio_url]

Duration: 38:06
As we pass the second yearly anniversary of the show, we take a look back at some of our favorite segments from past episodes with academic guests who share our passion for everything "Singularity". This includes episode…