Stephen Fleming: Metacognition

Stephen Fleming: Metacognition

Author: Helen and Dave Edwards December 12, 2021 Duration: 1:01:40

It’s human to know oneself. We are able to self-monitor, understand our cognition, and recognize gaps in our knowledge. This is called metacognition—we think about how we think. We can think of it as self-awareness or the ability to understand the state of our knowledge. In this episode, we talk with Stephen Fleming, Professor of Cognitive Neuroscience at University College London.

Steve has recently published a book on this topic called Know Thyself. We wanted to explore a number of ideas with him—metacognition as uniquely human, as an important skill, whether machines need to have some form of awareness and the issue of agency and machines. 

In his book, Steve proposes that we either put self-awareness into machines, thereby reducing our need for self-awareness, or design interfaces that increase human self-awareness. If we have self-aware machines then we risk losing our own. If we want better self-awareness we must prioritize how an AI metacognition can show us its uncertainty and error. This second route is more likely to result in humans retaining autonomy. It preserves the human role of wrestling uncertainty, seeking explanations, and making sense of the world. Perhaps the biggest insight for us regarding agency and AI is how to think about it as having a structure. We talk about how true autonomy is aligning our choices and wants and how machines play a role.

About Artficiality from Helen & Dave Edwards:

Artificiality is a research and services business founded in 2019 to help people make sense of artificial intelligence and complex change. Our weekly publication provides thought-provoking ideas, science reviews, and market research and our monthly research releases provides leaders with actionable intelligence and insights for applying AI in their organizations. We provide research-based and expert-led AI strategy and complex change management services to organizations around the world.

We are artificial philosophers and meta-researchers who aim to make the philosophical more practical and the practical more philosophical. We believe that understanding AI requires synthesizing research across disciplines: behavioral economics, cognitive science, complexity science, computer science, decision science, design, neuroscience, philosophy, and psychology. We are dedicated to unraveling the profound impact of AI on our society, communities, workplaces, and personal lives. 

Subscribe for free at https://www.artificiality.world.

If you enjoy our podcasts, please subscribe and leave a positive rating or comment. Sharing your positive feedback helps us reach more people and connect them with the world’s great minds.

Learn more about ⁠⁠Sonder Studio⁠⁠

Subscribe to get ⁠⁠Artificiality⁠⁠ delivered to your email

Learn about our book ⁠⁠Make Better Decisions⁠⁠ and buy it on ⁠⁠Amazon⁠⁠

Thanks to ⁠⁠Jonathan Coulton⁠⁠ for our music

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.artificiality.world.

#ai #artificialintelligence #generativeai #airesearch #complexity #futureofai 



Hosted by Helen and Dave Edwards, Stay Human, from the Artificiality Institute is a conversation that lives in the messy, human space between our tools and our selves. Each episode digs into the subtle ways artificial intelligence is reshaping our daily decisions, our creative impulses, and even our sense of identity. This isn't a technical manual or a series of futuristic predictions; it's a grounded exploration of how we maintain our agency in a world increasingly mediated by algorithms. The podcast operates from a core belief: that our engagement with AI should be about more than just safety or efficiency-it needs to be meaningful and worthwhile. You'll hear discussions rooted in story-based research, where complex ideas about cognition and ethics are unpacked through relatable narratives and real-world examples. The goal is to provide a framework for thoughtful choice, helping each of us consciously design the relationship we want with the machines in our lives. Tuning in offers a chance to step back from the hype and consider how we can actively remain the authors of our own minds, preserving what makes us uniquely human even as the technology evolves. It's an essential listen for anyone curious about the personal and philosophical dimensions of our digital age.
Author: Language: en-us Episodes: 100

Stay Human, from the Artificiality Institute
Podcast Episodes
Steven Sloman: LLMs and Deliberative Reasoning [not-audio_url] [/not-audio_url]

Duration: 1:01:06
If you’ve used a large language model, you’ve likely had one or more moments of amazement as the tool immediately responded with impressive content from its massive data cosmos training set. But you’ve likely also had mo…
Julia Rhodes Davis: Advancing Racial Equity [not-audio_url] [/not-audio_url]

Duration: 47:39
In this episode, we speak with Julia Rhodes Davis, a Senior Advisor at Data & Society, about her recent report "Advancing Racial Equity Through Technology Policy" published by the AI Now Institute. This comprehensive rep…
Alicia Juarrero: Context Changes Everything [not-audio_url] [/not-audio_url]

Duration: 1:04:50
Grounding her work in the problem of causation, Alicia Juarrero challenges previously held beliefs that only forceful impacts are causes. Constraints, she claims, bring about effects as well, and they enable the emergenc…
Jai Vipra: Computational Power and AI [not-audio_url] [/not-audio_url]

Duration: 41:17
Jai Vipra is a research fellow at the AI Now Institute where she focuses on competition issues in frontier AI models. She recently published the report Computational Power and AI which focuses on compute as a core depend…
Wendy Wong: We, the Data, and Human Rights [not-audio_url] [/not-audio_url]

Duration: 58:40
Wendy Wong is a professor of political science and principal’s research chair at the University of British Columbia where she researches and teaches about the governance of emerging technologies, human rights, and civil…
Chris Summerfield: Natural General Intelligence [not-audio_url] [/not-audio_url]

Duration: 56:53
Chris Summerfield is a Professor of Cognitive Science at the University of Oxford. His work is concerned with understanding how humans learn and make decisions. He is interested in how humans acquire new concepts or patt…
Michael Bungay Stanier: How to Work with (Almost) Anyone [not-audio_url] [/not-audio_url]

Duration: 58:02
Michael Bungay Stanier has an extraordinary talent for distilling the complexity of human relationships into easy to remember and follow frameworks—doing so with just the right amount of Australian humor and plenty of vu…
Synthesis & Generative AI [not-audio_url] [/not-audio_url]

Duration: 33:21
An exploration of how we might conceptualize the design of AGI within the context of human left and right brains. The tension between AI and human functioning highlights unique cooperation. AI uses language, abstraction,…
Jonathan Coulton: Generative AI, songwriting, and creativity [not-audio_url] [/not-audio_url]

Duration: 1:01:37
If you’ve read our show notes, you’ll know that our music was written and performed by Jonathan Coulton. I’ve known Jonathan for more than 30 years, dating back to when we sang together in college. But that’s a story for…
Is it possible for AI to be meaningful? [not-audio_url] [/not-audio_url]

Duration: 36:30
An exploration of the intersection of AI, meaning, and human relationships. In this episode, we dive deep into the role of AI in our lives and how it can influence our perception of meaning. We explore how AI, and specif…