"The persona selection model" by Sam Marks

"The persona selection model" by Sam Marks

Author: LessWrong February 25, 2026 Duration: 1:34:24
TL;DR

We describe the persona selection model (PSM): the idea that LLMs learn to simulate diverse characters during pre-training, and post-training elicits and refines a particular such Assistant persona. Interactions with an AI assistant are then well-understood as being interactions with the Assistant—something roughly like a character in an LLM-generated story. We survey empirical behavioral, generalization, and interpretability-based evidence for PSM. PSM has consequences for AI development, such as recommending anthropomorphic reasoning about AI psychology and introduction of positive AI archetypes into training data. An important open question is how exhaustive PSM is, especially whether there might be sources of agency external to the Assistant persona, and how this might change in the future.

Introduction

What sort of thing is a modern AI assistant? One perspective holds that they are shallow, rigid systems that narrowly pattern-match user inputs to training data. Another perspective regards AI systems as alien creatures with learned goals, behaviors, and patterns of thought that are fundamentally inscrutable to us. A third option is to anthropomorphize AIs and regard them as something like a digital human. Developing good mental models for AI systems is important for predicting and controlling their behaviors. If our goal is to [...]

---

Outline:

(00:10) TL;DR

(01:02) Introduction

(06:18) The persona selection model

(07:09) Predictive models and personas

(09:54) From predictive models to AI assistants

(12:43) Statement of the persona selection model

(16:25) Empirical evidence for PSM

(16:58) Evidence from generalization

(22:48) Behavioral evidence

(28:42) Evidence from interpretability

(35:42) Complicating evidence

(42:21) Consequences for AI development

(42:45) AI assistants are human-like

(43:23) Anthropomorphic reasoning about AI assistants is productive

(49:17) AI welfare

(51:35) The importance of good AI role models

(53:49) Interpretability-based alignment auditing will be tractable

(56:43) How exhaustive is PSM?

(59:46) Shoggoths, actors, operating systems, and authors

(01:00:46) Degrees of non-persona LLM agency en-US-AvaMultilingualNeural__ Green leaf or plant with yellow smiley face character attached.

(01:06:52) Other sources of persona-like agency

(01:11:17) Why might we expect PSM to be exhaustive?

(01:12:21) Post-training as elicitation

(01:14:54) Personas provide a simple way to fit the post-training data

(01:17:55) How might these considerations change?

(01:20:01) Empirical observations

(01:27:07) Conclusion

(01:30:30) Acknowledgements

(01:31:15) Appendix A: Breaking character

(01:32:52) Appendix B: An example of non-persona deception

The original text contained 5 footnotes which were omitted from this narration.

---

First published:
February 23rd, 2026

Source:
https://www.lesswrong.com/posts/dfoty34sT7CSKeJNn/the-persona-selection-model

---



Narrated by TYPE III AUDIO.

---


Dive into a stream of ideas where technology, culture, philosophy, and society intersect, all through the lens of the LessWrong (Curated & Popular) podcast. This isn't a traditional talk show with hosts, but rather a curated audio library of the most impactful writing from the LessWrong community. Each episode is a narration of a full post, selected for its high value and interesting arguments, focusing on pieces that have been formally curated or have garnered significant community approval. You'll hear clear, thoughtful readings of essays that tackle complex topics like artificial intelligence, rational thinking, moral philosophy, and the forces shaping our future. The audio format lets you absorb these dense, often paradigm-shifting concepts during a commute or a walk, turning written analysis into an immersive listening experience. This particular feed is deliberately selective, offering a manageable stream of the community's standout work. For those who want an even deeper dive into the discussion, there are broader feeds available. The LessWrong (Curated & Popular) podcast serves as an intellectual filter, delivering the signal through the noise and inviting you to engage with some of the most rigorously examined ideas on the internet.
Author: Language: English Episodes: 100

LessWrong (Curated & Popular)
Podcast Episodes
“Claude 4.5 Opus’ Soul Document” by null [not-audio_url] [/not-audio_url]

Duration: 1:19:57
Summary As far as I understand and uncovered, a document for the character training for Claude is compressed in Claude's weights. The full document can be found at the "Anthropic Guidelines" heading at the end. The Gist…
“Alignment remains a hard, unsolved problem” by null [not-audio_url] [/not-audio_url]

Duration: 23:23
Thanks to (in alphabetical order) Joshua Batson, Roger Grosse, Jeremy Hadfield, Jared Kaplan, Jan Leike, Jack Lindsey, Monte MacDiarmid, Francesco Mosconi, Chris Olah, Ethan Perez, Sara Price, Ansh Radhakrishnan, Fabien…
“Video games are philosophy’s playground” by Rachel Shu [not-audio_url] [/not-audio_url]

Duration: 31:50
Crypto people have this saying: "cryptocurrencies are macroeconomics' playground." The idea is that blockchains let you cheaply spin up toy economies to test mechanisms that would be impossibly expensive or unethical to…
“Stop Applying And Get To Work” by plex [not-audio_url] [/not-audio_url]

Duration: 2:52
TL;DR: Figure out what needs doing and do it, don't wait on approval from fellowships or jobs. If you... Have short timelines Have been struggling to get into a position in AI safety Are able to self-motivate your effort…
“Gemini 3 is Evaluation-Paranoid and Contaminated” by null [not-audio_url] [/not-audio_url]

Duration: 14:59
TL;DR: Gemini 3 frequently thinks it is in an evaluation when it is not, assuming that all of its reality is fabricated. It can also reliably output the BIG-bench canary string, indicating that Google likely trained on a…

«1...678910