“AI in 2025: gestalt” by technicalities

“AI in 2025: gestalt” by technicalities

Author: LessWrong December 8, 2025 Duration: 41:59
This is the editorial for this year's "Shallow Review of AI Safety". (It got long enough to stand alone.)

Epistemic status: subjective impressions plus one new graph plus 300 links.

Huge thanks to Jaeho Lee, Jaime Sevilla, and Lexin Zhou for running lots of tests pro bono and so greatly improving the main analysis.

tl;dr

  • Informed people disagree about the prospects for LLM AGI – or even just what exactly was achieved this year. But they at least agree that we’re 2-20 years off (if you allow for other paradigms arising). In this piece I stick to arguments rather than reporting who thinks what.
  • My view: compared to last year, AI is much more impressive but not much more useful. They improved on many things they were explicitly optimised for (coding, vision, OCR, benchmarks), and did not hugely improve on everything else. Progress is thus (still!) consistent with current frontier training bringing more things in-distribution rather than generalising very far.
  • Pretraining (GPT-4.5, Grok 4, but also counterfactual large runs which weren’t done) disappointed people this year. It's probably not because it wouldn’t work; it was just ~30 times more efficient to do post-training instead, on the margin. This should [...]
---

Outline:

(00:36) tl;dr

(03:51) Capabilities in 2025

(04:02) Arguments against 2025 capabilities growth being above-trend

(08:48) Arguments for 2025 capabilities growth being above-trend

(16:19) Evals crawling towards ecological validity

(19:28) Safety in 2025

(22:39) The looming end of evals

(24:35) Prosaic misalignment

(26:56) What is the plan?

(29:30) Things which might fundamentally change the nature of LLMs

(31:03) Emergent misalignment and model personas

(32:32) Monitorability

(34:15) New people

(34:49) Overall

(35:17) Discourse in 2025

The original text contained 9 footnotes which were omitted from this narration.

---

First published:
December 7th, 2025

Source:
https://www.lesswrong.com/posts/Q9ewXs8pQSAX5vL7H/ai-in-2025-gestalt

---



Narrated by TYPE III AUDIO.

---

Images from the article:




Dive into a stream of ideas where technology, culture, philosophy, and society intersect, all through the lens of the LessWrong (Curated & Popular) podcast. This isn't a traditional talk show with hosts, but rather a curated audio library of the most impactful writing from the LessWrong community. Each episode is a narration of a full post, selected for its high value and interesting arguments, focusing on pieces that have been formally curated or have garnered significant community approval. You'll hear clear, thoughtful readings of essays that tackle complex topics like artificial intelligence, rational thinking, moral philosophy, and the forces shaping our future. The audio format lets you absorb these dense, often paradigm-shifting concepts during a commute or a walk, turning written analysis into an immersive listening experience. This particular feed is deliberately selective, offering a manageable stream of the community's standout work. For those who want an even deeper dive into the discussion, there are broader feeds available. The LessWrong (Curated & Popular) podcast serves as an intellectual filter, delivering the signal through the noise and inviting you to engage with some of the most rigorously examined ideas on the internet.
Author: Language: English Episodes: 100

LessWrong (Curated & Popular)
Podcast Episodes
“Little Echo” by Zvi [not-audio_url] [/not-audio_url]

Duration: 4:08
I believe that we will win. An echo of an old ad for the 2014 US men's World Cup team. It did not win. I was in Berkeley for the 2025 Secular Solstice. We gather to sing and to reflect. The night's theme was the opposite…
“A Pragmatic Vision for Interpretability” by Neel Nanda [not-audio_url] [/not-audio_url]

Duration: 1:03:58
Executive Summary The Google DeepMind mechanistic interpretability team has made a strategic pivot over the past year, from ambitious reverse-engineering to a focus on pragmatic interpretability: Trying to directly solve…
“Eliezer’s Unteachable Methods of Sanity” by Eliezer Yudkowsky [not-audio_url] [/not-audio_url]

Duration: 16:13
"How are you coping with the end of the world?" journalists sometimes ask me, and the true answer is something they have no hope of understanding and I have no hope of explaining in 30 seconds, so I usually answer someth…
“An Ambitious Vision for Interpretability” by leogao [not-audio_url] [/not-audio_url]

Duration: 8:49
The goal of ambitious mechanistic interpretability (AMI) is to fully understand how neural networks work. While some have pivoted towards more pragmatic approaches, I think the reports of AMI's death have been greatly ex…
“MIRI’s 2025 Fundraiser” by alexvermeer [not-audio_url] [/not-audio_url]

Duration: 15:37
MIRI is running its first fundraiser in six years, targeting $6M. The first $1.6M raised will be matched 1:1 via an SFF grant. Fundraiser ends at midnight on Dec 31, 2025. Support our efforts to improve the conversation…
“The Boring Part of Bell Labs” by Elizabeth [not-audio_url] [/not-audio_url]

Duration: 25:57
It took me a long time to realize that Bell Labs was cool. You see, my dad worked at Bell Labs, and he has not done a single cool thing in his life except create me and bring a telescope to my third grade class. Nothing…