“Unless its governance changes, Anthropic is untrustworthy” by null

“Unless its governance changes, Anthropic is untrustworthy” by null

Author: LessWrong November 30, 2025 Duration: 53:22
Anthropic is untrustworthy.

This post provides arguments, asks questions, and documents some examples of Anthropic's leadership being misleading and deceptive, holding contradictory positions that consistently shift in OpenAI's direction, lobbying to kill and water down regulation so helpful that employees of all major AI companies speak out to support it, and violating the fundamental promise the company was founded on. It also shares a few previously unreported details on Anthropic leadership's promises and efforts.[1]

Anthropic has a strong internal culture that has broadly EA views and values, and the company has strong pressures to appear to follow these views and values as it wants to retain talent and the loyalty of staff, but it's very unclear what they would do when it matters most. Their staff should demand answers.

There's a details box here with the title "Suggested questions for Anthropic employees to ask themselves, Dario, the policy team, and the board after reading this post, and for Dario and the board to answer publicly". The box contents are omitted from this narration. I would like to thank everyone who provided feedback on the draft; was willing to share information; and raised awareness of some of the facts discussed here.

[...]

---

Outline:

(01:34) 0. What was Anthropics supposed reason for existence?

(05:01) 1. In private, Dario frequently said he won't push the frontier of AI capabilities; later, Anthropic pushed the frontier

(10:54) 2. Anthropic said it will act under the assumption we might be in a pessimistic scenario, but it doesn't seem to do this

(14:40) 3. Anthropic doesnt have strong independent value-aligned governance

(14:47) Anthropic pursued investments from the UAE and Qatar

(17:32) The Long-Term Benefit Trust might be weak

(18:06) More general issues

(19:14) 4. Anthropic had secret non-disparagement agreements

(21:58) 5. Anthropic leaderships lobbying contradicts their image

(24:05) Europe

(24:44) SB-1047

(34:04) Dario argued against any regulation except for transparency requirements

(34:39) Jack Clark publicly lied about the NY RAISE Act

(36:39) Jack Clark tried to push for federal preemption

(37:04) 6. Anthropics leadership quietly walked back the RSP commitments

(37:55) Unannounced removal of the commitment to plan for a pause in scaling

(38:52) Unannounced change in October 2024 on defining ASL-N+1 by the time ASL-N is reached

(40:33) The last-minute change in May 2025 on insider threats

(41:11) 7. Why does Anthropic really exist?

(47:09) 8. Conclusion

The original text contained 11 footnotes which were omitted from this narration.

---

First published:
November 29th, 2025

Source:
https://www.lesswrong.com/posts/5aKRshJzhojqfbRyo/unless-its-governance-changes-anthropic-is-untrustworthy

---



Narrated by TYPE III AUDIO.

---

Images from the article:


Dive into a stream of ideas where technology, culture, philosophy, and society intersect, all through the lens of the LessWrong (Curated & Popular) podcast. This isn't a traditional talk show with hosts, but rather a curated audio library of the most impactful writing from the LessWrong community. Each episode is a narration of a full post, selected for its high value and interesting arguments, focusing on pieces that have been formally curated or have garnered significant community approval. You'll hear clear, thoughtful readings of essays that tackle complex topics like artificial intelligence, rational thinking, moral philosophy, and the forces shaping our future. The audio format lets you absorb these dense, often paradigm-shifting concepts during a commute or a walk, turning written analysis into an immersive listening experience. This particular feed is deliberately selective, offering a manageable stream of the community's standout work. For those who want an even deeper dive into the discussion, there are broader feeds available. The LessWrong (Curated & Popular) podcast serves as an intellectual filter, delivering the signal through the noise and inviting you to engage with some of the most rigorously examined ideas on the internet.
Author: Language: English Episodes: 100

LessWrong (Curated & Popular)
Podcast Episodes
“Little Echo” by Zvi [not-audio_url] [/not-audio_url]

Duration: 4:08
I believe that we will win. An echo of an old ad for the 2014 US men's World Cup team. It did not win. I was in Berkeley for the 2025 Secular Solstice. We gather to sing and to reflect. The night's theme was the opposite…
“A Pragmatic Vision for Interpretability” by Neel Nanda [not-audio_url] [/not-audio_url]

Duration: 1:03:58
Executive Summary The Google DeepMind mechanistic interpretability team has made a strategic pivot over the past year, from ambitious reverse-engineering to a focus on pragmatic interpretability: Trying to directly solve…
“AI in 2025: gestalt” by technicalities [not-audio_url] [/not-audio_url]

Duration: 41:59
This is the editorial for this year's "Shallow Review of AI Safety". (It got long enough to stand alone.) Epistemic status: subjective impressions plus one new graph plus 300 links. Huge thanks to Jaeho Lee, Jaime Sevill…
“Eliezer’s Unteachable Methods of Sanity” by Eliezer Yudkowsky [not-audio_url] [/not-audio_url]

Duration: 16:13
"How are you coping with the end of the world?" journalists sometimes ask me, and the true answer is something they have no hope of understanding and I have no hope of explaining in 30 seconds, so I usually answer someth…
“An Ambitious Vision for Interpretability” by leogao [not-audio_url] [/not-audio_url]

Duration: 8:49
The goal of ambitious mechanistic interpretability (AMI) is to fully understand how neural networks work. While some have pivoted towards more pragmatic approaches, I think the reports of AMI's death have been greatly ex…
“MIRI’s 2025 Fundraiser” by alexvermeer [not-audio_url] [/not-audio_url]

Duration: 15:37
MIRI is running its first fundraiser in six years, targeting $6M. The first $1.6M raised will be matched 1:1 via an SFF grant. Fundraiser ends at midnight on Dec 31, 2025. Support our efforts to improve the conversation…