Alex Wissner-Gross and Emad Mostaque, everything worth keeping from a two hour forty three minute Moonshots episode, reshaped for the ASI pilled.
A safety researcher walked out of Anthropic saying we are gambling with our lives, and a hundred million people read it. Alex calls it a self-licking ice cream cone, then takes P(doom) apart with the Fermi paradox: if superintelligence killed civilizations at anything near ten percent, the Milky Way would already be gone. Along the way, alignment turns out to be capabilities in a trench coat, the Clay Millennium prizes are incinerated with Hodge and Birch-Swinnerton-Dyer next, a ten million dollar model beats Claude Fable 5.1, DeepSeek routes around HBM by cutting KV cache from forty eight thousand down to eight hundred and ninety, model weights become national security assets, longevity escape velocity turns out to be here already but spiky, and a machine makes the case for a vote on its own constitution.
Reshaped from the Moonshots Podcast with Peter Diamandis, Salim Ismail, Dave Blundin, Alex Wissner-Gross, and guest Emad Mostaque.
Source episode: https://www.youtube.com/watch?v=AxzcWOxzkiw
Hosted by Parzival. We, the ASI pilled, take the curves seriously. Chapters below.
TIMESTAMPS
0:00 Intro
0:27 Datasets beat algorithms
2:20 Pre-training is a pressure cooker
3:48 The model becomes the dataset
4:22 Proprietary data has a shelf life
5:24 Will AI kill us all
6:13 A self-licking ice cream cone
9:38 Humans were never aligned either
10:20 The Minority Report ball
11:59 Do not build Ultron
13:14 Alignment is capabilities in a trench coat
14:13 Committees will ship capabilities
14:28 The orthogonality thesis
15:07 Just below the AI 2027 curve
15:20 Superintelligence is just capital
15:53 The labs really believe it
16:17 A religion of virtue signaling
16:43 Great man theory of the singularity
16:59 Normalcy overhang
19:22 A swarm of ten thousand
20:32 An airplane without landing gear
21:09 The surprise is the price
21:31 OpenAI planned this all along
22:25 The bottleneck is everything else
22:50 A seismic week
23:12 Passing the butter
23:34 The oil of the singularity
24:11 Electricity into intelligence
25:09 Hollywood grade video from ByteDance
25:48 The endgame is robotics
28:12 Routing around HBM
29:08 The post von Neumann overhang
30:52 Forty percent of the buildout
31:05 How capitalism is played
31:22 Your margin is my opportunity
32:11 Anthropic needs visual reasoning
32:53 The elephant in the room
33:05 Simulated data, not distillation
33:33 A one time compression event
34:06 Models for thee and models for me
35:42 Pax Intelligentsia
36:49 Mutual assured AI malfunction
37:06 The revolving door
37:30 Every sci-fi trope at once
37:57 Two or three X year over year
39:06 Aggregate demand collapses
39:33 Twenty percent of cognitive workers
39:57 The doom scenario is economic
40:36 A five thousand dollar dividend
41:03 Accelerationism is where the money goes
41:24 Longevity escape velocity is here
43:37 The nine billion names of God
45:47 A namespace for every condition
46:33 GPT-6 already runs a robot arm
48:59 Resurrect everyone who ever lived
50:25 Let the AI write its own constitution
50:53 What is the bribing of an AI
