AI Computing Hardware - Past, Present, and Future

AI Computing Hardware - Past, Present, and Future

Author: Skynet Today January 29, 2025 Duration: 2:04:24
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible. Join our brand new Discord here! https://discord.gg/nTyezGSKwP Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode:  - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.  - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.  - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.  - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps: 00:00:00 Introduction 00:03:08 Historical Recap: Early AI and Hardware 00:11:51 The Rise of GPUs and Deep Learning 00:15:39 Scaling Laws and the Evolution of AI Models 00:24:05 The Bitter Lesson and the Future of AI Compute 00:25:58 Moore's Law and Huang's Law 00:30:12 Memory and Logic in AI Hardware 00:34:53 Challenges in AI Hardware: The Memory Wall 00:37:08 The Role of GPUs in Modern AI 00:42:27 Fitting Neural Nets in GPUs 00:48:04 Batch Sizes and GPU Utilization 00:52:47 Parallelism in AI Models 00:55:53 Matrix Multiplications and GPUs 00:59:57 Understanding B200 and GB200 01:05:41 Data Center Hierarchy 01:13:42 High Bandwidth Memory (HBM) 01:16:45 Fabrication and Packaging 01:20:17 The Complexity of Semiconductor Fabrication 01:24:34 Understanding Process Nodes 01:28:26 The Art of Fabrication 01:33:17 The Role of Yield in Fabrication 01:35:47 The Photolithography Process 01:40:38 Deep Ultraviolet Lithography (DUV) 01:43:58 Extreme Ultraviolet Lithography (EUV) 01:51:46 Export Controls and Their Impact 01:54:22 The Rise of Custom AI Hardware 02:00:10 The Future of AI and Hardware See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Keeping up with artificial intelligence can feel like drinking from a firehose. Every week brings a new breakthrough, a surprising application, or an urgent ethical debate. Last Week in AI, from the team at Skynet Today, is here to turn that torrent into a clear, digestible stream. Instead of getting lost in the noise, you'll get a thoughtful rundown of the developments that actually have impact, explained without unnecessary jargon. Each episode feels like a conversation with well-informed friends who have done the homework for you, sifting through research papers, product launches, and industry announcements to highlight what's substantive. You'll hear nuanced discussions that go beyond the headlines, considering the real-world implications of new models, policy shifts, and corporate moves in the tech landscape. This podcast doesn't just tell you what happened; it provides context on why it matters for developers, businesses, and society at large. It’s an efficient way to stay informed and critically engaged with a field that is reshaping our world at a breathtaking pace. Tune in for a consistently insightful analysis that makes the complex world of AI feel accessible and relevant, week after week.
Author: Language: English Episodes: 100

Last Week in AI
Podcast Episodes
#231 - Claude Cowork, Anthropic $10B, Deep Delta Learning [not-audio_url] [/not-audio_url]

Duration: 1:43:17
Our 231st episode with a summary and discussion of last week's big AI news! Recorded on 01/16/2026 Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at contact@lastweekinai.co…
#230 - 2025 Retrospective, Nvidia buys Groq, GLM 4.7, METR [not-audio_url] [/not-audio_url]

Duration: 1:38:08
Our 230th episode with a summary and discussion of last week's big AI news! Recorded on 01/02/2026 Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at contact@lastweekinai.co…
#229 - Gemini 3 Flash, ChatGPT Apps, Nemotron 3 [not-audio_url] [/not-audio_url]

Duration: 1:27:07
Our 229th episode with a summary and discussion of last week's big AI news! Recorded on 12/19/2025 Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at contact@lastweekinai.co…
#228 - GPT 5.2, Scaling Agents, Weird Generalization [not-audio_url] [/not-audio_url]

Duration: 1:26:42
Our 228th episode with a summary and discussion of last week's big AI news! Recorded on 12/12/2025 Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at contact@lastweekinai.co…
#227 - Jeremie is back! DeepSeek 3.2, TPUs, Nested Learning [not-audio_url] [/not-audio_url]

Duration: 1:34:40
Our 227th episode with a summary and discussion of last week's big AI news! Recorded on 12/05/2025 Hosted by Andrey Kurenkov and Jeremie Harris Feel free to email us your questions and feedback at contact@lastweekinai.co…
#226 - Gemini 3, Claude Opus 4.5, Nano Banana Pro, LeJEPA [not-audio_url] [/not-audio_url]

Duration: 1:11:11
Our 226th episode with a summary and discussion of last week's big AI news! Recorded on 11/24/2025 Hosted by Andrey Kurenkov and co-hosted by Michelle Lee Feel free to email us your questions and feedback at contact@last…
#225 - GPT 5.1, Kimi K2 Thinking, Remote Labor Index [not-audio_url] [/not-audio_url]

Duration: 1:18:14
Our 225th episode with a summary and discussion of last week's big AI news! Recorded on 11/16/2025 Hosted by Andrey Kurenkov and co-hosted by Michelle Lee Feel free to email us your questions and feedback at contact@last…
#224 - OpenAI is for-profit! Cursor 2, Minimax M2, Udio copyright [not-audio_url] [/not-audio_url]

Duration: 1:31:43
Our 224th episode with a summary and discussion of last week's big AI news! Recorded on 10/31/2025 Hosted by Andrey Kurenkov and co-hosted by Gavin Purcell (check out AI For Humans and AndThen!) Feel free to email us you…
#223 - Haiku 4.5, OpenAI DevDay, Claude Skills, Scaling RL, SB 243 [not-audio_url] [/not-audio_url]

Duration: 1:11:45
We discuss a range of news from updates on AI models and tools by Microsoft, OpenAI, and Anthropic, to new business partnerships involving OpenAI and Broadcom, along with regulatory actions from California and market mov…
#222 - Sora 2, Sonnet 4.5, Vibes, Thinking Machines [not-audio_url] [/not-audio_url]

Duration: 1:37:16
Our 222st episode with a summary and discussion of last week's big AI news! Recorded on 10/03/2025 Hosted by Andrey Kurenkov and co-hosted by Jon Krohn Feel free to email us your questions and feedback at contact@lastwee…