AI Computing Hardware - Past, Present, and Future

AI Computing Hardware - Past, Present, and Future

Author: Skynet Today January 29, 2025 Duration: 2:04:24
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible. Join our brand new Discord here! https://discord.gg/nTyezGSKwP Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode:  - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.  - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.  - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.  - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps: 00:00:00 Introduction 00:03:08 Historical Recap: Early AI and Hardware 00:11:51 The Rise of GPUs and Deep Learning 00:15:39 Scaling Laws and the Evolution of AI Models 00:24:05 The Bitter Lesson and the Future of AI Compute 00:25:58 Moore's Law and Huang's Law 00:30:12 Memory and Logic in AI Hardware 00:34:53 Challenges in AI Hardware: The Memory Wall 00:37:08 The Role of GPUs in Modern AI 00:42:27 Fitting Neural Nets in GPUs 00:48:04 Batch Sizes and GPU Utilization 00:52:47 Parallelism in AI Models 00:55:53 Matrix Multiplications and GPUs 00:59:57 Understanding B200 and GB200 01:05:41 Data Center Hierarchy 01:13:42 High Bandwidth Memory (HBM) 01:16:45 Fabrication and Packaging 01:20:17 The Complexity of Semiconductor Fabrication 01:24:34 Understanding Process Nodes 01:28:26 The Art of Fabrication 01:33:17 The Role of Yield in Fabrication 01:35:47 The Photolithography Process 01:40:38 Deep Ultraviolet Lithography (DUV) 01:43:58 Extreme Ultraviolet Lithography (EUV) 01:51:46 Export Controls and Their Impact 01:54:22 The Rise of Custom AI Hardware 02:00:10 The Future of AI and Hardware See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Keeping up with artificial intelligence can feel like drinking from a firehose. Every week brings a new breakthrough, a surprising application, or an urgent ethical debate. Last Week in AI, from the team at Skynet Today, is here to turn that torrent into a clear, digestible stream. Instead of getting lost in the noise, you'll get a thoughtful rundown of the developments that actually have impact, explained without unnecessary jargon. Each episode feels like a conversation with well-informed friends who have done the homework for you, sifting through research papers, product launches, and industry announcements to highlight what's substantive. You'll hear nuanced discussions that go beyond the headlines, considering the real-world implications of new models, policy shifts, and corporate moves in the tech landscape. This podcast doesn't just tell you what happened; it provides context on why it matters for developers, businesses, and society at large. It’s an efficient way to stay informed and critically engaged with a field that is reshaping our world at a breathtaking pace. Tune in for a consistently insightful analysis that makes the complex world of AI feel accessible and relevant, week after week.
Author: Language: English Episodes: 100

Last Week in AI
Podcast Episodes
#221 - OpenAI Codex, Gemini in Chrome, K2-Think, SB 53 [not-audio_url] [/not-audio_url]

Duration: 47:01
Our 221st episode with a summary and discussion of last week's big AI news! Recorded on 09/19/2025 Note: we transitioned to a new RSS feed and it seems this did not make it to there, so this may be posted about 2 weeks p…
#220 - Gemini 2.5 Flash Image, Claude for Chrome, DeepConf [not-audio_url] [/not-audio_url]

Duration: 52:43
Our 220th episode with a summary and discussion of last week's big AI news! Recorded on 08/30/2025 Check out Andrey's work over at Astrocade , sign up to be an ambassador here Hosted by Andrey Kurenkov and co-hosted by D…
#219 - GPT 5, Opus 4.1, OpenAI's Open Source, Astrocade [not-audio_url] [/not-audio_url]

Duration: 1:48:33
Our 219th episode with a summary and discussion of last week's big AI news! Recorded on 08/08/2025 Check out Andrey's work over at Astrocade , sign up to be an ambassador here Hosted by Andrey Kurenkov and Jeremie Harris…
#218 - Github Spark, MegaScience, US AI Action Plan [not-audio_url] [/not-audio_url]

Duration: 1:32:12
Our 218th episode with a summary and discussion of last week's big AI news! Recorded on 07/25/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#217 - ChatGPT Agent, Kimi k2, Hiring Drama [not-audio_url] [/not-audio_url]

Duration: 53:00
Our 217th episode with a summary and discussion of last week's big AI news! Recorded on 07/17/2025 Hosted by Andrey Kurenkov and guest co-host Jon Krohn. Feel free to email us your questions and feedback at contact@lastw…
#216 - Grok 4, Project Rainier, Kimi K2 [not-audio_url] [/not-audio_url]

Duration: 1:42:10
Our 216th episode with a summary and discussion of last week's big AI news! Recorded on 07/11/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#214 - Gemini CLI, io drama, AlphaGenome, copyright rulings [not-audio_url] [/not-audio_url]

Duration: 1:33:32
Our 214th episode with a summary and discussion of last week's big AI news! Recorded on 06/27/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#213 - Midjourney video, Gemini 2.5 Flash-Lite, LiveCodeBench Pro [not-audio_url] [/not-audio_url]

Duration: 36:36
Our 213nd episode with a summary and discussion of last week's big AI news! Recorded on 06/21/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#212 - o3 pro, Cursor 1.0, ProRL, Midjourney Sued [not-audio_url] [/not-audio_url]

Duration: 1:46:08
Our 212th episode with a summary and discussion of last week's big AI news! Recorded on 06/13/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…