AI Computing Hardware - Past, Present, and Future

AI Computing Hardware - Past, Present, and Future

Author: Skynet Today January 29, 2025 Duration: 2:04:24
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible. Join our brand new Discord here! https://discord.gg/nTyezGSKwP Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode:  - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.  - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.  - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.  - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps: 00:00:00 Introduction 00:03:08 Historical Recap: Early AI and Hardware 00:11:51 The Rise of GPUs and Deep Learning 00:15:39 Scaling Laws and the Evolution of AI Models 00:24:05 The Bitter Lesson and the Future of AI Compute 00:25:58 Moore's Law and Huang's Law 00:30:12 Memory and Logic in AI Hardware 00:34:53 Challenges in AI Hardware: The Memory Wall 00:37:08 The Role of GPUs in Modern AI 00:42:27 Fitting Neural Nets in GPUs 00:48:04 Batch Sizes and GPU Utilization 00:52:47 Parallelism in AI Models 00:55:53 Matrix Multiplications and GPUs 00:59:57 Understanding B200 and GB200 01:05:41 Data Center Hierarchy 01:13:42 High Bandwidth Memory (HBM) 01:16:45 Fabrication and Packaging 01:20:17 The Complexity of Semiconductor Fabrication 01:24:34 Understanding Process Nodes 01:28:26 The Art of Fabrication 01:33:17 The Role of Yield in Fabrication 01:35:47 The Photolithography Process 01:40:38 Deep Ultraviolet Lithography (DUV) 01:43:58 Extreme Ultraviolet Lithography (EUV) 01:51:46 Export Controls and Their Impact 01:54:22 The Rise of Custom AI Hardware 02:00:10 The Future of AI and Hardware See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Keeping up with artificial intelligence can feel like drinking from a firehose. Every week brings a new breakthrough, a surprising application, or an urgent ethical debate. Last Week in AI, from the team at Skynet Today, is here to turn that torrent into a clear, digestible stream. Instead of getting lost in the noise, you'll get a thoughtful rundown of the developments that actually have impact, explained without unnecessary jargon. Each episode feels like a conversation with well-informed friends who have done the homework for you, sifting through research papers, product launches, and industry announcements to highlight what's substantive. You'll hear nuanced discussions that go beyond the headlines, considering the real-world implications of new models, policy shifts, and corporate moves in the tech landscape. This podcast doesn't just tell you what happened; it provides context on why it matters for developers, businesses, and society at large. It’s an efficient way to stay informed and critically engaged with a field that is reshaping our world at a breathtaking pace. Tune in for a consistently insightful analysis that makes the complex world of AI feel accessible and relevant, week after week.
Author: Language: English Episodes: 100

Last Week in AI
Podcast Episodes
#211 - Claude Voice, Flux Kontext, wrong RL research? [not-audio_url] [/not-audio_url]

Duration: 1:38:06
Our 211th episode with a summary and discussion of last week's big AI news! Recorded on 05/31/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#210 - Claude 4, Google I/O 2025, OpenAI+io, Gemini Diffusion [not-audio_url] [/not-audio_url]

Duration: 1:44:47
Our 210th episode with a summary and discussion of last week's big AI news! Recorded on 05/23/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#209 - OpenAI non-profit, US diffusion rules, AlphaEvolve [not-audio_url] [/not-audio_url]

Duration: 1:53:14
Our 209th episode with a summary and discussion of last week's big AI news! Recorded on 05/16/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#208 - Claude Integrations, ChatGPT Sycophancy, Leaderboard Cheats [not-audio_url] [/not-audio_url]

Duration: 1:55:25
Our 208th episode with a summary and discussion of last week's big AI news! Recorded on 05/02/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#207 - GPT 4.1, Gemini 2.5 Flash, Ironwood, Claude Max [not-audio_url] [/not-audio_url]

Duration: 1:42:30
Our 207th episode with a summary and discussion of last week's big AI news! Recorded on 04/14/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#206 - Llama 4, Nova Act, xAI buys X, PaperBench [not-audio_url] [/not-audio_url]

Duration: 1:13:44
Our 206th episode with a summary and discussion of last week's big AI news! Recorded on 04/07/2025 Try out the Astrocade demo here! https://www.astrocade.com/ Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to em…
#205 - Gemini 2.5, ChatGPT Image Gen, Thoughts of LLMs [not-audio_url] [/not-audio_url]

Duration: 1:34:18
Our 205th episode with a summary and discussion of last week's big AI news! Recorded on 03/28/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#204 - OpenAI Audio, Rubin GPUs, MCP, Zochi [not-audio_url] [/not-audio_url]

Duration: 1:49:03
Our 204th episode with a summary and discussion of last week's big AI news! Recorded on 03/21/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#203 - Gemini Image Gen, Ascend 910C, Gemma 3, Gemini Robotics [not-audio_url] [/not-audio_url]

Duration: 1:46:23
Our 203rd episode with a summary and discussion of last week's big AI news! Recorded on 03/14/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…
#202 - Qwen-32B, Anthropic's $3.5 billion, LLM Cognitive Behaviors [not-audio_url] [/not-audio_url]

Duration: 1:19:52
Our 202nd episode with a summary and discussion of last week's big AI news! Recorded on 03/07/2025 Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.c…