AI Computing Hardware - Past, Present, and Future

AI Computing Hardware - Past, Present, and Future

Author: Skynet Today January 29, 2025 Duration: 2:04:24
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible. Join our brand new Discord here! https://discord.gg/nTyezGSKwP Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode:  - Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.  - ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.  - Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.  - New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps: 00:00:00 Introduction 00:03:08 Historical Recap: Early AI and Hardware 00:11:51 The Rise of GPUs and Deep Learning 00:15:39 Scaling Laws and the Evolution of AI Models 00:24:05 The Bitter Lesson and the Future of AI Compute 00:25:58 Moore's Law and Huang's Law 00:30:12 Memory and Logic in AI Hardware 00:34:53 Challenges in AI Hardware: The Memory Wall 00:37:08 The Role of GPUs in Modern AI 00:42:27 Fitting Neural Nets in GPUs 00:48:04 Batch Sizes and GPU Utilization 00:52:47 Parallelism in AI Models 00:55:53 Matrix Multiplications and GPUs 00:59:57 Understanding B200 and GB200 01:05:41 Data Center Hierarchy 01:13:42 High Bandwidth Memory (HBM) 01:16:45 Fabrication and Packaging 01:20:17 The Complexity of Semiconductor Fabrication 01:24:34 Understanding Process Nodes 01:28:26 The Art of Fabrication 01:33:17 The Role of Yield in Fabrication 01:35:47 The Photolithography Process 01:40:38 Deep Ultraviolet Lithography (DUV) 01:43:58 Extreme Ultraviolet Lithography (EUV) 01:51:46 Export Controls and Their Impact 01:54:22 The Rise of Custom AI Hardware 02:00:10 The Future of AI and Hardware See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Keeping up with artificial intelligence can feel like drinking from a firehose. Every week brings a new breakthrough, a surprising application, or an urgent ethical debate. Last Week in AI, from the team at Skynet Today, is here to turn that torrent into a clear, digestible stream. Instead of getting lost in the noise, you'll get a thoughtful rundown of the developments that actually have impact, explained without unnecessary jargon. Each episode feels like a conversation with well-informed friends who have done the homework for you, sifting through research papers, product launches, and industry announcements to highlight what's substantive. You'll hear nuanced discussions that go beyond the headlines, considering the real-world implications of new models, policy shifts, and corporate moves in the tech landscape. This podcast doesn't just tell you what happened; it provides context on why it matters for developers, businesses, and society at large. It’s an efficient way to stay informed and critically engaged with a field that is reshaping our world at a breathtaking pace. Tune in for a consistently insightful analysis that makes the complex world of AI feel accessible and relevant, week after week.
Author: Language: English Episodes: 100

Last Week in AI
Podcast Episodes
#180 - Ideogram v2, Imagen 3, AI in 2030, Agent Q, SB 1047 [not-audio_url] [/not-audio_url]

Duration: 2:05:23
Our 180th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to ge…
#179 - Grok 2, Gemini Live, Flux, FalconMamba, AI Scientist [not-audio_url] [/not-audio_url]

Duration: 1:58:26
Our 179th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) If you would like to ge…
#178 - More Not-Acquihires, More OpenAI drama, More LLM Scaling Talk [not-audio_url] [/not-audio_url]

Duration: 2:05:37
Our 178th episode with a summary and discussion of last week's big AI news! NOTE: this is a re-upload with fixed audio, my bad on the last one! - Andrey With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) an…
#177 - Instagram AI Bots, Noam Shazeer -> Google, FLUX.1, SAM2 [not-audio_url] [/not-audio_url]

Duration: 1:52:58
Our 177th episode with a summary and discussion of last week's big AI news! With guest co-host Jon Krohn from the super data science podcast (https://www.superdatascience.com/podcast)! If you'd like to listen to the inte…
#176 - BIG WEEK for OSS! SearchGPT, Lamma 3.1 405B, Mistral Large 2 [not-audio_url] [/not-audio_url]

Duration: 1:25:45
Our 176th episode with a summary and discussion of last week's big AI news! NOTE: apologies for this episode coming out about a week late, things got in the way of editing it... With hosts Andrey Kurenkov (https://twitte…
#175 - GPT-4o Mini, OpenAI's Strawberry, Mixture of A Million Experts [not-audio_url] [/not-audio_url]

Duration: 1:47:29
Our 175th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) In this episode of Last…
#174 - Odyssey Text-to-Video, Groq LLM Engine, OpenAI Security Issues [not-audio_url] [/not-audio_url]

Duration: 2:04:25
Our 174rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) In this episode of Last…
#173 - Gemini Pro, Llama 400B, Gen-3 Alpha, Moshi, Supreme Court [not-audio_url] [/not-audio_url]

Duration: 1:49:49
Our 173rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) See full episode notes…
#172 - Claude and Gemini updates, Gemma 2, GPT-4 Critic [not-audio_url] [/not-audio_url]

Duration: 1:51:04
Our 172nd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris) Read out our text newsl…