Powering the AI Inference Wave with EPRI's Ben Sooter - Ep. 292

Powering the AI Inference Wave with EPRI's Ben Sooter - Ep. 292

Author: NVIDIA March 4, 2026 Duration: 32:20
AI is reshaping electricity demand. What does increased demand, and the shape of that demand, mean for the electric grid? Ben Sooter, Director of R&D at EPRI joins the podcast to explain why most of an AI model’s lifetime energy use comes from inference rather than training, and how micro data centers located near underutilized substations can help deliver low‑latency AI services while strengthening grid resilience.

Behind every major shift in how we live and work, there's a story about the technology that made it possible. The NVIDIA AI Podcast, produced by NVIDIA, delves into those narratives, moving beyond headlines to explore the human and technical ingenuity driving progress. Each episode connects with creators, researchers, and pioneers who are applying artificial intelligence and accelerated computing in surprising ways. You'll hear conversations that unpack complex ideas, from how AI is accelerating scientific discovery in medicine and climate science to its role in reimagining creative industries and building more sustainable systems. This isn't about abstract futures; it's a grounded look at the tools and collaborations solving real-world problems today. The discussions are crafted to be accessible, offering clarity on transformative topics without oversimplifying the profound work being done. Tuning into this podcast provides a unique vantage point into the ecosystem of innovation, where the focus is on practical applications and the thinkers turning possibility into reality. It's an ongoing series for anyone curious about the mechanics of change and how computational power is being harnessed to tackle some of our most pressing challenges and unlock new opportunities across every field.
Author: Language: English Episodes: 100

NVIDIA AI Podcast
Podcast Episodes
NVIDIA’s Annamalai Chockalingam on the Rise of LLMs - Ep. 206 [not-audio_url] [/not-audio_url]

Duration: 38:32
Generative AI and large language models (LLMs) are stirring change across industries — but according to NVIDIA Senior Product Manager of Developer Marketing Annamalai Chockalingam, “we’re still in the early innings.” In…
Making Machines Mindful: NYU Professor Talks Responsible AI - Ep. 205 [not-audio_url] [/not-audio_url]

Duration: 35:50
Artificial intelligence is now a household term. Responsible AI is hot on its heels. Julia Stoyanovich, associate professor of computer science and engineering at NYU and director of the university’s Center for Responsib…

«1...678910