Speed and Scale: How Today's AI Datacenters Are Operating Through Hypergrowth

Speed and Scale: How Today's AI Datacenters Are Operating Through Hypergrowth

Author: Demetrios February 3, 2026 Duration: 1:07:16
MLOps.community
Technology

Kris Beevers is the CEO at NetBox Labs, working on turning NetBox into the system of record and automation backbone for modern and AI-driven infrastructure.


Speed and Scale: How Today's AI Datacenters Are Operating Through Hypergrowth // MLOps Podcast #359 with Kris Beevers, CEO of NetBox Labs


Join the Community: https://go.mlops.community/YTJoinIn

Get the newsletter: https://go.mlops.community/YTNewsletter

MLOps GPU Guide: https://go.mlops.community/gpuguide


// Abstract

Hundreds of neocloud operators and "AI Factory" builders have emerged to serve the insatiable demand for AI infrastructure. These teams are compressing the design, build, deploy, operate, scale cycle of their infrastructures down to months, while managing massive footprints with lean teams. How? By applying modern intent-driven infrastructure automation principles to greenfield deployments. We'll explore how these teams carry design intent through to production, and how operating and automating around consistent infrastructure data is compressing "time to first train".


// Bio

Kris Beevers is the Co-founder and CEO of NetBox Labs. NetBox is used by nearly every Neocloud and AI datacenter to manage their networks and infrastructure. Kris is an engineer at heart and by background, and loves the leverage infrastructure innovation creates to accelerate technology and empower engineers to do their best work. A serial entrepreneur, Kris has founded and helped lead multiple other successful businesses in the internet and network infrastructure. Most recently, he co-founded and led NS1, which was acquired by IBM in 2023. He holds a Ph.D. in Computer Science from Rensselaer Polytechnic Institute and is based in New Jersey.


// Related Links

Website: https://netboxlabs.com/

Coding Agents Conference: https://luma.com/codingagents


~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~

Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore

Join our Slack community [https://go.mlops.community/slack]

Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)]

Sign up for the next meetup: [https://go.mlops.community/register]

MLOps Swag/Merch: [https://shop.mlops.community/]


Connect with Demetrios on LinkedIn: /dpbrinkm

Connect with Kris on LinkedIn: /beevek/


Timestamps:

[00:00] Observability and Delta Analysis

[00:26] New World Exploration

[04:06] Bottlenecks in AI Infrastructure

[13:37] Data Center Optimization Challenges

[19:58] Tech Stack Breakdown

[25:26] Data Center Design Principles

[31:32] Constraints and Automation in Design

[40:00] Complexity in Data Centers

[45:02] GPU Cloud Landscape

[50:24] Data Centers in Containers

[57:45] Observability Beyond Software

[1:04:43] Tighter Integrations vs NetBox

[1:06:47] Wrap up


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 100

Official website RSS
MLOps.community
Podcast Episodes
Economics of Building Data Centers, GPU Clouds, Sovereign AI [not-audio_url] [/not-audio_url]

Duration: 45:59
AI Conversations Powered by Prosus Group. Craig Tavares, COO of Buzz High Performance Compute, shares lessons from building GPU cloud infrastructure worldwide. He stresses the role of sovereign mandates, renewable power,…
The Era of AI Agents in Marketing // Joel Horwitz // #337 [not-audio_url] [/not-audio_url]

Duration: 48:56
The Era of AI Agents in Marketing // MLOps Podcast #337 with Joel Horwitz, Growth Engineer at Neoteric3D.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter/…
A Candid Conversation with the CEO of Stack Overflow [not-audio_url] [/not-audio_url]

Duration: 32:50
AI Conversations Powered by Prosus Group Stack Overflow is adapting to the AI era by licensing its trusted Q&A corpus, expanding into discussions and enterprise tools, and reinforcing its role as a reliable source as dev…
Knowledge is Eventually Consistent // Devin Stein // #335 [not-audio_url] [/not-audio_url]

Duration: 55:14
Knowledge is Eventually Consistent // MLOps Podcast #335 with Devin Stein, CEO of Dosu.Grateful to @Databricks and @hyperbolic-labs for supporting our podcast and helping us keep great conversations going.Join the Commun…
LinkedIn Recommender System Predictive ML vs LLMs [not-audio_url] [/not-audio_url]

Duration: 47:39
Demetrios chats with Arpita Vats about how LLMs are shaking up recommender systems. Instead of relying on hand-crafted features and rigid user clusters, LLMs can read between the lines—spotting patterns in user behavior…

«1...345678910»