Architecting Modern AI Systems: Platforms, Agents, and Integration

Architecting Modern AI Systems: Platforms, Agents, and Integration

Author: Demetrios May 28, 2026 Duration: 56:59

BuzzHPC Roundtable episode: Architecting Modern AI Systems: Platforms, Agents, and Integration


Join the Community: https://go.mlops.community/YTJoinIn

Get the newsletter: https://go.mlops.community/YTNewsletter

MLOps GPU Guide: https://go.mlops.community/gpuguide


Big shout-out to BuzzHPC for the collaboration!


// Abstract

As AI systems evolve into more autonomous, agent-driven architectures, the way we design platforms, tools, and infrastructure is rapidly changing. In this session with BuzzHPC, we explore the shifting boundary between platforms and tools, what developers expect platform providers to handle versus what they want to control and build themselves.


We unpack what modern agentic stacks look like today, how teams are structuring them in production, and where these architectures are heading as systems become more complex and distributed. A key focus will also be on agent interoperability, how different agents communicate, coordinate, and operate within shared environments.


Finally, we share insights and lessons from a recent AI hackathon delivered in partnership with Bell, Buzz, Mila, and KHP, highlighting how these concepts are being tested and applied by builders in real-world scenarios.


// Bio

Allen Roush

Allen has held senior technical and AI leadership roles at companies like Oracle and Intel. He's very active in the AI research space and open source communities. He's passionate about improving the creativity and coherence of AI systems.


Frédéric Bénard

Frédéric is Senior Director of AI Applications Development at Mila (Quebec AI Institute), where he leads a team focused on building the engineering foundations for applied AI systems. His work centers on translating cutting-edge research into scalable applications, including AI-driven platforms and agent-based systems used across research and industry collaborations.


Shuo Wang

Shuo leads the Responsible AI Office for Bell Canada, where all AI use cases are reviewed and assessed for potential harm and bias. Previously, he led a team of data scientists to expand a large-scale ML program to improve customer support effectiveness.


// Related Links

Website: https://www.buzzhpc.ai/


~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~

Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore

Join our Slack community [https://go.mlops.community/slack]

Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)]

Sign up for the next meetup: [https://go.mlops.community/register]

MLOps Swag/Merch: [https://shop.mlops.community/]


Connect with Demetrios on LinkedIn: /dpbrinkm

Connect with Allen on LinkedIn: /allen-roush-27721011b/

Connect with Frédéric on LinkedIn: /benard/

Connect with Shuo on LinkedIn: /shuow/


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 100

MLOps.community
Podcast Episodes
The Hidden Bottlenecks Slowing Down AI Agents [not-audio_url] [/not-audio_url]

Duration: 47:59
Demetrios chats with Paul van der Boor and Bruce Martens from Prosus about the real bottlenecks in AI agent development—not tools, but evaluation and feedback. They unpack when to build vs. buy, the tradeoffs of external…
9 Commandments for Building AI Agents [not-audio_url] [/not-audio_url]

Duration: 1:20:33
Building AI agents that actually get things done is harder than it looks. Demetrios, Paul, and Dmitri break down what makes agents effective—from smart planning and memory to treating tools, systems, and even people as c…
Enterprise AI Adoption Challenges [not-audio_url] [/not-audio_url]

Duration: 1:05:00
Building AI Agents that work is no small feat.In Agents in Production [Podcast Limited Series] - Episode Six, Paul van der Boor and Sean Kenny share how they scaled AI across 100+ companies with Toqan—a tool born from a…
Real-time Feature Generation at Lyft // Rakesh Kumar // #334 [not-audio_url] [/not-audio_url]

Duration: 58:04
Real-time Feature Generation at Lyft // MLOps Podcast #334 with Rakesh Kumar, Senior Staff Software Engineer at Lyft.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/Y…
AI Agent Development Tradeoffs You NEED to Know [not-audio_url] [/not-audio_url]

Duration: 57:06
Sherwood Callaway, tech lead at 11X, joins us to talk about building digital workers—specifically Alice (an AI sales rep) and Julian (a voice agent)—that are shaking up sales outreach by automating complex, messy tasks.H…
From the Legal Trenches to Tech // Nick Coleman // #332 [not-audio_url] [/not-audio_url]

Duration: 35:51
From the Legal Trenches to Tech // MLOps Podcast #332 with Nick Coleman, Attorney/Founder of LexMed.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// Abs…
A New Way of Building with AI [not-audio_url] [/not-audio_url]

Duration: 1:04:49
Thanks to MLflow for supporting this episode — the platform helping teams track, manage, and deploy ML and GenAI projects with ease. Try it free at mlflow.org.What if AI could build and maintain your software—like a co-w…
Inside Uber’s AI Revolution - Everything about how they use AI/ML [not-audio_url] [/not-audio_url]

Duration: 45:23
Kai Wang joins the MLOps Community podcast LIVE to share how Uber built and scaled its ML platform, Michelangelo. From mission-critical models to tools for both beginners and experts, he walks us through Uber’s AI playbo…
The Missing Data Stack for Physical AI [not-audio_url] [/not-audio_url]

Duration: 52:42
The Missing Data Stack for Physical AI // MLOps Podcast #328 with Nikolaus West, CEO of Rerun.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractN…