Architecting Modern AI Systems: Platforms, Agents, and Integration

Architecting Modern AI Systems: Platforms, Agents, and Integration

Author: Demetrios May 28, 2026 Duration: 56:59

BuzzHPC Roundtable episode: Architecting Modern AI Systems: Platforms, Agents, and Integration


Join the Community: https://go.mlops.community/YTJoinIn

Get the newsletter: https://go.mlops.community/YTNewsletter

MLOps GPU Guide: https://go.mlops.community/gpuguide


Big shout-out to BuzzHPC for the collaboration!


// Abstract

As AI systems evolve into more autonomous, agent-driven architectures, the way we design platforms, tools, and infrastructure is rapidly changing. In this session with BuzzHPC, we explore the shifting boundary between platforms and tools, what developers expect platform providers to handle versus what they want to control and build themselves.


We unpack what modern agentic stacks look like today, how teams are structuring them in production, and where these architectures are heading as systems become more complex and distributed. A key focus will also be on agent interoperability, how different agents communicate, coordinate, and operate within shared environments.


Finally, we share insights and lessons from a recent AI hackathon delivered in partnership with Bell, Buzz, Mila, and KHP, highlighting how these concepts are being tested and applied by builders in real-world scenarios.


// Bio

Allen Roush

Allen has held senior technical and AI leadership roles at companies like Oracle and Intel. He's very active in the AI research space and open source communities. He's passionate about improving the creativity and coherence of AI systems.


Frédéric Bénard

Frédéric is Senior Director of AI Applications Development at Mila (Quebec AI Institute), where he leads a team focused on building the engineering foundations for applied AI systems. His work centers on translating cutting-edge research into scalable applications, including AI-driven platforms and agent-based systems used across research and industry collaborations.


Shuo Wang

Shuo leads the Responsible AI Office for Bell Canada, where all AI use cases are reviewed and assessed for potential harm and bias. Previously, he led a team of data scientists to expand a large-scale ML program to improve customer support effectiveness.


// Related Links

Website: https://www.buzzhpc.ai/


~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~

Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore

Join our Slack community [https://go.mlops.community/slack]

Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)]

Sign up for the next meetup: [https://go.mlops.community/register]

MLOps Swag/Merch: [https://shop.mlops.community/]


Connect with Demetrios on LinkedIn: /dpbrinkm

Connect with Allen on LinkedIn: /allen-roush-27721011b/

Connect with Frédéric on LinkedIn: /benard/

Connect with Shuo on LinkedIn: /shuow/


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 100

MLOps.community
Podcast Episodes
A Playground for AI/ML Engineers [not-audio_url] [/not-audio_url]

Duration: 54:41
Paulo Vasconcellos is the Principal Data Scientist for Generative AI Products at Hotmart, working on AI-powered creator and learning experiences, including intelligent tutoring, content automation, and multilingual local…
Conversation with the MLflow Maintainers [not-audio_url] [/not-audio_url]

Duration: 58:23
Corey Zumar is a Product Manager at Databricks, working on MLflow and LLM evaluation, tracing, and lifecycle tooling for generative AI.Jules Damji is a Lead Developer Advocate at Databricks, working on Spark, lakehouse t…
Leadership on AI [not-audio_url] [/not-audio_url]

Duration: 47:24
Euro Beinat is the Global Head of AI and Data Science at Prosus Group, working on scaling AI-driven tools and agent-based systems across Prosus’s global portfolio, deploying internal assistants like Toqan and generative…
Computers that Think and Take Actions for You [not-audio_url] [/not-audio_url]

Duration: 45:08
Zengyi Qin is the Founder of the OpenAGI Foundation, working on computer-use models and open, agent-centric AI infrastructure.Computers that Think and Take Actions for You, Zengy Qin // MLOps Podcast #355Join the Communi…
Real time features, AI search, Agentic similarities [not-audio_url] [/not-audio_url]

Duration: 29:27
Varant Zanoyan is the Co-founder & CEO at Zipline AI, working on building a next-generation AI/ML infrastructure platform that streamlines data pipelines, model deployment, observability, and governance to accelerate ent…
Tool definitions are the new Prompt Engineering [not-audio_url] [/not-audio_url]

Duration: 58:08
Alex Salazar is the CEO and Co-Founder of Arcade.dev, working on secure AI agents and real-world automation integrations.Chiara Caratelli is a Data Scientist at Prosus Group, working on AI agents, web automation, and eva…
The Future of AI Agents is Sandboxed [not-audio_url] [/not-audio_url]

Duration: 58:03
Jonathan Wall is the CEO at Runloop.ai, working on enterprise-grade infrastructure and execution environments for AI coding agents.The Future of AI Agents is Sandboxed // MLOps Podcast #353 with Jonathan Wall, CEO at Run…
Does AgenticRAG Really Work? [not-audio_url] [/not-audio_url]

Duration: 1:01:39
Satish Bhambri is a Sr Data Scientist at Walmart Labs, working on large-scale recommendation systems and conversational AI, including RAG-powered GroceryBot agents, vector-search personalization, and transformer-based ad…