Agents are Just While Loops

Agents are Just While Loops

Author: Demetrios May 15, 2026 Duration: 41:11

Hamza Tahir, co-founder of ZenML, joins the show to cut through the hype around long-running agents — arguing that at the end of the day, an agent is just a while loop that talks to a model, calls a tool, and writes to a file system. He covers the architecture of agent harnesses (inner and outer), what durable execution actually guarantees (and what it doesn't), and why the ML pipeline paradigm is a cleaner mental model than transactions for most agent workloads.


Hamza also announces Kitaru — ZenML's new open-source execution runtime for async Python agents — built on five years of running ML workloads in enterprise environments.


What we get into:

Agents are while loops: The surprising simplicity under all the tooling: a brain (LLM), hands (tool calls), and a file system, stacked recursively

Inner harness vs outer harness: Why Pydantic AI owns the inner loop while production deployment needs a separate runtime layer

What "long-running" actually means: Why the infrastructure we need to build is about extrapolating the future, not defining a time window today

Durable execution demystified: What checkpointing actually guarantees (infra failures, pod death, network drops) vs. what it never will (external state, bad LLM outputs, Snowflake rollbacks)

ML pipelines vs transactions: Why bursty containers in Kubernetes map more naturally to agent workloads than microsecond-latency queue workers — and why Hamza argues against the complexity tax

Anthropic opening the harness: Why letting other models run Claude Cowork is a "boss move," and what it means for the one-harness vs one-model debate

Human-in-the-loop, done right: The pod-kill-and-resume pattern, and why warm pools matter less when your agent runs for days

Kitaru: ZenML's new open source durable execution runtime: zero-config local, Kubernetes/SageMaker/Vertex in production, built on Pydantic AI integration

Arguing with Claude about Temporal: Hamza's story of spending hours getting an LLM to admit ZenML and Temporal solves the same problem


If you're architecting agents for production, picking between Pydantic AI, LangGraph, and Temporal, or just want to understand what "durable execution" actually means — this is the episode.


// LINKS & RESOURCES

Kitaru on GitHub: https://github.com/zenml-io/kitaru

Kitaru launch blog post: https://www.zenml.io/blog/kitaru-launch

Kitaru on Hacker News: https://news.ycombinator.com/item?id=47520115

Hamza Tahir on LinkedIn: https://www.linkedin.com/in/hamzatahirofficial/

ZenML: https://www.zenml.io/


Timestamps

[00:00] While Loop Checkpointing

[00:24] Long-Running Agents Explained

[01:28] Agent Harness Model Definitions

[06:30] Durability and State Recovery

[11:03] Agent Systems Layers

[18:45] Durability in Agent Systems

[22:07] ML Pipeline vs Transactions

[29:23] Durability vs Guarantees

[33:13] Durability vs Chaos Engineering

[39:50] Kitaru Naming and Purpose

[40:38] Wrap up


#AIAgents #DurableExecution #OpenSource


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 50

Agentic Conversations (formally mlops.community)
Podcast Episodes
The Dark Side of MCP Servers [not-audio_url] [/not-audio_url]

Duration: 1:09:59
Sam Partee (CTO & co-founder of Arcade.dev) and Nate Barbettini (Founding Engineer at Arcade.dev) sit down at the MCP Dev Summit to unpack what nobody wants to admit about the Model Context Protocol: the security model i…
Sandboxing, Agent Harnesses, and Agent Teamwork [not-audio_url] [/not-audio_url]

Duration: 1:19:53
Shahram Anver is the Co-Founder and CEO of Cleric, the autonomous AI SRE that investigates and root-causes production issues like an experienced teammate — often in under two minutes. Before Cleric, Shahram led MLOps, De…
MCP Servers Are Becoming the UI for AI Agents [not-audio_url] [/not-audio_url]

Duration: 47:21
Naseem Al-Naji is the co-founder of MCPcat.io and the creator of Opal — a builder with deep roots in privacy-first developer tooling. In this conversation, he breaks down why MCP servers have become a black box in produc…
Agents & the $40M Bet on Multiplayer AI [not-audio_url] [/not-audio_url]

Duration: 1:20:46
Stanislas Polu is Co-Founder & CTO of Dust — the enterprise AI agent platform used by 51,000 workers at 3,000+ companies. Before Dust, he spent three years on OpenAI's research team under Ilya Sutskever, working on mathe…
From Single-Player to Multi-Player: Operating AI Agents at Scale [not-audio_url] [/not-audio_url]

Duration: 55:54
James Everingham is the CEO and Co-founder of Guild.ai — the AI agent control plane for production teams. With roots at Netscape, Instagram (Head of Engineering), and Meta (Head of Dev Infra, leading a 1,000-person org),…
The Control-vs-Magic Spectrum Building Agents [not-audio_url] [/not-audio_url]

Duration: 43:18
Thiago Cardoso is the Director of Data & AI at iFood and the architect behind iFood Pago's AI agent platform. This fintech system serves millions of restaurants across Brazil through WhatsApp and the iFood app. In this e…
Logs Are All You Need: Rethinking Observability with AI Agents [not-audio_url] [/not-audio_url]

Duration: 46:39
Sherwood Callaway is the founder of Sazabi (YC P26), the AI-native observability platform built for engineering teams who ship fast. He previously founded and exited a YC company — now he's back, betting that logs are al…
AI Is Fast. AI Projects Are Slow. Let's Fix That. [not-audio_url] [/not-audio_url]

Duration: 56:47
Joe Maionchi (Co-founder & COO) and Rod Christensen (Co-founder & Chief Architect) of RocketRide join the MLOps Community to walk through AIDE — the AI Integrated Development Environment. RocketRide is an open-source AI…
Architecting Modern AI Systems: Platforms, Agents, and Integration [not-audio_url] [/not-audio_url]

Duration: 56:59
BuzzHPC Roundtable episode: Architecting Modern AI Systems: Platforms, Agents, and Integration Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletterMLOps GPU G…