Agents are Just While Loops

Agents are Just While Loops

Author: Demetrios May 15, 2026 Duration: 41:11

Hamza Tahir, co-founder of ZenML, joins the show to cut through the hype around long-running agents — arguing that at the end of the day, an agent is just a while loop that talks to a model, calls a tool, and writes to a file system. He covers the architecture of agent harnesses (inner and outer), what durable execution actually guarantees (and what it doesn't), and why the ML pipeline paradigm is a cleaner mental model than transactions for most agent workloads.


Hamza also announces Kitaru — ZenML's new open-source execution runtime for async Python agents — built on five years of running ML workloads in enterprise environments.


What we get into:

Agents are while loops: The surprising simplicity under all the tooling: a brain (LLM), hands (tool calls), and a file system, stacked recursively

Inner harness vs outer harness: Why Pydantic AI owns the inner loop while production deployment needs a separate runtime layer

What "long-running" actually means: Why the infrastructure we need to build is about extrapolating the future, not defining a time window today

Durable execution demystified: What checkpointing actually guarantees (infra failures, pod death, network drops) vs. what it never will (external state, bad LLM outputs, Snowflake rollbacks)

ML pipelines vs transactions: Why bursty containers in Kubernetes map more naturally to agent workloads than microsecond-latency queue workers — and why Hamza argues against the complexity tax

Anthropic opening the harness: Why letting other models run Claude Cowork is a "boss move," and what it means for the one-harness vs one-model debate

Human-in-the-loop, done right: The pod-kill-and-resume pattern, and why warm pools matter less when your agent runs for days

Kitaru: ZenML's new open source durable execution runtime: zero-config local, Kubernetes/SageMaker/Vertex in production, built on Pydantic AI integration

Arguing with Claude about Temporal: Hamza's story of spending hours getting an LLM to admit ZenML and Temporal solves the same problem


If you're architecting agents for production, picking between Pydantic AI, LangGraph, and Temporal, or just want to understand what "durable execution" actually means — this is the episode.


// LINKS & RESOURCES

Kitaru on GitHub: https://github.com/zenml-io/kitaru

Kitaru launch blog post: https://www.zenml.io/blog/kitaru-launch

Kitaru on Hacker News: https://news.ycombinator.com/item?id=47520115

Hamza Tahir on LinkedIn: https://www.linkedin.com/in/hamzatahirofficial/

ZenML: https://www.zenml.io/


Timestamps

[00:00] While Loop Checkpointing

[00:24] Long-Running Agents Explained

[01:28] Agent Harness Model Definitions

[06:30] Durability and State Recovery

[11:03] Agent Systems Layers

[18:45] Durability in Agent Systems

[22:07] ML Pipeline vs Transactions

[29:23] Durability vs Guarantees

[33:13] Durability vs Chaos Engineering

[39:50] Kitaru Naming and Purpose

[40:38] Wrap up


#AIAgents #DurableExecution #OpenSource


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 50

Agentic Conversations (formally mlops.community)
Podcast Episodes
Skills over MCP on the streets of Tokyo [not-audio_url] [/not-audio_url]

Duration: 32:30
Tool descriptions tell an agent what a tool does. They don't tell it how to use five tools together, in the right order, following your conventions. That gap is where this conversation lives.Filmed at AGNTCon + MCPCon in…
Walking Tokyo Talking Agent Protocols [not-audio_url] [/not-audio_url]

Duration: 28:49
Two people, a wrong turn into a back alley, a community garden, and about thirty minutes of arguing about protocols on the streets of Tokyo.The guest is Angie Jones, VP of Developer Experience at the Agentic AI Foundatio…
Why Cost Per Million Tokens Is A Useless KPI? [not-audio_url] [/not-audio_url]

Duration: 38:49
A year ago, Palo Alto Networks built dashboards to track AI spend. Today those dashboards are useless, and the team that built them thinks that's the whole story.Recorded at FinOps X in San Diego, this conversation bring…
The Five-Layer Cake Approach to Scaling AI Without Wasting Money [not-audio_url] [/not-audio_url]

Duration: 38:55
In this episode of Agentic Conversations, we sit down with Ambud Sharma, Principal Engineer at Pinterest, responsible for general technology efficiency, fresh off delivering a controversial keynote on AI infrastructure o…
The Winchester Mystery House Problem in AI Development [not-audio_url] [/not-audio_url]

Duration: 59:41
AI models are starting to act like appliances, locked into one narrow way of working, instead of the flexible infrastructure they used to be. Drew Breunig, an AI and data strategist working with the Overture Maps Foundat…
How Predictive Analytics Stops Budget Overruns Before They Happen? [not-audio_url] [/not-audio_url]

Duration: 29:23
Every engineer at Wayfair can now see, in real time, exactly what their code costs, and that's on purpose. Brent Eubanks, FinOps Architect at Wayfair, walks us through what happens when you stop treating AI spend as a fi…
How To Delegate To An Agent Like You Would An Employee? [not-audio_url] [/not-audio_url]

Duration: 55:15
OpenAI's Codex developer experience lead sits down with a former comedian turned ML engineering lead for a conversation about what happens when computer use agents stop being a novelty and start actually running your day…
Why Your AI Bill Will Double Before It Gets Better [not-audio_url] [/not-audio_url]

Duration: 32:24
In this episode, we're joined by Josh Collier, FinOps Lead at Superhuman (formerly Grammarly), to explore what it really costs to run AI at scale and why the rules of the game changed faster than anyone expected.We discu…
MCP Goes Stateless [not-audio_url] [/not-audio_url]

Duration: 52:27
David Soria Parra is an Engineering Lead at Anthropic and one of the core maintainers of the Model Context Protocol (MCP). We explore the biggest evolution of the protocol since its launch, and why MCP is becoming the fo…
AI Hype vs. Real Value [not-audio_url] [/not-audio_url]

Duration: 42:37
Manish Dasaur is a Managing Director at PwC with over 20 years in data and AI, having helped 100+ clients navigate AI disruption and extract real business value from data, AI, and agentic AI initiatives. In this episode,…