Agents are Just While Loops

Agents are Just While Loops

Author: Demetrios May 15, 2026 Duration: 41:11

Hamza Tahir, co-founder of ZenML, joins the show to cut through the hype around long-running agents — arguing that at the end of the day, an agent is just a while loop that talks to a model, calls a tool, and writes to a file system. He covers the architecture of agent harnesses (inner and outer), what durable execution actually guarantees (and what it doesn't), and why the ML pipeline paradigm is a cleaner mental model than transactions for most agent workloads.


Hamza also announces Kitaru — ZenML's new open-source execution runtime for async Python agents — built on five years of running ML workloads in enterprise environments.


What we get into:

Agents are while loops: The surprising simplicity under all the tooling: a brain (LLM), hands (tool calls), and a file system, stacked recursively

Inner harness vs outer harness: Why Pydantic AI owns the inner loop while production deployment needs a separate runtime layer

What "long-running" actually means: Why the infrastructure we need to build is about extrapolating the future, not defining a time window today

Durable execution demystified: What checkpointing actually guarantees (infra failures, pod death, network drops) vs. what it never will (external state, bad LLM outputs, Snowflake rollbacks)

ML pipelines vs transactions: Why bursty containers in Kubernetes map more naturally to agent workloads than microsecond-latency queue workers — and why Hamza argues against the complexity tax

Anthropic opening the harness: Why letting other models run Claude Cowork is a "boss move," and what it means for the one-harness vs one-model debate

Human-in-the-loop, done right: The pod-kill-and-resume pattern, and why warm pools matter less when your agent runs for days

Kitaru: ZenML's new open source durable execution runtime: zero-config local, Kubernetes/SageMaker/Vertex in production, built on Pydantic AI integration

Arguing with Claude about Temporal: Hamza's story of spending hours getting an LLM to admit ZenML and Temporal solves the same problem


If you're architecting agents for production, picking between Pydantic AI, LangGraph, and Temporal, or just want to understand what "durable execution" actually means — this is the episode.


// LINKS & RESOURCES

Kitaru on GitHub: https://github.com/zenml-io/kitaru

Kitaru launch blog post: https://www.zenml.io/blog/kitaru-launch

Kitaru on Hacker News: https://news.ycombinator.com/item?id=47520115

Hamza Tahir on LinkedIn: https://www.linkedin.com/in/hamzatahirofficial/

ZenML: https://www.zenml.io/


Timestamps

[00:00] While Loop Checkpointing

[00:24] Long-Running Agents Explained

[01:28] Agent Harness Model Definitions

[06:30] Durability and State Recovery

[11:03] Agent Systems Layers

[18:45] Durability in Agent Systems

[22:07] ML Pipeline vs Transactions

[29:23] Durability vs Guarantees

[33:13] Durability vs Chaos Engineering

[39:50] Kitaru Naming and Purpose

[40:38] Wrap up


#AIAgents #DurableExecution #OpenSource


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 50

Agentic Conversations (formally mlops.community)
Podcast Episodes
The Creator of FastMCP Explains the Future of MCP [not-audio_url] [/not-audio_url]

Duration: 55:11
In this episode, we're joined by Jeremiah Lowin, Founder & CEO at Prefect and the creator of FastMCP, to explore how one of the most influential projects in the MCP ecosystem came to be - and where the protocol is headin…
What Happens When Every Developer Has 20 AI Agents? [not-audio_url] [/not-audio_url]

Duration: 34:37
In this episode, we're joined by Stephen O'Grady, Co-Founder and Principal Analyst at RedMonk, to explore one of the biggest shifts happening in software engineering: AI is making code dramatically cheaper to produce, bu…
AI Agents Should Be Treated Like Hackers [not-audio_url] [/not-audio_url]

Duration: 31:35
In this episode, we're joined by Matt DeBergalis, CTO and Co-Founder of Apollo GraphQL, to explore what happens when AI agents start interacting with enterprise systems that were never designed for them.We dive into the…
Developers May Stop Depending on Libraries [not-audio_url] [/not-audio_url]

Duration: 46:52
In this episode of Agentic Conversations, we're joined by Shaun Smith, software engineer, open source advocate, and contributor at Hugging Face, to explore how AI coding has changed almost overnight.We dive into reinforc…
10 Cities. 4 Countries. One Unexpected MCP Lesson. [not-audio_url] [/not-audio_url]

Duration: 22:18
In this episode, we're joined by Ben Morss, Developer Advocate at DeepL, who spent months traveling across North America and Europe teaching developers about MCP, building MCP servers, and helping teams understand how AI…
The Next Programming Language Is English [not-audio_url] [/not-audio_url]

Duration: 38:13
In this episode, we're joined by Cornelia Davis, Developer Advocate at Temporal and a longtime software architect who has spent decades helping shape modern cloud-native systems.We explore how programming has evolved fro…
Omnigent: Composition, Control, and Collaboration for AI Agents [not-audio_url] [/not-audio_url]

Duration: 58:16
Denny Lee is PM Director, Startups & Ecosystem at Databricks, a longtime Apache Spark, MLflow, and Delta Lake contributor — and one of the people behind Omnigent, the open-source meta-harness Databricks just released und…
The Current State of Agentic Retrieval - Qdrant Roundtable [not-audio_url] [/not-audio_url]

Duration: 58:54
Qdrant Roundtable episode: The Current State of Agentic RetrievalJoin the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletterMLOps GPU Guide: https://go.mlops.communi…
AI Agents in Healthcare? [not-audio_url] [/not-audio_url]

Duration: 39:28
Kingsley Madikaegbu is the founder of HealID, a startup building agentic AI on top of the Model Context Protocol (MCP) for one of the most heavily regulated environments there is: healthcare.Recorded at MCP Dev Summit No…
Coding Agents Are Secretly General Agents [not-audio_url] [/not-audio_url]

Duration: 1:12:02
In this episode:🧠 Coding agents are generalist agents — why "positive transfer" means an agent that's better at code is better at everything, and how that makes them "AGI-complete"⏳ "Code will be solved in a year" — what…