Logs Are All You Need: Rethinking Observability with AI Agents

Logs Are All You Need: Rethinking Observability with AI Agents

Author: Demetrios June 2, 2026 Duration: 46:39

Sherwood Callaway is the founder of Sazabi (YC P26), the AI-native observability platform built for engineering teams who ship fast. He previously founded and exited a YC company — now he's back, betting that logs are all you need to replace Datadog.


Logs Are All You Need: Rethinking Observability with AI Agents // MLOps Podcast #381 with Sherwood Callaway, the Founder of Sazabi


🔑 What's covered:

🪵 Logs vs. The Three Pillars — Sherwood makes the case that the traditional observability stack (metrics, logs, traces) is overkill. In 2026, with AI agents in the loop, logs alone are sufficient — and dramatically simpler to instrument.

🚨 AI-Generated Alerts, Not AI-Evaluated Alerts — Instead of using AI to triage your noisy alert stream, Sazabi generates the alerts autonomously from your logs and codebase — so you never configure a monitor again.

🤖 Agent Sandboxing & Bash Access — How Sazabi gives its AI agent a persistent bash sandbox with CLI tool access, why every other action routes through that sandbox, and how RLS database permissions keep the agent from doing damage.

🧠 Agentic Memory via Git — Sazabi's novel approach to persisting agent memory across threads using Git branches — enabling multiple parallel sub-agents to share findings without bloating the context window.

🔀 Multi-Agent Parallelization — How Sazabi spawns sub-agents and background agents on-demand to investigate production issues in parallel, the way Claude Code displays a live to-do list of agent work.

📊 Why Evals Are Hard (and What They Built Instead) — An honest conversation about the difficulty of evaluating agentic systems, log-based eval proxies, and why Sazabi still doesn't buy third-party eval tooling.

⚡ MCP Servers, Skills Bloat & Context Management — The tradeoffs between MCP servers and local skill files, progressive tool disclosure, and why context window management is the hidden bottleneck in production agent systems.

🎯 Building a Moat in 2026 — Sherwood and Demetrios debate what a defensible advantage actually looks like when every AI tool can be cloned fast. Spoiler: "We built it first" is not a moat.

🚀 Beta Launch & Who It's For — Sazabi is in closed beta and opening the waitlist. If your team uses Cursor or Claude Code and you have production traffic you can't afford to break, this is built for you.

👉 Perfect for: AI engineers, SREs, DevOps teams, and founders building production-grade agent systems who are questioning whether their current observability stack is overbuilt.


🔗 Links & Resources

🌐 Sazabi: https://sazabi.com

📄 Sazabi on Y Combinator: https://www.ycombinator.com/companies/sazabi

💼 Sherwood Callaway on LinkedIn: https://www.linkedin.com/in/sherwood-callaway

📰 SiliconANGLE coverage: https://siliconangle.com/2026/04/08/startup-sazabi-bets-on-logs-and-ai-agents-to-replace-traditional-observability-stacks/

💻 MLOps.community: https://mlops.community


⏱️ Timestamps

[00:00] Genetic Agent Evolution

[00:33] Dethroning Datadog

[03:13] Sazabi vs Traditional Observability

[10:47] MCP vs CLI Paradigm

[15:12] Sandbox Usage for Agents

[24:28] Genetic Prompt Optimization

[32:34] Eval and Agent Spawning

[38:45] RL Environment Tensions

[45:40] Sazabi is hiring!

[46:10] Wrap up


#Observability #AIAgents #DevTools


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 100

MLOps.community
Podcast Episodes
The Hidden Bottlenecks Slowing Down AI Agents [not-audio_url] [/not-audio_url]

Duration: 47:59
Demetrios chats with Paul van der Boor and Bruce Martens from Prosus about the real bottlenecks in AI agent development—not tools, but evaluation and feedback. They unpack when to build vs. buy, the tradeoffs of external…
9 Commandments for Building AI Agents [not-audio_url] [/not-audio_url]

Duration: 1:20:33
Building AI agents that actually get things done is harder than it looks. Demetrios, Paul, and Dmitri break down what makes agents effective—from smart planning and memory to treating tools, systems, and even people as c…
Enterprise AI Adoption Challenges [not-audio_url] [/not-audio_url]

Duration: 1:05:00
Building AI Agents that work is no small feat.In Agents in Production [Podcast Limited Series] - Episode Six, Paul van der Boor and Sean Kenny share how they scaled AI across 100+ companies with Toqan—a tool born from a…
Real-time Feature Generation at Lyft // Rakesh Kumar // #334 [not-audio_url] [/not-audio_url]

Duration: 58:04
Real-time Feature Generation at Lyft // MLOps Podcast #334 with Rakesh Kumar, Senior Staff Software Engineer at Lyft.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/Y…
AI Agent Development Tradeoffs You NEED to Know [not-audio_url] [/not-audio_url]

Duration: 57:06
Sherwood Callaway, tech lead at 11X, joins us to talk about building digital workers—specifically Alice (an AI sales rep) and Julian (a voice agent)—that are shaking up sales outreach by automating complex, messy tasks.H…
From the Legal Trenches to Tech // Nick Coleman // #332 [not-audio_url] [/not-audio_url]

Duration: 35:51
From the Legal Trenches to Tech // MLOps Podcast #332 with Nick Coleman, Attorney/Founder of LexMed.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// Abs…
A New Way of Building with AI [not-audio_url] [/not-audio_url]

Duration: 1:04:49
Thanks to MLflow for supporting this episode — the platform helping teams track, manage, and deploy ML and GenAI projects with ease. Try it free at mlflow.org.What if AI could build and maintain your software—like a co-w…
Inside Uber’s AI Revolution - Everything about how they use AI/ML [not-audio_url] [/not-audio_url]

Duration: 45:23
Kai Wang joins the MLOps Community podcast LIVE to share how Uber built and scaled its ML platform, Michelangelo. From mission-critical models to tools for both beginners and experts, he walks us through Uber’s AI playbo…
The Missing Data Stack for Physical AI [not-audio_url] [/not-audio_url]

Duration: 52:42
The Missing Data Stack for Physical AI // MLOps Podcast #328 with Nikolaus West, CEO of Rerun.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractN…