The Winchester Mystery House Problem in AI Development

The Winchester Mystery House Problem in AI Development

Author: Demetrios August 24, 2026 Duration: 59:41

AI models are starting to act like appliances, locked into one narrow way of working, instead of the flexible infrastructure they used to be. Drew Breunig, an AI and data strategist working with the Overture Maps Foundation, joins us to explain why, and what it means for anyone building something that doesn't look like Claude Code.


Drew walks through his "Winchester Mystery House" idea: what happens once code gets so cheap to write that the only real bottleneck left is feedback. From there we dig into DSPy: signatures, the GEPA optimizer, and the brand-new Flex optimizer, which rewrites your code instead of just your prompt, complete with a real before-and-after on cost and accuracy. We also get into why so many AI-built apps and websites end up looking identical, the actual difference between an agent and a workflow, what Drew learned a year after shipping a code library with no code in it, and why he thinks the most valuable thing you can do right now is close the laptop and go talk to people.


CMPND: https://www.cmpnd.ai


Drew Breunig: https://www.linkedin.com/in/drewbreunig/

Demetrios: https://www.linkedin.com/in/dpbrinkm


Timestamps:

[0:00] Cold open: when Claude Code tries to call itself

[1:19] Biggest AI news: labs trading diversity for reliability

[2:35] How harnesses get trained into models over time

[5:41] The problem: your harness starts fighting the model

[9:13] When do you need your own harness?

[10:02] The Winchester Mystery House warning

[16:13] The blank page problem: why everything looks the same

[20:50] Infrastructure vs appliances: the thesis lands

[22:40] Current tool loadout: GLM, Kimi, Claude Code, Pi

[27:04] The Raspberry Pi personal agent running on Slack

[31:00] Crystallizing tasks: when to replace AI with pure code

[33:10] DSPy explained: separating what from how

[35:23] How prompt optimizers actually work

[39:31] DSPy pre-dates ChatGPT: model-agnostic programs

[44:00] Why you still need to ship the code, not just the spec

[50:00] Don't plan more than a month ahead anymore

[54:00] Coaching agents all day feels productive — it isn't

[57:58] The dopamine of building with agents vs. why you still need human feedback


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 50

Agentic Conversations (formally mlops.community)
Podcast Episodes
Skills over MCP on the streets of Tokyo [not-audio_url] [/not-audio_url]

Duration: 32:30
Tool descriptions tell an agent what a tool does. They don't tell it how to use five tools together, in the right order, following your conventions. That gap is where this conversation lives.Filmed at AGNTCon + MCPCon in…
Walking Tokyo Talking Agent Protocols [not-audio_url] [/not-audio_url]

Duration: 28:49
Two people, a wrong turn into a back alley, a community garden, and about thirty minutes of arguing about protocols on the streets of Tokyo.The guest is Angie Jones, VP of Developer Experience at the Agentic AI Foundatio…
Why Cost Per Million Tokens Is A Useless KPI? [not-audio_url] [/not-audio_url]

Duration: 38:49
A year ago, Palo Alto Networks built dashboards to track AI spend. Today those dashboards are useless, and the team that built them thinks that's the whole story.Recorded at FinOps X in San Diego, this conversation bring…
The Five-Layer Cake Approach to Scaling AI Without Wasting Money [not-audio_url] [/not-audio_url]

Duration: 38:55
In this episode of Agentic Conversations, we sit down with Ambud Sharma, Principal Engineer at Pinterest, responsible for general technology efficiency, fresh off delivering a controversial keynote on AI infrastructure o…
How Predictive Analytics Stops Budget Overruns Before They Happen? [not-audio_url] [/not-audio_url]

Duration: 29:23
Every engineer at Wayfair can now see, in real time, exactly what their code costs, and that's on purpose. Brent Eubanks, FinOps Architect at Wayfair, walks us through what happens when you stop treating AI spend as a fi…
How To Delegate To An Agent Like You Would An Employee? [not-audio_url] [/not-audio_url]

Duration: 55:15
OpenAI's Codex developer experience lead sits down with a former comedian turned ML engineering lead for a conversation about what happens when computer use agents stop being a novelty and start actually running your day…
Why Your AI Bill Will Double Before It Gets Better [not-audio_url] [/not-audio_url]

Duration: 32:24
In this episode, we're joined by Josh Collier, FinOps Lead at Superhuman (formerly Grammarly), to explore what it really costs to run AI at scale and why the rules of the game changed faster than anyone expected.We discu…
MCP Goes Stateless [not-audio_url] [/not-audio_url]

Duration: 52:27
David Soria Parra is an Engineering Lead at Anthropic and one of the core maintainers of the Model Context Protocol (MCP). We explore the biggest evolution of the protocol since its launch, and why MCP is becoming the fo…
AI Hype vs. Real Value [not-audio_url] [/not-audio_url]

Duration: 42:37
Manish Dasaur is a Managing Director at PwC with over 20 years in data and AI, having helped 100+ clients navigate AI disruption and extract real business value from data, AI, and agentic AI initiatives. In this episode,…
The Creator of FastMCP Explains the Future of MCP [not-audio_url] [/not-audio_url]

Duration: 55:11
In this episode, we're joined by Jeremiah Lowin, Founder & CEO at Prefect and the creator of FastMCP, to explore how one of the most influential projects in the MCP ecosystem came to be - and where the protocol is headin…