The Modern Software Engineer

The Modern Software Engineer

Author: Demetrios April 14, 2026 Duration: 53:37

This episode is brought to you by the MLflow team. Check out more information at MLflow.org.

Mihail Eric is Head of AI at Monaco and Adjunct Lecturer at Stanford University, where he teaches CS146S: "The Modern Software Developer" — the first course in the world dedicated to how AI is transforming every stage of the software development lifecycle. With 12+ years building production AI systems at Amazon Alexa, Storia AI (YC S24), and early-stage startups, Mihail has one of the most grounded, practitioner-level takes on what it actually means to be a software engineer in 2026.

The Modern Software Engineer // MLOps Podcast #370 with Mihail Eric, Head of AI at Monaco

🧠 What the modern software engineer actually looks like — why the job description has fundamentally shifted from writing code to designing systems and directing agents

⚙️ Agents require more thinking, not less — why the engineers getting the most out of coding agents are the ones who invest the most upfront in architecture, planning, and codebase structure

🎓 Inside Stanford's "Modern Software Developer" course — what Mihail teaches in the first CS course in the world focused entirely on AI-transformed software development

🏗️ From writing code to designing systems — how the best developers are repositioning themselves as architects of agentic workflows rather than line-by-line coders

🔁 The Build System: how to run agents at scale — practical lessons from building multi-agent pipelines, parallel subagent batches, and automated retrospectives📉 What junior engineers should actually focus on — the skills that remain irreplaceable and the paths that still produce strong software engineers in an AI-first world

🚀 Building Monaco's AI-native revenue engine — what it's like building AI infrastructure for a fast-moving $35M-funded startup disrupting enterprise CRM

🎯 How to ace AI engineering interviews — Mihail's framework for demonstrating real AI engineering competence beyond prompt engineering basics. Essential watching for software engineers, ML practitioners, and engineering managers who want an honest, practitioner-level view of where the profession is going — from someone who's both teaching it at Stanford and building it in production.


🔗 Links & Resources

Mihail Eric on LinkedIn: https://www.linkedin.com/in/mihaileric/

Mihail's website: https://www.mihaileric.com

Stanford course "The Modern Software Developer": https://themodernsoftware.dev/

Maven course — AI Software Development: From First Prompt to Production Code: https://maven.com/the-modern-software-developer/ai-course

Free AI Engineer interview prep course: https://course.aiengineermastery.com/

Monaco (AI-native revenue engine): https://monaco.com

MLOps.community Slack: https://go.mlops.community/slack


⏱️ Timestamps

00:00 Intro — Mihail Eric & Monaco

04:00 What has actually changed for software engineers in 2026

09:00 Inside Stanford's "Modern Software Developer" course

15:00 Why agents require more human thinking, not less

21:00 From writing code to designing systems — the architect mindset

27:00 The Build System: running agents at scale in production

33:00 What junior engineers should focus on right now

39:00 Building AI infrastructure at Monaco

44:00 How to demonstrate real AI engineering competence

49:00 Skills that will remain irreplaceable

52:00 Rapid fire/closing thoughts


Hosted by Demetrios, MLOps.community is a space for honest, meandering talks about the real work of making artificial intelligence systems actually work. This isn't about hype or theoretical papers; it's about the messy, practical, and often surprising journey of taking models from a notebook into a live environment. You'll hear from engineers and practitioners who are in the trenches, discussing the tools, the frustrations, and the occasional breakthroughs that define the day-to-day. The conversations are deliberately relaxed, covering everything from traditional machine learning pipelines to the new world of large language models and even the intangible "vibes" of team culture and process. Each episode peels back a layer on what "production" really means, whether that involves deploying a predictive service, managing an agentic system, or maintaining reliability as everything scales. Tuning into this podcast feels like grabbing a coffee with colleagues who aren't afraid to dig into the technical nitty-gritty while keeping the tone conversational and accessible. It's for anyone who builds, manages, or is just curious about the operational backbone that allows AI to deliver value, offering a grounded perspective often missing from the broader conversation.
Author: Language: en-us Episodes: 50

Agentic Conversations (formally mlops.community)
Podcast Episodes
We Cut LLM Latency by 70% in Production [not-audio_url] [/not-audio_url]

Duration: 1:05:20
Maher Hanafi is an engineering leader who went from zero AI experience to self-hosting LLMs at enterprise scale — managing GPU costs, optimizing inference with TensorRT LLM, and building an AI platform for HR tech. In th…
Getting Humans Out of the Way: How to Work with Teams of Agents [not-audio_url] [/not-audio_url]

Duration: 50:30
Rob Ennals is the creator of Broomy, an open-source IDE designed for working effectively with many agents in parallel. He previously worked at Meta, Quora, Google Search, and Intel Research. He has a PhD in Computer Scie…
Fixing GPU Starvation in Large-Scale Distributed Training [not-audio_url] [/not-audio_url]

Duration: 52:48
Kashish Mittal is a Staff Software Engineer at Uber, working on large-scale distributed systems and core backend infrastructure.Fixing GPU Starvation in Large-Scale Distributed Training // MLOps Podcast #367 with Kashish…
arrowspace: Vector Spaces and Graph Wiring [not-audio_url] [/not-audio_url]

Duration: 56:01
Lorenzo Moriondo is a Technical Lead for AI at tuned.org.uk, working on AI agent protocols, graph-based search, and production-grade LLM systems.arrowspace: Vector Spaces and Graph Wiring // MLOps Podcast #365 with Loren…
Agentic Marketplace [not-audio_url] [/not-audio_url]

Duration: 51:26
Donné Stevenson is a Machine Learning Engineer at Prosus, working on scalable ML infrastructure and productionizing GenAI systems across portfolio companies.Pedro Chaves is a Data Science Manager at OLX Group, working on…
Durable Execution and Modern Distributed Systems [not-audio_url] [/not-audio_url]

Duration: 1:00:36
Johann Schleier-Smith is the Technical Lead for AI at Temporal Technologies, working on reliable infrastructure for production AI systems and long-running agent workflows. Durable Execution and Modern Distributed Systems…