Lessons from Building AI Agents with Rafal Wilinski

Lessons from Building AI Agents with Rafal Wilinski

Author: Software Huddle August 12, 2025 Duration: 1:08:51
Today we're talking with one of our favorite engineers, Rafal Wilinski. Rafal has been on the cutting edge of AI development in the last few years as he has led AI teams at Zapier and Vendr. Rafal walks us through the hard-won lessons about actually integrating AI tools into the applications you're building. One of the hardest things in integrating these AI tools is how to ensure you're getting better and not regressing as you improve your prompts and upgrade your models. He shows how using evals is one part of the story along with deeply investigating customer signals to see how they are or aren't succeeding with AI. Along the way, we also talk about RAG, his favorite models, his AI development toolset, and why Poland has been killing it lately. Check it out and be sure to follow Rafal if you want to learn more on building with AI.

Every week on Software Huddle, Alex DeBrie and Sean Falconer sit down with a different expert from across the tech landscape. The conversations are less about quick tips and more about substantive discussions, digging into the real challenges and decisions behind building software, launching products, and navigating the industry's constant shifts. You'll hear from practitioners who have been in the trenches, offering perspectives that blend deep technical knowledge with hard-won business and entrepreneurial experience. Alex brings his specialized expertise as the author of The DynamoDB Book and an AWS Data Hero, while Sean contributes a unique viewpoint shaped by over two decades as an engineer, founder, and marketing executive, recognized as a Snowflake Data Superhero. Together, they create a space where complex topics in software development and technology trends become accessible and genuinely engaging. This podcast is for anyone who wants to move beyond surface-level news and understand the "why" behind the tools and strategies shaping our digital world. Tune in for a thoughtful huddle that feels more like a candid conversation between colleagues than a formal interview.
Author: Language: en-us Episodes: 79

Software Huddle
Podcast Episodes
Java and Building AI Applications with Kevin Dubois [not-audio_url] [/not-audio_url]

Duration: 56:58
Today on the show, we have Kevin Dubois. Kevin is a Senior Principal Developer Advocate at Red Hat, Java Champion, and well known open source contributor. In our conversation with Kevin, we talk about his history with Ja…
SQLite, Turso, and the State of Databases with Glauber Costa [not-audio_url] [/not-audio_url]

Duration: 1:12:07
Today we have Glauber Costa on the show, who's the CEO and founder at Turso. They provide a managed SQLite service with some really interesting capabilities that's changing some of the application patterns you can do. He…
Blocking Bots & Moving from Redis to SQLite with Mike Buckbee [not-audio_url] [/not-audio_url]

Duration: 53:00
Today, we have Mike Buckbee on the show. Mike is the co-founder of Wafris, and he wrote a really insightful article last week about moving from Redis to SQLite for an aspect of their architecture. The article was nuanced…
AI Engineer, Web Frameworks, & more with Tejas Kumar [not-audio_url] [/not-audio_url]

Duration: 1:21:58
Today we have Tejas Kumar on the show. Tejas is part of the Developer Relations team at Datastax. He's really good at frontend, got a great podcast and he has written a book called Fluent React. He spoke recently at the…
The Data Engineering Landscape with Peter Hanssens [not-audio_url] [/not-audio_url]

Duration: 54:52
Today on the show, we have Peter Hanssens, the CEO and founder of Cloud Shuttle and creator of the DataEngBytes Conference. Peter has helped build an incredible data engineering community in Australia. He runs meetups, u…
Infrastructure, AWS, AI and Jobs, HTMX & more [not-audio_url] [/not-audio_url]

Duration: 1:34:19
Today we have a special guest. We have Jeremy Daly, who’s been in the cloud space for a while. Jeremy is the co-founder of Ampt, which is building an abstraction infrastructure layer on top of AWS, just to make it simple…
Introduction to GraphRAG with Stephen Chin [not-audio_url] [/not-audio_url]

Duration: 1:03:10
Today we have Stephen Chin, VP of developer relations at Neo4j on the show. Stephen is an author, speaker, and Java expert, we’ll actually be crossing paths in person at the upcoming Infobip Shift conference in September…
Infrastructure as Code with Dax Raad [not-audio_url] [/not-audio_url]

Duration: 1:17:47
Today, we have Dax Raad on the show. Dax is a must-follow on tech Twitter, known for his blend of humor and insightful tech opinions. We talked a lot about SST, which is the infrastructure as code tool that he works on.…
No More Broken Docs with Manny Silva [not-audio_url] [/not-audio_url]

Duration: 48:10
Today, we have Manny Silva, Head of Docs at Skyflow, on the show to talk about two open source projects he created, Docs as Tests and Doc Detective. Docs as Tests is a framework to make sure that your docs are in sync wi…