Lessons from Building AI Agents with Rafal Wilinski

Lessons from Building AI Agents with Rafal Wilinski

Author: Software Huddle August 12, 2025 Duration: 1:08:51
Today we're talking with one of our favorite engineers, Rafal Wilinski. Rafal has been on the cutting edge of AI development in the last few years as he has led AI teams at Zapier and Vendr. Rafal walks us through the hard-won lessons about actually integrating AI tools into the applications you're building. One of the hardest things in integrating these AI tools is how to ensure you're getting better and not regressing as you improve your prompts and upgrade your models. He shows how using evals is one part of the story along with deeply investigating customer signals to see how they are or aren't succeeding with AI. Along the way, we also talk about RAG, his favorite models, his AI development toolset, and why Poland has been killing it lately. Check it out and be sure to follow Rafal if you want to learn more on building with AI.

Every week on Software Huddle, Alex DeBrie and Sean Falconer sit down with a different expert from across the tech landscape. The conversations are less about quick tips and more about substantive discussions, digging into the real challenges and decisions behind building software, launching products, and navigating the industry's constant shifts. You'll hear from practitioners who have been in the trenches, offering perspectives that blend deep technical knowledge with hard-won business and entrepreneurial experience. Alex brings his specialized expertise as the author of The DynamoDB Book and an AWS Data Hero, while Sean contributes a unique viewpoint shaped by over two decades as an engineer, founder, and marketing executive, recognized as a Snowflake Data Superhero. Together, they create a space where complex topics in software development and technology trends become accessible and genuinely engaging. This podcast is for anyone who wants to move beyond surface-level news and understand the "why" behind the tools and strategies shaping our digital world. Tune in for a thoughtful huddle that feels more like a candid conversation between colleagues than a formal interview.
Author: Language: en-us Episodes: 79

Software Huddle
Podcast Episodes
Developer Education and Training with Craig Dennis from Twilio [not-audio_url] [/not-audio_url]

Duration: 52:13
In this episode, We spoke with Craig Dennis from Twilio about developer education and training. Craig's been working in the developer education space for a long time and has a ton of experience. And, of course, Twilio is…
Generative AI and LLMs with Dash Desai from Snowflake [not-audio_url] [/not-audio_url]

Duration: 34:31
If you've been involved with the Snowflake world, today's guest probably can skip an introduction as he is the demo king from the Snowflake Summit and well-known within the Snowflake builder community. We're talking abou…
V0 by Vercel, Bun, RCS on Apple Devices, Retool Breach, & more [not-audio_url] [/not-audio_url]

Duration: 49:55
Our special episode is here, and it's all about the latest news. Join Sean and Alex for an in-depth discussion. Follow Alex: https://twitter.com/alexbdebrie Follow Sean: https://twitter.com/seanfalconer Software Huddle ⤵…
Building Generative AI Apps with Hassan El Mghari from Vercel [not-audio_url] [/not-audio_url]

Duration: 45:41
Over the past couple of months, Generative AI has taken the world by storm. OpenAI’s launch of ChatGPT was a turning point. With each iteration, the Transformer has improved its capabilities while the underlying compute…
Scaling MySQL with Sam Lambert from PlanetScale [not-audio_url] [/not-audio_url]

Duration: 1:21:18
What would it look like if databases were built for developers rather than operators? Sam Lambert is the CEO of PlanetScale, a company that provides a managed MySQL database solution. PlanetScale uses Vitess, a database…