Complete AI Course on Prompting, Evals, RAG, and Fine-Tuning | Adam Loving (Meta)

Complete AI Course on Prompting, Evals, RAG, and Fine-Tuning | Adam Loving (Meta)

Author: Peter Yang June 1, 2025 Duration: 46:21

Adam Loving (Meta) has helped 100s of companies craft AI products. Our interview is a complete, beginner friendly AI course on how to use prompting, evals, RAG, and fine-tuning to build great AI products.

Timestamps:

(00:00) The 2 types of AI optimizations every PM needs to know

(02:52) 4 tips to craft compelling AI prompts

(07:14) 4 types of AI evaluations to consider

(12:06) The scoring trick for advanced AI evaluations

(21:50) Retrieval augmented generation explained

(27:29) Is fine-tuning basically lobotomizing your AI model?

(30:31) Now I finally understand vector databases

(41:40) Why Meta thinks open source will win

(44:04) Adam's best advice after leading 100s of AI integrationsWhere to find Adam:

LinkedIn: https://www.linkedin.com/in/adamloving/

Website: https://www.llama.com/Get the takeaways: https://creatoreconomy.so/p/complete-ai-course-on-prompting-evals-rag-fine-tuning-adam-loving📌 Subscribe to this channel – more interviews coming soon!


For anyone building the future, Behind the Craft is a conversation with Peter Yang that moves beyond theory and into the tangible details of creation. This podcast lives in the messy, rewarding space where ideas become real products. Each episode is built on candid interviews with experts who have been in the trenches, dissecting the pivotal decisions, the unexpected hurdles, and the hard-won lessons that rarely make it into a polished case study. You’ll hear the unvarnished stories behind the features and companies shaping our world, focusing on the practical frameworks and mental models that effective product leaders and creators rely on daily. It’s about understanding the craft from the inside out-the strategic shifts, the team dynamics, the user insights that truly move the needle. Tune in for a direct, no-fluff dialogue designed to accelerate your own journey, providing actionable guidance you can apply immediately to level up your own work. This is where the blueprint meets the build.
Author: Language: English Episodes: 100

Behind the Craft
Podcast Episodes
Master Google AI Studio in 40 Minutes | Logan Kilpatrick [not-audio_url] [/not-audio_url]

Duration: 39:17
Logan is the Product Lead for Google AI Studio. I got him to give us an inside look at how he uses AI Studio to build AI Studio (very meta) and how his team ships at startup speed inside Google. AI Studio is the feature…
Build an AI Analyst with Claude Code in 50 Min | Sumeet Marwaha [not-audio_url] [/not-audio_url]

Duration: 51:47
Sumeet is the Head of Data at Brex and came personally recommended by the Claude Code team. In our episode, he showed me how to use Claude Code to build a data explorer that lets anyone ask questions and get insights wit…
A Founder's Playbook for Shipping 10x Faster with AI | Yana Welinder [not-audio_url] [/not-audio_url]

Duration: 41:53
Yana is Head of AI at Amplitude and a good friend. We had some real talk about how to stay scrappy inside a big company, including how to avoid decision by committee and endless internal debates. Yana also demoed her fav…
A Proven 5-Step System to Prototype Apps with AI | Xinran Ma [not-audio_url] [/not-audio_url]

Duration: 38:14
Xinran is a top AI instructor who has taught 100s of product teams how to design and prototype with AI. He shared 5 practical techniques to avoid generating AI slop — from side-by-side exploration to reverse prompting to…