Azure API Management's GenAI Gateway with Andrei Kamenev

Azure API Management's GenAI Gateway with Andrei Kamenev

Author: Carl Franklin and Richard Campbell August 8, 2024 Duration: 50:49
How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Hosted by Carl Franklin and Richard Campbell, .NET Rocks! is a long-running conversation with the people building the future of software. This isn't a dry lecture; it's a lively, technical deep dive where two seasoned developers explore the vast ecosystem around Microsoft .NET, Azure, and modern development practices with a diverse roster of expert guests. Each episode feels like you're pulling up a chair in a room full of brilliant minds, listening to unfiltered discussions about real-world coding challenges, architectural patterns, and the tools that shape our daily work. You'll hear practical advice, war stories from the trenches, and forward-looking insights that go far beyond the documentation. Tuning into this podcast means connecting with a community of professionals who are as passionate about the craft as you are, offering perspectives that can transform how you approach your next project. Whether you're deep into C# or just curious about cloud-native development, these conversations provide a valuable blend of knowledge, humor, and genuine enthusiasm for technology.
Author: Language: English Episodes: 1000

.NET Rocks!
Podcast Episodes
Leading Teams in the Time of AI with Andrew Murphy [not-audio_url] [/not-audio_url]

Duration: 1:01:05
Artificial Intelligence is changing how software development happens - how is your team coping? Carl and Richard talk to Andrew Murphy about his work leading teams struggling with AI tools. Andrew talks about Nolan Lawso…
Making Reliable Software in 2026 with Damian Brady [not-audio_url] [/not-audio_url]

Duration: 1:01:00
It's always been challenging to make reliable software - is AI making it worse or better? Carl and Richard talk to Damian Brady about his experiences building software with AI tools and trying to bring that software up t…
Making Reliable Software in 2026 with Damien Brady [not-audio_url] [/not-audio_url]

Duration: 1:00:43
It's always been challenging to make reliable software - is AI making it worse or better? Carl and Richard talk to Damien Brady about his experiences building software with AI tools and trying to bring that software up t…
The Role of AI in Secure Software with Ben Dechrai [not-audio_url] [/not-audio_url]

Duration: 59:53
How does Artificial Intelligence impact our approach to building secure software? Carl and Richard talk to Ben Dechrai about his experiences working with AI tooling and building AI apps, and how that impacts security. Be…
The Role of AI in Secure Software with Ben Dechrai [not-audio_url] [/not-audio_url]

Duration: 1:00:00
How does Artificial Intelligence impact our approach to building secure software? Carl and Richard talk to Ben Dechrai about his experiences working with AI tooling and building AI apps, and how that impacts security. Be…
.NET Source Generators with Jason Bock [not-audio_url] [/not-audio_url]

Duration: 52:53
Why would you write code to generate code? Carl and Richard talk with Jason Bock about his experiences using modern .NET source generators to optimize certain aspects of applications. Jason talks about treading carefully…
.NET Source Generators with Jason Bock [not-audio_url] [/not-audio_url]

Duration: 53:00
Why would you write code to generate code? Carl and Richard talk with Jason Bock about his experiences using modern .NET source generators to optimize certain aspects of applications. Jason talks about treading carefully…
Aspire in 2026 with Maddy Montaquila [not-audio_url] [/not-audio_url]

Duration: 1:00:00
What's coming for Aspire in 2026? Carl and Richard talk to Maddy Montaquila about her work as the product manager for Aspire, the tool that helps you build cloud-native, distributed applications in any language and on an…
Aspire in 2026 with Maddy Montaquila [not-audio_url] [/not-audio_url]

Duration: 59:48
What's coming for Aspire in 2026? Carl and Richard talk to Maddy Montaquila about her work as the product manager for Aspire, the tool that helps you build cloud-native, distributed applications in any language and on an…
MAUI in 2026 with Gerald Versluis [not-audio_url] [/not-audio_url]

Duration: 58:00
What's happening with MAUI today? Carl and Richard talk to Gerald Versluis about the latest version of MAUI - and what's coming next! Gerald talks about the release of .NET 10 and the new features that have come to MAUI,…