Azure API Management's GenAI Gateway with Andrei Kamenev

Azure API Management's GenAI Gateway with Andrei Kamenev

Author: Carl Franklin and Richard Campbell August 8, 2024 Duration: 50:49
How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Hosted by Carl Franklin and Richard Campbell, .NET Rocks! is a long-running conversation with the people building the future of software. This isn't a dry lecture; it's a lively, technical deep dive where two seasoned developers explore the vast ecosystem around Microsoft .NET, Azure, and modern development practices with a diverse roster of expert guests. Each episode feels like you're pulling up a chair in a room full of brilliant minds, listening to unfiltered discussions about real-world coding challenges, architectural patterns, and the tools that shape our daily work. You'll hear practical advice, war stories from the trenches, and forward-looking insights that go far beyond the documentation. Tuning into this podcast means connecting with a community of professionals who are as passionate about the craft as you are, offering perspectives that can transform how you approach your next project. Whether you're deep into C# or just curious about cloud-native development, these conversations provide a valuable blend of knowledge, humor, and genuine enthusiasm for technology.
Author: Language: English Episodes: 1000

.NET Rocks!
Podcast Episodes
NUKE 5.0 with Matthias Koch [not-audio_url] [/not-audio_url]

Duration: 49:10
With a new version of .NET out, it's time for a new version of Nuke! Carl and Richard talk to Matthias Koch about Nuke V5 - synchronizing the version number of Nuke with the version of .NET. Matthias talks about the phil…
Hello World the Film with Shawn Wildermuth [not-audio_url] [/not-audio_url]

Duration: 53:20
Ever pivoted halfway through a software project? It happens in filmmaking too! Carl and Richard talk to Shawn Wildermuth about his experience making Hello World the Film. Shawn talks about starting out wanting to make a…
The Microsoft Open Source Sandbox with Aaron Stannard [not-audio_url] [/not-audio_url]

Duration: 1:06:49
Can you make open source projects in the Microsoft ecosystem and live to tell the tale? Carl and Richard talk to Aaron Stannard about his view of the Microsoft open-source ecosystem, including the challenges of building…
The ROI of Good UX Design with Billy Hollis [not-audio_url] [/not-audio_url]

Duration: 56:28
Good user interface design makes your company money! Carl and Richard talk to Billy Hollis about his latest work around understanding the return on investment that exists with user interface design. Billy talks about a s…
Cake 1.0 with Mattias Karlsson [not-audio_url] [/not-audio_url]

Duration: 55:34
Cake is shipping! Carl and Richard talk to Mattias Karlsson about Cake, aka C# Make. First on the show in 2016, Cake has been through a lot - all the twists and turns of .NET Core, becoming a cross-platform product - it'…
The .NET Foundation Evolves with Layla Porter [not-audio_url] [/not-audio_url]

Duration: 50:15
A new .NET Foundation board is elected - what does it mean for you? Carl and Richard talk to Layla Porter about her new role on the .NET Foundation board and the goals of the foundation to grow its membership, bring more…
Migrating .NET Applications to Azure with Mike Richter [not-audio_url] [/not-audio_url]

Duration: 57:43
The pandemic is sending a lot of work to the cloud - are you ready to move? Carl and Richard talk to Mike Richter about his work helping companies move .NET applications into the cloud. Mike starts out with the hard trut…
GitHub Codespaces with Anthony van der Hoorn [not-audio_url] [/not-audio_url]

Duration: 54:59
Can a development environment be online? Carl and Richard talk to Anthony van der Hoorn about GitHub Codespaces - the consolidation of a number of online development solutions from Microsoft including Visual Studio Onlin…
When Your Experiment Gets Popular with Jamie Rees [not-audio_url] [/not-audio_url]

Duration: 50:51
What happens when an open-source experiment becomes software people care about? Carl and Richard talk to Jamie Rees about his experiences creating Ombi - an open-source project that helps people managing Plex servers to…