Azure API Management's GenAI Gateway with Andrei Kamenev

Azure API Management's GenAI Gateway with Andrei Kamenev

Author: Carl Franklin and Richard Campbell August 8, 2024 Duration: 50:49
How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Hosted by Carl Franklin and Richard Campbell, .NET Rocks! is a long-running conversation with the people building the future of software. This isn't a dry lecture; it's a lively, technical deep dive where two seasoned developers explore the vast ecosystem around Microsoft .NET, Azure, and modern development practices with a diverse roster of expert guests. Each episode feels like you're pulling up a chair in a room full of brilliant minds, listening to unfiltered discussions about real-world coding challenges, architectural patterns, and the tools that shape our daily work. You'll hear practical advice, war stories from the trenches, and forward-looking insights that go far beyond the documentation. Tuning into this podcast means connecting with a community of professionals who are as passionate about the craft as you are, offering perspectives that can transform how you approach your next project. Whether you're deep into C# or just curious about cloud-native development, these conversations provide a valuable blend of knowledge, humor, and genuine enthusiasm for technology.
Author: Language: English Episodes: 1000

.NET Rocks!
Podcast Episodes
Enterprise Mobile Web with Chris Love [not-audio_url] [/not-audio_url]

Duration: 55:48
Carl and Richard talk to Chris Love about building mobile web apps for the enterprise. The conversation starts out with a reference to a comment made on a previous show about the problems with web apps not being built we…
Thinking in DDD with Julie Lerman and Steve Smith [not-audio_url] [/not-audio_url]

Duration: 1:03:35
Carl and Richard talk to Julie Lerman and Steve Smith about the fundamentals of Domain Driven Design (DDD). Julie and Steve have collaborated on a very popular Pluralsight course about DDD that has made the methodology m…
Fusion Power Geek Out #2 [not-audio_url] [/not-audio_url]

Duration: 54:56
Well, here we go - the second installation of the fusion power geek out. While the first show focused on the "Big Science" fusion power projects like NIF and ITER, this time around Richard digs into smaller hybrid projec…
Evolving ASP.NET Web Development with Scott Hunter [not-audio_url] [/not-audio_url]

Duration: 57:22
Carl and Richard chat with Scott Hunter about how Microsoft is working to evolve web development for ASP.NET developers. While the focus of the discussion is on ASP.NET vNext, you can't talk web without also talking clou…
Machine Learning in the Cloud with Seth Juarez [not-audio_url] [/not-audio_url]

Duration: 55:23
Carl and Richard talk to Seth Juarez about the latest developments in the machine learning space for the Microsoft space. The conversation starts out focused on Seth's open source library for doing machine learning in .N…
Internet of Things on Windows with Dan Rosenstein [not-audio_url] [/not-audio_url]

Duration: 54:23
Carl and Richard chat with Dan Rosenstein about his work bringing the Windows Developer Program for Internet of Things (IoT) to life. The conversation starts out with a discussion about Microsoft's focus on IoT and the r…
Building Mobile Web Apps with Rick Strahl [not-audio_url] [/not-audio_url]

Duration: 56:37
Carl and Richard chat with Rick Strahl about his latest efforts to build mobile web applications. The conversation starts out with a recap of the continuing debate about native vs web on mobile devices. As Rick says, the…
Migrating to Azure with Mike Wood [not-audio_url] [/not-audio_url]

Duration: 54:07
Carl and Richard talk to Mike Wood about migrating your applications to Azure. The conversation starts out thinking through the fundamentals of working in the cloud - how architecture and deployment are different. This i…
Psychology in Programming with Adam Tornhill [not-audio_url] [/not-audio_url]

Duration: 54:16
Carl and Richard talk to Adam Tornhill about his work understanding the psychology of programming. The conversation starts out with some thinking around getting into "the flow," being able to focus effectively on program…