Azure API Management's GenAI Gateway with Andrei Kamenev

Azure API Management's GenAI Gateway with Andrei Kamenev

Author: Carl Franklin and Richard Campbell August 8, 2024 Duration: 50:49
How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Hosted by Carl Franklin and Richard Campbell, .NET Rocks! is a long-running conversation with the people building the future of software. This isn't a dry lecture; it's a lively, technical deep dive where two seasoned developers explore the vast ecosystem around Microsoft .NET, Azure, and modern development practices with a diverse roster of expert guests. Each episode feels like you're pulling up a chair in a room full of brilliant minds, listening to unfiltered discussions about real-world coding challenges, architectural patterns, and the tools that shape our daily work. You'll hear practical advice, war stories from the trenches, and forward-looking insights that go far beyond the documentation. Tuning into this podcast means connecting with a community of professionals who are as passionate about the craft as you are, offering perspectives that can transform how you approach your next project. Whether you're deep into C# or just curious about cloud-native development, these conversations provide a valuable blend of knowledge, humor, and genuine enthusiasm for technology.
Author: Language: English Episodes: 1000

.NET Rocks!
Podcast Episodes
Ethics and Bias in AI with Amber McKenzie [not-audio_url] [/not-audio_url]

Duration: 55:06
Artificial Intelligence is happening - are we using it correctly? While at NDC in Oslo, Carl and Richard talked to Amber McKenzie about the challenges of building AI applications that are ethical and unbiased. Doc Am dis…
Automated Text Summarization with Masa Nekic [not-audio_url] [/not-audio_url]

Duration: 55:26
Can software summarize documents? While at NDC in Oslo, Carl and Richard talked to Masa Nekic about automated text summarization. Masa walks through a few cases where text summarization is valuable, such as search optimi…
Migrating from WCF with Mark Rendle [not-audio_url] [/not-audio_url]

Duration: 56:54
WCF isn't coming to .NET Core 3 - what to do? While at NDC in Oslo, Carl and Richard chatted with Mark Rendle about his new project called Recode. Mark talks about how Microsoft came to the decision that they could not m…
Integrating UX in your Development Process with Debbie Levitt [not-audio_url] [/not-audio_url]

Duration: 59:00
How does UX work in your organization? While at NDC in Oslo, Carl and Richard talked to Debbie Levitt about how UX can help make software better and the development process less difficult. Debbie talks about UX being par…
HashiCorp Packer with Jamie Phillips [not-audio_url] [/not-audio_url]

Duration: 49:58
What can HashiCorp's Packer do for you? Carl and Richard talk to Jamie Phillips about how Packer helps to make golden images of hypervisor machines - that would be Hyper-V, VMWare or any of the container solutions so tha…
Authentication with Auth0 2019 with Vittorio Bertocci [not-audio_url] [/not-audio_url]

Duration: 53:38
What's your authentication solution? Carl and Richard talk to Vittorio Bertocci, now an architect at Auth0, about building pure identity solutions that work for all platforms and languages. Vittorio digs into why you wan…
Messaging Pitfalls with Jimmy Bogard [not-audio_url] [/not-audio_url]

Duration: 56:57
How do you use messaging? Carl and Richard talk to Jimmy Bogard about his work developing messaging architecture for applications. Jimmy talks about the mistakes he's made along the way, starting with not using formal me…
Home Automation Geek Out with Mads Kristensen [not-audio_url] [/not-audio_url]

Duration: 58:27
It's 2019, how smart is your home? Time for a Geek Out! Carl and Richard chat with Mads Kristensen about how he's adding automation to his home - and in a way that is tolerable for his significant other and young childre…
Building Websites using Gatsby with Jason Lengstorf [not-audio_url] [/not-audio_url]

Duration: 52:45
Why should you build your website with Gatsby? Carl and Richard chat with Jason Lengstorf about the Javascript library built on top of ReactJS to automate the generation of static web pages from a variety of data sources…