Scaling Agent Workloads at Vercel

Scaling Agent Workloads at Vercel

Author: Software Engineering Daily September 17, 2026 Duration: 51:25

Most AI agent setups today are built around a single session, where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business, where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself.

eve is an open source, cloud-native agent framework from Vercel that removes much of the agent scaling burden. In the eve framework, an agent is defined declaratively through configuration files and these files compile into infrastructure as code so the platform provisions only what the agent actually uses.

Andrew Barba is a Member of Technical Staff at Vercel, and Shar Dara is the Product Lead for eve at Vercel. In this episode, they join Kevin Ball to discuss what it means for an agent framework to be cloud-native, why they chose to express agents in plain English, and their view that company building is becoming agent building.

Sponsorship inquiries:
sponsor@softwareengineeringdaily.com

The post Scaling Agent Workloads at Vercel appeared first on Software Engineering Daily.


Dive into the vast Podcast Archives-Software Engineering Daily, a curated collection of in-depth technical conversations that have defined the landscape of modern software development. This archive goes beyond surface-level news, offering a permanent record of deep-dive discussions with engineers, researchers, and founders who are building the tools and platforms shaping our digital world. Each episode is a focused exploration, unpacking complex topics like distributed systems, machine learning infrastructure, programming language design, and the practical challenges of scaling technology. You'll hear firsthand accounts of architectural decisions, post-mortems on system failures, and thoughtful debates on emerging paradigms. It’s a resource built for the curious professional who values substance over soundbites, providing context and depth that shorter formats simply cannot. Whether you're looking to understand the historical context behind a current technology, reinforce your foundational knowledge, or discover niche specialties, this podcast archive serves as an essential, ever-growing library. The conversations are detailed, technical, and assume a level of familiarity with the field, making it a trusted companion for continuous learning. Listen to this podcast not for fleeting headlines, but for the enduring insights and nuanced expertise that come from thoughtful, long-form dialogue with the people writing the code and designing the systems that run our world.
Author: Language: en-us Episodes: 50

Software Engineering Daily
Podcast Episodes
Inside Google’s Database Infrastructure for the AI Era [not-audio_url] [/not-audio_url]

Duration: 1:18:26
Historically, databases were responsible for storing data and returning exact results in response to queries. However, AI is now bending that contract in a new direction. Applications increasingly expect structured and u…
A Rust Framework to Simplify Distributed Systems [not-audio_url] [/not-audio_url]

Duration: 50:31
A Rust Framework to Simplify Distributed Systems Building software that runs across many machines is notoriously difficult. Developers have to grapple with problems such as race conditions, partial failures, and message…
Moving Beyond RAG with Precomputed Context [not-audio_url] [/not-audio_url]

Duration: 55:48
Retrieval has become one of the central problems in building useful AI systems. The standard approach to grounding a model in one’s own data has been retrieval augmented generation, or RAG, where an agent searches a vect…
The Death of Online Anonymity [not-audio_url] [/not-audio_url]

Duration: 52:42
Age verification is reshaping how people access the internet. An ever-growing patchwork of laws can now require government IDs, facial age estimation, or behavioral inference before you can enter digital spaces. Discord,…
TypeScript 7 and What Comes Next [not-audio_url] [/not-audio_url]

Duration: 57:15
TypeScript is a programming language that builds on JavaScript by adding a system of types. Those types let developers describe the shape of their data and catch mistakes before code ever runs, while also powering the au…
The Gap Between AI Spending and AI Value [not-audio_url] [/not-audio_url]

Duration: 54:42
It is widely reported that a gap has emerged between enterprise spending on AI and the durable value captured from that spend. Individual employees have enthusiastically adopted coding assistants and chatbots, yet those…
AI and the New Global Security Landscape [not-audio_url] [/not-audio_url]

Duration: 1:12:32
The conversation about AI often focuses on software, automation, and the race between attackers and defenders in code. However, some of the most consequential risks lie further afield, in domains where a mistake is measu…
How LLMs Are Reshaping Recommendation Systems [not-audio_url] [/not-audio_url]

Duration: 47:51
News feeds and recommendation systems have long relied on deep learning architectures that score each candidate item independently. As LLMs have matured, they have opened up a fundamentally different approach, where a sy…
Rebuilding the Cloud for AI Agent Code [not-audio_url] [/not-audio_url]

Duration: 49:57
For two decades, the cloud has been shaped by human developers writing code and managing its deployment. Now a growing share of production code is generated by LLMs with little human review. Because that code is not full…