Scaling Agent Workloads at Vercel

Scaling Agent Workloads at Vercel

Author: Software Engineering Daily September 17, 2026 Duration: 51:25

Most AI agent setups today are built around a single session, where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business, where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself.

eve is an open source, cloud-native agent framework from Vercel that removes much of the agent scaling burden. In the eve framework, an agent is defined declaratively through configuration files and these files compile into infrastructure as code so the platform provisions only what the agent actually uses.

Andrew Barba is a Member of Technical Staff at Vercel, and Shar Dara is the Product Lead for eve at Vercel. In this episode, they join Kevin Ball to discuss what it means for an agent framework to be cloud-native, why they chose to express agents in plain English, and their view that company building is becoming agent building.

Sponsorship inquiries:
sponsor@softwareengineeringdaily.com

The post Scaling Agent Workloads at Vercel appeared first on Software Engineering Daily.


Dive into the vast Podcast Archives-Software Engineering Daily, a curated collection of in-depth technical conversations that have defined the landscape of modern software development. This archive goes beyond surface-level news, offering a permanent record of deep-dive discussions with engineers, researchers, and founders who are building the tools and platforms shaping our digital world. Each episode is a focused exploration, unpacking complex topics like distributed systems, machine learning infrastructure, programming language design, and the practical challenges of scaling technology. You'll hear firsthand accounts of architectural decisions, post-mortems on system failures, and thoughtful debates on emerging paradigms. It’s a resource built for the curious professional who values substance over soundbites, providing context and depth that shorter formats simply cannot. Whether you're looking to understand the historical context behind a current technology, reinforce your foundational knowledge, or discover niche specialties, this podcast archive serves as an essential, ever-growing library. The conversations are detailed, technical, and assume a level of familiarity with the field, making it a trusted companion for continuous learning. Listen to this podcast not for fleeting headlines, but for the enduring insights and nuanced expertise that come from thoughtful, long-form dialogue with the people writing the code and designing the systems that run our world.
Author: Language: en-us Episodes: 50

Software Engineering Daily
Podcast Episodes
Autonomous Drone Delivery at Scale [not-audio_url] [/not-audio_url]

Duration: 50:30
Autonomous drone delivery has long been the stuff of science fiction, but ongoing advances have moved the space from experimental to operational. Zipline is one of the leading companies in this space, with drones that ch…
The European Startup Scene [not-audio_url] [/not-audio_url]

Duration: 48:57
Europe’s startup ecosystem is maturing rapidly, with companies like Revolut, Lovable, and Legora demonstrating that world-class technology businesses can be built and scaled on the continent. While the US remains the dom…
React Native at Scale [not-audio_url] [/not-audio_url]

Duration: 45:35
React Native is an open source framework developed by Meta that allows engineers to build mobile applications for both iOS and Android using a single JavaScript codebase. The framework bridges the gap between web develop…
Formal Methods as Agent Guardrails [not-audio_url] [/not-audio_url]

Duration: 48:32
Formal methods are a branch of mathematics and computer science focused on proving the correctness of systems, and they have long promised a more rigorous foundation for software. However, their complexity has kept them…
Open Source Sustainability [not-audio_url] [/not-audio_url]

Duration: 58:43
Open source software underpins nearly every modern application, including frameworks powering the most popular websites, to the libraries securing financial backend systems. However, while open source drives collaboratio…
Vespa AI and Surpassing the Limits of Vector Search [not-audio_url] [/not-audio_url]

Duration: 38:35
Vector search has risen to become a foundational tool in modern search and retrieval systems, including the RAG pipelines that power many AI applications. However, the demands on retrieval systems are growing more sophis…
SmartBear and Multi-Agent QA [not-audio_url] [/not-audio_url]

Duration: 55:15
AI coding tools have dramatically accelerated the pace of development, and the bottleneck in the software development lifecycle has shifted to code validation and testing. However, the conventional tools and workflows th…
The Ethics of Autonomous Weapons Systems [not-audio_url] [/not-audio_url]

Duration: 1:06:40
Artificial intelligence is transforming warfare faster than the legal and ethical frameworks designed to govern it. Militaries around the world are deploying AI-powered decision support systems to identify targets, asses…
Open-Weight AI Models [not-audio_url] [/not-audio_url]

Duration: 50:14
Open-weight models are AI systems whose trained parameters are publicly released, which allows developers to run, fine-tune, and deploy them independently rather than accessing them only through a hosted API. While close…