Lessons from the early days building Kafka and Confluent | Jay Kreps

Lessons from the early days building Kafka and Confluent | Jay Kreps

Author: Ronak Nathani, Guang Yang June 4, 2024 Duration: 1:16:08

From writing the first lines of Kafka over a Christmas break as a LinkedIn engineer to running a public company as the CEO of Confluent, Jay joins the show to chat about how he and his co-founders convinced investors to take a chance on their vision, what many engineers get wrong about communication, and why engineers can make great CEOs - even when coding is not in the job description. And much more.

Segments:

(00:01:16) The Shaved Head Bet
(00:04:07) Fundraising
(00:12:16) The Role of Technical Background in VCs
(00:15:48) The power of believing in the possibility of important changes
(00:18:29) The Journey to starting Confluent
(00:27:11) Kafka's Controversial Beginnings
(00:34:30) Effective Communication in Engineering
(00:44:20) The Early Days of Kafka
(00:48:31) The Power of Storytelling
(00:57:19) Early days of Confluent
(01:03:06) Do Engineers Make Good CEOs?
(01:07:59) A Typical Day in the Life of a CEO
(01:12:24) The Evolution of Data Streaming

Show Notes:
- "The log" blog post that solidified Jay and his co-founders' conviction to found Confluent: https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying

- Jay on twitter: https://x.com/jaykreps

Stay in touch:
👋 Make Ronak's day by leaving us a review and let us know who we should talk to next! hello@softwaremisadventures.com

Music: Vlad Gluschenko — Forest License: Creative Commons Attribution 3.0 Unported: https://creativecommons.org/licenses/by/3.0/deed.en


Behind every line of code, there's a person with a story, and that's where Software Misadventures finds its pulse. Hosts Ronak Nathani and Guang Yang pull up a chair with engineers, founders, and investors, but the conversation rarely stays in the technical manual. Instead, it wanders into the human territory of career detours, hard-won insights, and those unpredictable stumbles that often teach the most. This podcast is built on the idea that the journey is just as important as the destination, especially in the fast-moving tech world. You'll hear guests recount the projects that went sideways, the decisions they'd rethink, and the moments of clarity that emerged from the chaos. It’s a refreshingly honest look at the industry, emphasizing that expertise isn't just about what you build, but what you learn when things don't go as planned. Tune in for conversations that are less about perfect solutions and more about the real, sometimes messy, process of creating with technology. Each episode offers a blend of professional wisdom and personal narrative, making it a compelling listen for anyone curious about the lives woven into our digital landscape.
Author: Language: English Episodes: 55

Software Misadventures
Podcast Episodes
Introducing Software Misadventures Podcast - #0 [not-audio_url] [/not-audio_url]

Duration: 4:00
In this episode, Ronak, Austin and Guang share the origin story - who they are, what this podcast is about and why they are doing this. They've seen first hand how stressful it is when something breaks in production but…