Breaking distributed systems for fun and profit | Kyle Kingsbury (Jepsen)

Breaking distributed systems for fun and profit | Kyle Kingsbury (Jepsen)

Author: Ronak Nathani, Guang Yang July 2, 2024 Duration: 1:23:17

Well-known for his insightful and meticulous write-ups on testing distributed systems, Kyle (aka Aphyr) joins the show to chat about the origins of Jepsen, how he built a business around testing distributed systems, his writing process, favorite databases, and more.

 

Segments:

(00:03:29) From Physics to Software Engineering

(00:07:47) The origins of Jepsen

(00:09:41) Turning Jepsen into a full-time venture

(00:13:14) Jepsen's testing philosophy

(00:16:30) The consulting journey

(00:19:16) Structuring a consultancy

(00:22:32) Setting boundaries

(00:24:32) Pricing misadventures

(00:29:17) Pros and cons of being an independent consultant

(00:32:08) Managing your time when working for yourself

(00:38:23) Best part of the job

(00:41:13) Early writing influences

(00:45:25) LLMs and AI-generated content

(00:48:17) "The period where you can trust what you read is actually very recent"

(00:51:33) How to become a better writer

(00:54:25) Developing a formal understanding of distributed systems

(00:59:30) Common faults in distributed systems

(01:01:17) The complexity of testing distributed systems

(01:07:32) Communicating criticism effectively

(01:10:26) Advice for distributed systems engineers

(01:13:46) "Anybody trying to sell you a distributed lock is selling you sawdust and lies"

(01:16:31) Failure mode documentation

(01:18:52) The pitfalls of containerization

(01:20:17) Lightning round - favorite databases

 

Show Notes:

"Anybody who is trying to sell you a distributed lock is trying to sell you sawdust and Lies": https://martin.kleppmann.com/2016/02/08/how-to-do-distributed-locking.html

Kyle's excellent write-ups on testing distributed systems: https://jepsen.io/analyses

Kyle's blog: https://aphyr.com/posts

Training courses that Kyle runs: https://jepsen.io/services/training

 

Stay in touch:

👋 Make Ronak's day by leaving us a review and let us know who we should talk to next! hello@softwaremisadventures.com

Music: Vlad Gluschenko — Forest License: Creative Commons Attribution 3.0 Unported: https://creativecommons.org/licenses/by/3.0/deed.en


Behind every line of code, there's a person with a story, and that's where Software Misadventures finds its pulse. Hosts Ronak Nathani and Guang Yang pull up a chair with engineers, founders, and investors, but the conversation rarely stays in the technical manual. Instead, it wanders into the human territory of career detours, hard-won insights, and those unpredictable stumbles that often teach the most. This podcast is built on the idea that the journey is just as important as the destination, especially in the fast-moving tech world. You'll hear guests recount the projects that went sideways, the decisions they'd rethink, and the moments of clarity that emerged from the chaos. It’s a refreshingly honest look at the industry, emphasizing that expertise isn't just about what you build, but what you learn when things don't go as planned. Tune in for conversations that are less about perfect solutions and more about the real, sometimes messy, process of creating with technology. Each episode offers a blend of professional wisdom and personal narrative, making it a compelling listen for anyone curious about the lives woven into our digital landscape.
Author: Language: English Episodes: 55

Software Misadventures
Podcast Episodes
From High School Suspension to US Chief Data Scientist | DJ Patil [not-audio_url] [/not-audio_url]

Duration: 1:05:08
Known for coining the term "Data Scientist", DJ is a renowned technologist with a diverse background spanning academia, industry, and government. Having led product teams at companies like RelateIQ and LinkedIn, DJ was a…
Building Diverse Engineering Teams | Erica Lockheimer [not-audio_url] [/not-audio_url]

Duration: 1:20:22
Erica is a former VP of Engineering at LinkedIn. Having almost dropped out of college, Erica's journey in tech is a testament to her perseverance and dedication. In addition to leading engineering teams at LinkedIn, Eric…
Stories behind building HashiCorp | Mitchell Hashimoto [not-audio_url] [/not-audio_url]

Duration: 1:17:01
Mitchell co-founded HashiCorp in 2012 and created many important infrastructure tools, such as Terraform, Vagrant, Packer, and Consul. In addition to being a prolific engineer, Mitchell grew HashiCorp into a multi-billio…
Open sourcing LinkedIn's Derived Data Platform | Felix GV (LinkedIn) [not-audio_url] [/not-audio_url]

Duration: 1:01:09
What's it like to open source an internal project at a big tech company like LinkedIn? When should a company open source a project and what are the benefits and challenges that come along with it? If you want to open sou…