LLMs are like your weird, over-confident intern | Simon Willison (Datasette)

LLMs are like your weird, over-confident intern | Simon Willison (Datasette)

Author: Ronak Nathani, Guang Yang September 10, 2024 Duration: 1:55:50

Known for co-creating Django and Datasette, as well as his thoughtful writing on LLMs, Simon Willison joins the show to chat about blogging as an accountability mechanism, how to build intuition with LLMs, building a startup with his partner on their honeymoon, and more.

 

Segments:

(00:00:00) The weird intern

(00:01:50) The early days of LLMs

(00:04:59) Blogging as an accountability mechanism

(00:09:24) The low-pressure approach to blogging

(00:11:47) GitHub issues as a system of records

(00:16:15) Temporal documentation and design docs

(00:18:19) GitHub issues for team collaboration

(00:21:53) Copy-paste as an API

(00:26:54) Observable notebooks

(00:28:50) pip install LLM

(00:32:26) The evolution of using LLMs daily

(00:34:47) Building intuition with LLMs

(00:43:24) Democratizing access to automation

(00:47:45) Alternative interfaces for language models

(00:53:39) Is prompt engineering really engineering?

(00:58:39) The frustrations of working with LLMs

(01:01:59) Structured data extraction with LLMs

(01:06:08) How Simon would go about building a LLM app

(01:09:49) LLMs making developers more ambitious

(01:13:32) Typical workflow with LLMs

(01:19:58) Vibes-based evaluation

(01:23:25) Staying up-to-date with LLMs

(01:27:49) The impact of LLMs on new programmers

(01:29:37) The rise of 'Goop' and the future of software development

(01:40:20) Being an independent developer

(01:42:26) Staying focused and accountable

(01:47:30) Building a startup with your partner on the honeymoon

(01:51:30) The responsibility of AI practitioners

(01:53:07) The hidden dangers of prompt injection

(01:53:44) "Artificial intelligence" is really "imitation intelligence"

 

Show Notes:

Simon's blog: https://simonwillison.net/

Natalie's post on them building a startup together: https://blog.natbat.net/post/61658401806/lanyrd-from-idea-to-exit

Simon's talk from DjangoCon: https://www.youtube.com/watch?v=GLkRK2rJGB0

Simon on twitter: https://x.com/simonw

Datasette: https://github.com/simonw/datasette

 

Stay in touch:

👋 Make Ronak's day by leaving us a review and let us know who we should talk to next! hello@softwaremisadventures.com

 

Music: Vlad Gluschenko — Forest License: Creative Commons Attribution 3.0 Unported: https://creativecommons.org/licenses/by/3.0/deed.en


Behind every line of code, there's a person with a story, and that's where Software Misadventures finds its pulse. Hosts Ronak Nathani and Guang Yang pull up a chair with engineers, founders, and investors, but the conversation rarely stays in the technical manual. Instead, it wanders into the human territory of career detours, hard-won insights, and those unpredictable stumbles that often teach the most. This podcast is built on the idea that the journey is just as important as the destination, especially in the fast-moving tech world. You'll hear guests recount the projects that went sideways, the decisions they'd rethink, and the moments of clarity that emerged from the chaos. It’s a refreshingly honest look at the industry, emphasizing that expertise isn't just about what you build, but what you learn when things don't go as planned. Tune in for conversations that are less about perfect solutions and more about the real, sometimes messy, process of creating with technology. Each episode offers a blend of professional wisdom and personal narrative, making it a compelling listen for anyone curious about the lives woven into our digital landscape.
Author: Language: English Episodes: 55

Software Misadventures
Podcast Episodes
Impact Driven Development | Matt Klein (Envoy, bitdrift) [not-audio_url] [/not-audio_url]

Duration: 1:19:18
From creating Envoy to co-founding bitdrift to reimagine mobile observability, Matt joins the show to chat about being told to simply "write some proxy in Python" in the early days of building Envoy, early influences fro…
Build the scary stuff | Bryan Cantrill (Oxide) [not-audio_url] [/not-audio_url]

Duration: 2:19:41
From being a distinguished engineer at Sun Microsystems to co-founding Oxide Computer Company to build a new kind of server, Bryan joins the show to chat about being told that he's on a suicide mission when starting Oxid…
Lessons from the early days building Kafka and Confluent | Jay Kreps [not-audio_url] [/not-audio_url]

Duration: 1:16:08
From writing the first lines of Kafka over a Christmas break as a LinkedIn engineer to running a public company as the CEO of Confluent, Jay joins the show to chat about how he and his co-founders convinced investors to…
Become a LLM-ready Engineer | Maxime Beauchemin (Airflow, Preset) [not-audio_url] [/not-audio_url]

Duration: 41:05
If you've worked on data problems, you probably have heard of Airflow and Superset, two powerful tools that have cemented their place in the data ecosystem. Building successful open-source software is no easy feat, and e…
Life as a Distinguished Engineer | Joakim Recht (Uber) [not-audio_url] [/not-audio_url]

Duration: 1:15:43
Out of thousands of engineers at Uber, there's only a handful of Distinguished Engineers and Joakim was one of them. In this conversation we chat about Why software engineering is a lot like a sausage factory. Considerat…
Learning in public | Kelsey Hightower [not-audio_url] [/not-audio_url]

Duration: 57:26
We're super excited to have Kelsey back on the show! Our last conversation was around his incredible career journey - from working at McDonald's after school to starting his own computer store, to hacking on python infra…
Engineer's guide to startup advising | Kelsey Hightower [not-audio_url] [/not-audio_url]

Duration: 49:50
We're super excited to have Kelsey back on the show! Our last conversation was around his incredible career journey - from working at McDonald's after school to starting his own computer store, to hacking on python infra…