Pete Warden - On launching "AI in a Box" and building a hardware edge AI company - #24

Pete Warden - On launching "AI in a Box" and building a hardware edge AI company - #24

Author: Ronak Nathani, Guang Yang October 23, 2023 Duration: 43:01

What's "AI in a Box"? Pete Warden joins the show to share a new project he recently launched that encapulates Language Transcription/Translation and Question Answering capabilities into a wallet-sized board running locally without internet, as well as stories and learnings from building his new company, Useful Sensors, after 7 years of leading the tensorflow mobile project at Google. 

Pete is the CEO of Useful Sensors. After founding his own company Jetpac and selling it to Google in 2014, he became a staff research engineer at Google, where he led the TensorFlow Mobile team. Pete is also the author of two well-received books: "Public Data Sources" and "Big Data Glossary" and builder of OpenHeatMap.

 

Show Notes:

 

Stay in touch:

✉️ Subscribe to our newsletter: https://softwaremisadventures.com

👋 Send feedback or say hi: hello@softwaremisadventures.com

 

Segments:

[0:00:00] Failing and trying again, experiential learning

[0:03:13] AI-in-a-box demo

[0:07:28] Animatronics?

[0:10:12] Privacy and trust

[0:12:04] Talk to your appliances

[0:15:22] How to fit the LLM into such a small chip?

[0:16:50] Quantization

[0:20:07] Disposable ML frameworks

[0:24:33] Updating model on shipped hardware

[0:28:34] LLMs with specialized domain knowledge

[0:30:08] Founding Useful Sensors

[0:37:07] scaling training vs inference


Behind every line of code, there's a person with a story, and that's where Software Misadventures finds its pulse. Hosts Ronak Nathani and Guang Yang pull up a chair with engineers, founders, and investors, but the conversation rarely stays in the technical manual. Instead, it wanders into the human territory of career detours, hard-won insights, and those unpredictable stumbles that often teach the most. This podcast is built on the idea that the journey is just as important as the destination, especially in the fast-moving tech world. You'll hear guests recount the projects that went sideways, the decisions they'd rethink, and the moments of clarity that emerged from the chaos. It’s a refreshingly honest look at the industry, emphasizing that expertise isn't just about what you build, but what you learn when things don't go as planned. Tune in for conversations that are less about perfect solutions and more about the real, sometimes messy, process of creating with technology. Each episode offers a blend of professional wisdom and personal narrative, making it a compelling listen for anyone curious about the lives woven into our digital landscape.
Author: Language: English Episodes: 55

Software Misadventures
Podcast Episodes
Ryan Underwood - On debugging the Linux kernel - #4 [not-audio_url] [/not-audio_url]

Duration: 1:02:57
Ryan Underwood is a Staff SRE and tech lead on the Helix and Zookeeper SRE team at LinkedIn. Prior to LinkedIn, he was an SRE at Machine Zone and Google. Apart from his regular responsibilities, Ryan's interest and exper…