Mamba & Jamba

Mamba & Jamba

Author: Practical AI LLC April 24, 2024 Duration: 41:13

First there was Mamba… now there is Jamba from AI21. This is a model that combines the best non-transformer goodness of Mamba with good ‘ol attention layers. This results in a highly performant and efficient model that AI21 has open sourced! We hear all about it (along with a variety of other LLM things) from AI21’s co-founder Yoav.


Sponsors:

  • Fly.ioThe home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs
  • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today

Featuring:

Show Notes:

Upcoming Events: 


There's a lot of noise out there about artificial intelligence, but cutting through the hype to find what's genuinely useful can be a challenge. That's the space where Practical AI operates. Hosted by the team at Practical AI LLC, this technology podcast moves beyond abstract theory to explore how AI, machine learning, and large language models are actually being applied right now. Each episode features unscripted conversations with a diverse mix of experts, developers, business leaders, and curious minds. You'll hear tangible discussions about implementing machine learning systems, the realities of MLOps, the evolution of neural networks, and the practical implications of breakthroughs in deep learning and GANs. The dialogue is grounded in real-world scenarios, focusing on how these technologies solve problems, drive productivity, and create value in accessible ways. Whether you're a professional building models, a business person integrating AI tools, or an enthusiast eager to understand the landscape, this podcast offers a clear, conversational entry point. It’s about making sense of a complex field through the lens of practical application, demystifying the concepts that are shaping our world without losing sight of how they work on the ground.
Author: Language: en-us Episodes: 100

Practical AI
Podcast Episodes
Federated learning in production (part 1) [not-audio_url] [/not-audio_url]

Duration: 44:38
In this first of a two part series of episodes on federated learning, we dive into the evolving world of federated learning and distributed AI frameworks with Patrick Foley from Intel. We explore how frameworks like Open…
Emailing like a superhuman [not-audio_url] [/not-audio_url]

Duration: 47:27
Loïc Houssier, Head of Engineering at Superhuman, joins us to discuss how AI and LLMs are reshaping the email experience. He highlights challenges related to the variability of user prompts and infrastructure optimizatio…
Model Context Protocol Deep Dive [not-audio_url] [/not-audio_url]

Duration: 42:23
In this episode, Daniel and Chris unpack the Model Context Protocol (MCP), a rising standard for enabling agentic AI interactions with external systems, APIs, and data sources. They explore how MCP supports interoperabil…
Seeing beyond the scan in neuroimaging [not-audio_url] [/not-audio_url]

Duration: 42:58
In this episode, we explore the intersection of AI, machine learning, and healthcare through the lens of neuroimaging and epilepsy diagnosis. Dr. Gavin Winston shares insights from his work using MRI data and machine lea…
Open source AI to tackle your backlog [not-audio_url] [/not-audio_url]

Duration: 42:04
Vibe coding, agentic workflows, and AI-assisted pull requests? In this episode, Daniel and Chris chat with Robert Brennan and Graham Neubig of All Hands AI about how AI is transforming software development—from senior en…
Orchestrating agents, APIs, and MCP servers [not-audio_url] [/not-audio_url]

Duration: 42:52
In this episode, Daniel sits down with Pavel Veller, EPAM’s Chief Technologist, to explore the practical challenges of orchestrating many AI agents and managing connections to disparate systems/tools. Pavel shares insigh…
Software and hardware acceleration with Groq [not-audio_url] [/not-audio_url]

Duration: 43:24
How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acc…
AI-assisted coding with GitHub's COO [not-audio_url] [/not-audio_url]

Duration: 50:04
Kyle Daigle, COO of GitHub, joins the hosts to discuss the evolving role of AI in software development, GitHub Copilot’s impact, and the challenges of AI-assisted coding. The conversation covers licensing concerns, ethic…
Optimizing for efficiency with IBM’s Granite [not-audio_url] [/not-audio_url]

Duration: 43:38
We often judge AI models by leaderboard scores, but what if efficiency matters more? Kate Soule from IBM joins us to discuss how Granite AI is rethinking AI at the edge—breaking tasks into smaller, efficient components a…
Build a workspace of AI agents [not-audio_url] [/not-audio_url]

Duration: 47:39
How can every single person build a personal AI protégé and then accumulate (and share) a host of other assistants? In this episode, we dive into the world of no-code AI with Scott Meyer from Chipp.ai. We discuss AI tool…