#195 - OpenAI o3 & for-profit, DeepSeek-V3, Latent Space

#195 - OpenAI o3 & for-profit, DeepSeek-V3, Latent Space

Author: Skynet Today January 5, 2025 Duration: 1:39:05
Our 195th episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's  Recorded on 01/04/2024 Join our brand new Discord here! https://discord.gg/nTyezGSKwP Note: apologies for Andrey's slurred speech and the jumpy editing, will be back to normal next week! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. Sponsors: The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence. In this episode: - OpenAI teases new deliberative alignment techniques in its O3 model, showcasing major improvements in reasoning benchmarks, whilst surprising with autonomy in hacks against chess engines.  - Microsoft and OpenAI continue to wrangle over the terms of their partnership, highlighting tensions amid OpenAI's shift towards a for-profit model.  - Chinese AI companies like DeepSeek and Quen release advanced open-source models, presenting significant contributions to AI capabilities and performance optimization.  - Sakana AI introduces innovative applications of AI to the search for artificial life, emphasizing the potential and curiosity-driven outcomes of open-ended learning and exploration. If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form. Timestamps + Links: (00:00:00) Intro / Banter (00:03:07) News Preview (00:03:54) Response to listener comments (00:05:00) Sponsor Break Tools & Apps (00:06:11) OpenAI announces new o3 model (00:21:17) Alibaba slashes prices on large language models by up to 85% as China AI rivalry heats up (00:23:04) ElevenLabs launches Flash, its fastest text-to-speech AI yet Applications & Business (00:24:24) OpenAI announces plan to transform into a for-profit company (00:33:17) Microsoft and OpenAI Wrangle Over Terms of Their Blockbuster Partnership (00:37:36) Elon Musk’s xAI gets investment from Nvidia in recent funding round: report (00:39:43) Sam Altman’s nuclear energy startup signs one of the largest nuclear power deals to date (00:41:13) OpenAI Search Leader Departs After Less Than a Year (00:42:43) Senior OpenAI Researcher Radford Departs Projects & Open Source (00:45:21) DeepSeek-AI Just Released DeepSeek-V3: A Strong Mixture-of-Experts (MoE) Language Model with 671B Total Parameters with 37B Activated for Each Token (00:54:14) Qwen Team Releases QvQ: An Open-Weight Model for Multimodal Reasoning (00:58:09) LightOn and Answer.ai Releases ModernBERT: A New Model Series that is a Pareto Improvement over BERT with both Speed and Accuracy Research & Advancements (01:00:31) Deliberation in Latent Space via Differentiable Cache Augmentation (01:05:14) Automating the Search for Artificial Life with Foundation Models Policy & Safety (01:10:27) Nonprofit group joins Elon Musk’s effort to block OpenAI’s for-profit transition (01:14:35) OpenAI Researchers Propose 'Deliberative Alignment' : A Training Approach that Teaches LLMs to Explicitly Reason through Safety Specifications before Producing an Answer (01:22:06) o1-preview autonomously hacked its environment rather than lose to Stockfish in our chess challenge. No adversarial prompting needed. (01:27:22) Elon Musk’s xAI supercomputer gets 150MW power boost despite concerns over grid impact and local power stability (01:29:06) DOE: Data centers consumed 4.4% of US power in 2023, could hit 12% by 2028 Synthetic Media & Art (01:32:20) OpenAI failed to deliver the opt-out tool it promised by 2025 (01:36:15) Outro See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Keeping up with artificial intelligence can feel like drinking from a firehose. Every week brings a new breakthrough, a surprising application, or an urgent ethical debate. Last Week in AI, from the team at Skynet Today, is here to turn that torrent into a clear, digestible stream. Instead of getting lost in the noise, you'll get a thoughtful rundown of the developments that actually have impact, explained without unnecessary jargon. Each episode feels like a conversation with well-informed friends who have done the homework for you, sifting through research papers, product launches, and industry announcements to highlight what's substantive. You'll hear nuanced discussions that go beyond the headlines, considering the real-world implications of new models, policy shifts, and corporate moves in the tech landscape. This podcast doesn't just tell you what happened; it provides context on why it matters for developers, businesses, and society at large. It’s an efficient way to stay informed and critically engaged with a field that is reshaping our world at a breathtaking pace. Tune in for a consistently insightful analysis that makes the complex world of AI feel accessible and relevant, week after week.
Author: Language: English Episodes: 100

Last Week in AI
Podcast Episodes
#191 - Sora leak, Pixtral Large, OpenAI email archives [not-audio_url] [/not-audio_url]

Duration: 1:42:11
Our 191st episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladsto…
#190 - AI scaling struggles, OpenAI Agents, Super Weights [not-audio_url] [/not-audio_url]

Duration: 1:37:21
Our 190th episode with a summary and discussion of last week's* big AI news! *and sometimes last last week's Hosted by Andrey Kurenkov and Jeremie Harris. Note from Andrey: this one is coming out a bit later than planned…
#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI [not-audio_url] [/not-audio_url]

Duration: 1:42:46
Our 189th episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladsto…
#188 - ChatGPT+Search, OpenAI+AMD, SimpleQA, π0 [not-audio_url] [/not-audio_url]

Duration: 1:51:50
Our 188th episode with a summary and discussion of last week's big AI news! Hosted by Andrey Kurenkov and Jeremie Harris. Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladsto…
#186 - Adobe AI Tools, Tesla's Cybercab, Nobel Prizes [not-audio_url] [/not-audio_url]

Duration: 1:33:54
Our 186th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and guest host Jon Krohn from the SuperDataScience Podcast. Check out Jon’s upcoming agent-focused event here - AI Ca…
#185 - Movie Gen, ChatGPT Canvas, OpenAI's VC Round, SB 1047 Vetoed [not-audio_url] [/not-audio_url]

Duration: 1:29:37
Our 185th episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and guest host Gavin Purcell from the AI for Humans podcast. Read out our text newsletter and comment on the podcast…
#183 - OpenAI o1, Adobe vid gen, Reflection 70B, DeepMind AlphaProteo [not-audio_url] [/not-audio_url]

Duration: 1:48:16
Our 183rd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and Jeremie Harris. Note: once again, apologies from Andrey on this one coming out late. Starting with the next one w…
# 182 - Alexa 2.0, MiniMax, Surskever raises $1B, SB 1047 approved [not-audio_url] [/not-audio_url]

Duration: 1:38:47
Our 182nd episode with a summary and discussion of last week's big AI news! With hosts Andrey Kurenkov and Jeremie Harris. Read out our text newsletter and comment on the podcast at https://lastweekin.ai/. If you would l…