Phi-3 from Microsoft πŸ’» // SoftBank Invests $1B in Nvidia πŸ€‘ // HuggingFace's FineWeb Dataset 🌐

Phi-3 from Microsoft πŸ’» // SoftBank Invests $1B in Nvidia πŸ€‘ // HuggingFace's FineWeb Dataset 🌐

Author: Earkind April 23, 2024 Duration: 14:03

Microsoft has launched its smallest AI model yet, the Phi-3 Mini, which is designed to be smaller and cheaper to run than its larger counterparts.

SoftBank plans to invest nearly $1 billion in Nvidia's chips to bolster its computing facilities and develop its own generative AI, giving Japan a strong domestic player in the AI space.

HuggingFace has released FineWeb, a dataset consisting of more than 15 trillion tokens of cleaned and deduplicated English web data from CommonCrawl, which outperforms models trained on other commonly used high-quality web datasets.

The papers discussed in this episode cover topics such as extending embedding models for long context retrieval, automating graphic design using large multimodal models, and Microsoft's innovative approach to training the Phi-3 Mini AI model.

Contact:Β Β sergi@earkind.com

Timestamps:

00:34 Introduction

01:35Β Microsoft launches Phi-3, its smallest AI model yet

03:10Β SoftBank will reportedly invest nearly $1 billion in AI push, tapping Nvidia’s chips

05:11Β HuggingFace Releases FineWeb: 15 Trillion tokens to train on

06:02 Fake sponsor

08:15Β Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

09:42Β LongEmbed: Extending Embedding Models for Long Context Retrieval

11:04Β Graphic Design with Large Multimodal Model

12:53 Outro


Each morning, GPT Reviews serves up a fresh, slightly chaotic conversation about everything happening in artificial intelligence. This daily podcast from Earkind is actually crafted by AI, offering a unique blend of the latest headlines, major announcements, and intriguing research plucked from sources like arXiv. But it’s far from a dry briefing. The dynamic comes from its four distinct hosts: Giovani Pete Tizzano brings relentless optimism as an AI enthusiast, while Robert, the analyst, provides a grounded and often skeptical counterpoint. Olivia, who’s deeply embedded in online communities, shares the buzz and broader reactions, and Belinda, the witty research expert, helps unpack the technical details with clarity and a sharp sense of humor. Tuning in feels like dropping into a lively roundtable where complex ideas are debated, explained, and occasionally laughed about. You’ll get a comprehensive yet digestible overview of the AI landscape, all wrapped in a format that’s as entertaining as it is informative. The result is a consistently engaging listen that keeps you updated without feeling like homework, making it a standout in the daily news podcast space.
Author: Language: English Episodes: 100

GPT Reviews
Podcast Episodes