Phi-3 from Microsoft ๐Ÿ’ป // SoftBank Invests $1B in Nvidia ๐Ÿค‘ // HuggingFace's FineWeb Dataset ๐ŸŒ

Phi-3 from Microsoft ๐Ÿ’ป // SoftBank Invests $1B in Nvidia ๐Ÿค‘ // HuggingFace's FineWeb Dataset ๐ŸŒ

Author: Earkind April 23, 2024 Duration: 14:03

Microsoft has launched its smallest AI model yet, the Phi-3 Mini, which is designed to be smaller and cheaper to run than its larger counterparts.

SoftBank plans to invest nearly $1 billion in Nvidia's chips to bolster its computing facilities and develop its own generative AI, giving Japan a strong domestic player in the AI space.

HuggingFace has released FineWeb, a dataset consisting of more than 15 trillion tokens of cleaned and deduplicated English web data from CommonCrawl, which outperforms models trained on other commonly used high-quality web datasets.

The papers discussed in this episode cover topics such as extending embedding models for long context retrieval, automating graphic design using large multimodal models, and Microsoft's innovative approach to training the Phi-3 Mini AI model.

Contact:ย ย sergi@earkind.com

Timestamps:

00:34 Introduction

01:35ย Microsoft launches Phi-3, its smallest AI model yet

03:10ย SoftBank will reportedly invest nearly $1 billion in AI push, tapping Nvidiaโ€™s chips

05:11ย HuggingFace Releases FineWeb: 15 Trillion tokens to train on

06:02 Fake sponsor

08:15ย Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

09:42ย LongEmbed: Extending Embedding Models for Long Context Retrieval

11:04ย Graphic Design with Large Multimodal Model

12:53 Outro


Each morning, GPT Reviews serves up a fresh, slightly chaotic conversation about everything happening in artificial intelligence. This daily podcast from Earkind is actually crafted by AI, offering a unique blend of the latest headlines, major announcements, and intriguing research plucked from sources like arXiv. But itโ€™s far from a dry briefing. The dynamic comes from its four distinct hosts: Giovani Pete Tizzano brings relentless optimism as an AI enthusiast, while Robert, the analyst, provides a grounded and often skeptical counterpoint. Olivia, whoโ€™s deeply embedded in online communities, shares the buzz and broader reactions, and Belinda, the witty research expert, helps unpack the technical details with clarity and a sharp sense of humor. Tuning in feels like dropping into a lively roundtable where complex ideas are debated, explained, and occasionally laughed about. Youโ€™ll get a comprehensive yet digestible overview of the AI landscape, all wrapped in a format thatโ€™s as entertaining as it is informative. The result is a consistently engaging listen that keeps you updated without feeling like homework, making it a standout in the daily news podcast space.
Author: Language: English Episodes: 100

GPT Reviews
Podcast Episodes