GPT Reviews
Google I/O 2024 announcements, including new AI tools like Firebase Genkit, LearnLM, and Veo, as well as Gemini, an AI replacement for Google Assistant.
The introduction of the MS MARCO Web Search dataset, which provides a retrieval benchmark with three web retrieval challenge tasks and millions of real-clicked query-document pairs for training and evaluating retrieval models.
The "What matters when building vision-language models?" paper, which identifies critical decisions in the design of vision-language models and presents Idefics2, an efficient foundational VLM of 8 billion parameters that achieves state-of-the-art performance within its size category.
The "RLHF Workflow: From Reward Modeling to Online RLHF" paper, which presents a workflow for Online Iterative Reinforcement Learning from Human Feedback (RLHF) in an online setting and achieves impressive performance on LLM chatbot benchmarks and academic benchmarks.
Contact:ย ย sergi@earkind.com
Timestamps:
00:34 Introduction
01:34ย Google I/O 2024: Hereโs everything Google just announced
03:26ย Ilya Sutskever leaves OpenAI
04:57ย GPT-4oโs Memory Breakthrough!
06:00 Fake sponsor
07:49ย MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels
09:33ย What matters when building vision-language models?
10:54ย RLHF Workflow: From Reward Modeling to Online RLHF
13:00 Outro