GPT Reviews
Microsoft's investment in AI is paying off, with a 17% jump in revenue and a 20% increase in profit for the first three months of the year.
Apple has released eight small AI language models aimed at on-device use, using a "layer-wise scaling strategy" to improve performance and transparency.
Multi-Head Mixture-of-Experts is a new approach to address issues with Sparse Mixtures of Experts, outperforming existing models on three different tasks.
Stream of Search (SoS) is a new technique for teaching language models to search, resulting in improved search accuracy and the ability to solve previously unsolved problems.
Contact:ย ย sergi@earkind.com
Timestamps:
00:34 Introduction
01:28ย Microsoft Reports Rising Revenues as A.I. Investments Bear Fruit
03:14ย Apple releases eight small AI language models aimed at on-device use
05:00 Fake sponsor
07:01ย Multi-Head Mixture-of-Experts
08:43ย Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Perfect Reasoners
10:30ย Stream of Search (SoS): Learning to Search in Language
12:31 Outro