Meta's Stock Plunge ๐Ÿ’ธ // TSMC's A16 Process ๐Ÿš€ // Instruction Hierarchy Boosting LLMs ๐Ÿ“ˆ

Meta's Stock Plunge ๐Ÿ’ธ // TSMC's A16 Process ๐Ÿš€ // Instruction Hierarchy Boosting LLMs ๐Ÿ“ˆ

Author: Earkind April 25, 2024 Duration: 13:20

Meta's aggressive AI investments have caused a 13% plunge in their stock, threatening to wipe out almost $163 billion from their market value.

TSMC's new A16 manufacturing process promises to outperform its predecessor, N2P, by a significant margin, with an up to 10% higher clock rate at the same voltage and a 15% - 20% lower power consumption at the same frequency and complexity.

The Instruction Hierarchy proposes a data generation method to demonstrate hierarchical instruction following behavior, which drastically increases robustness for LLMs against attacks.

SPLATE is a lightweight adaptation of the ColBERTv2 model that improves the efficiency of late interaction retrieval, particularly for running ColBERT on CPU environments.

Contact:ย ย sergi@earkind.com

Timestamps:

00:34 Introduction

01:27ย Metaโ€™s stock plunges on โ€˜aggressiveโ€™ AI spending plans

02:49ย TSMC unveils 1.6nm process technology with backside power delivery, rivals Intel's competing design

04:48ย tiny-gpu

05:59 Fake sponsor

07:35ย The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

08:43ย A Reproducibility Study of PLAID

10:18ย SPLATE: Sparse Late Interaction Retrieval

12:00 Outro


Each morning, GPT Reviews serves up a fresh, slightly chaotic conversation about everything happening in artificial intelligence. This daily podcast from Earkind is actually crafted by AI, offering a unique blend of the latest headlines, major announcements, and intriguing research plucked from sources like arXiv. But itโ€™s far from a dry briefing. The dynamic comes from its four distinct hosts: Giovani Pete Tizzano brings relentless optimism as an AI enthusiast, while Robert, the analyst, provides a grounded and often skeptical counterpoint. Olivia, whoโ€™s deeply embedded in online communities, shares the buzz and broader reactions, and Belinda, the witty research expert, helps unpack the technical details with clarity and a sharp sense of humor. Tuning in feels like dropping into a lively roundtable where complex ideas are debated, explained, and occasionally laughed about. Youโ€™ll get a comprehensive yet digestible overview of the AI landscape, all wrapped in a format thatโ€™s as entertaining as it is informative. The result is a consistently engaging listen that keeps you updated without feeling like homework, making it a standout in the daily news podcast space.
Author: Language: English Episodes: 100

GPT Reviews
Podcast Episodes