105. Yannic Kilcher - A 10,000-foot view of AI

105. Yannic Kilcher - A 10,000-foot view of AI

Author: The TDS team December 1, 2021 Duration: 1:03:04

There once was a time when AI researchers could expect to read every new paper published in the field on the arXiv, but today, that’s no longer the case. The recent explosion of research activity in AI has turned keeping up to date with new developments into a full-time job.

Fortunately, people like YouTuber, ML PhD and sunglasses enthusiast Yannic Kilcher make it their business to distill ML news and papers into a digestible form for mortals like you and me to consume. I highly recommend his channel to any TDS podcast listeners who are interested in ML research — it’s a fantastic resource, and literally the way I finally managed to understand the Attention is All You Need paper back in the day.

Yannic is joined me to talk about what he’s learned from years of following, reporting and doing AI research, including the trends, the challenges and the opportunities that he expects are going to shape the course of AI history in coming years.

--- 

Intro music:

➞ Artist: Ron Gelinas

➞ Track Title: Daybreak Chill Blend (original mix)

➞ Link to Track: https://youtu.be/d8Y2sKIgFWc

--- 

Chapters:

- 0:00 Intro

- 1:20 Yannic’s path into ML

- 7:25 Selecting ML news

- 11:45 AI ethics → political discourse

- 17:30 AI alignment

- 24:15 Malicious uses

- 32:10 Impacts on persona

- 39:50 Bringing in human thought

- 46:45 Math with big numbers

- 51:05 Metrics for generalization

- 58:05 The future of AI

- 1:02:58 Wrap-up


While the active production of Towards Data Science has concluded, its archive remains a vital resource. Created by The TDS team, this collection captures a specific moment in the rapid evolution of data science and artificial intelligence. Each conversation pulls you directly into the room with leading researchers and practitioners who were shaping the tools and theories of their time. The discussions are not abstract lectures; they are grounded explorations of real-world problems, ethical dilemmas, and technical challenges that defined the field's trajectory. You'll hear experts dissect the implications of their work, from algorithmic fairness to the practicalities of deploying models at scale. This podcast served as a forum for nuanced debate, where complex ideas were unpacked with clarity and depth. Listening now offers a unique historical perspective, a chance to understand the foundational conversations that continue to influence where technology is headed next. The archive of Towards Data Science stands as a substantive record of insight, preserving the voices and questions from the forefront of a digital revolution.
Author: Language: en-us Episodes: 50

Towards Data Science
Podcast Episodes
110. Alex Turner - Will powerful AIs tend to seek power? [not-audio_url] [/not-audio_url]

Duration: 46:57
Today’s episode is somewhat special, because we’re going to be talking about what might be the first solid quantitative study of the power-seeking tendencies that we can expect advanced AI systems to have in the future.…
109. Danijar Hafner - Gaming our way to AGI [not-audio_url] [/not-audio_url]

Duration: 50:06
Until recently, AI systems have been narrow — they’ve only been able to perform the specific tasks that they were explicitly trained for. And while narrow systems are clearly useful, the holy grain of AI is to build more…
108. Last Week In AI — 2021: The (full) year in review [not-audio_url] [/not-audio_url]

Duration: 50:21
2021 has been a wild ride in many ways, but its wildest features might actually be AI-related. We’ve seen major advances in everything from language modeling to multi-modal learning, open-ended learning and even AI align…
107. Kevin Hu - Data observability and why it matters [not-audio_url] [/not-audio_url]

Duration: 49:56
Imagine for a minute that you’re running a profitable business, and that part of your sales strategy is to send the occasional mass email to people who’ve signed up to be on your mailing list. For a while, this approach…
106. Yang Gao - Sample-efficient AI [not-audio_url] [/not-audio_url]

Duration: 49:53
Historically, AI systems have been slow learners. For example, a computer vision model often needs to see tens of thousands of hand-written digits before it can tell a 1 apart from a 3. Even game-playing AIs like DeepMin…
104. Ken Stanley - AI without objectives [not-audio_url] [/not-audio_url]

Duration: 1:06:27
Today, most machine learning algorithms use the same paradigm: set an objective, and train an agent, a neural net, or a classical model to perform well against that objective. That approach has given good results: these…
102. Wendy Foster - AI ethics as a user experience challenge [not-audio_url] [/not-audio_url]

Duration: 44:36
AI ethics is often treated as a dry, abstract academic subject. It doesn’t have the kinds of consistent, unifying principles that you might expect from a quantitative discipline like computer science or physics. But some…
101. Ayanna Howard - AI and the trust problem [not-audio_url] [/not-audio_url]

Duration: 53:15
Over the last two years, the capabilities of AI systems have exploded. AlphaFold2, MuZero, CLIP, DALLE, GPT-3 and many other models have extended the reach of AI to new problem classes. There’s a lot to be excited about.…
100. Max Jaderberg - Open-ended learning at DeepMind [not-audio_url] [/not-audio_url]

Duration: 45:25
On the face of it, there’s no obvious limit to the reinforcement learning paradigm: you put an agent in an environment and reward it for taking good actions until it masters a task. And by last year, RL had achieved some…