Some Changes at The Gradient

Some Changes at The Gradient

Author: Daniel Bashir November 21, 2024 Duration: 34:25

Hi everyone!

If you’re a new subscriber or listener, welcome.

If you’re not new, you’ve probably noticed that things have slowed down from us a bit recently. Hugh Zhang, Andrey Kurenkov and I sat down to recap some of The Gradient’s history, where we are now, and how things will look going forward.

To summarize and give some context:

The Gradient has been around for around 6 years now – we began as an online magazine, and began producing our own newsletter and podcast about 4 years ago. With a team of volunteers — we take in a bit of money through Substack that we use for subscriptions to tools we need and try to pay ourselves a bit — we’ve been able to keep this going for quite some time.

Our team has less bandwidth than we’d like right now (and I’ll admit that at least some of us are running on fumes…) — we’ll be making a few changes:

* Magazine: We’re going to be scaling down our editing work on the magazine. While we won’t be accepting pitches for unwritten drafts for now, if you have a full piece that you’d like to pitch to us, we’ll consider posting it. If you’ve reached out about writing and haven’t heard from us, we’re really sorry. We’ve tried a few different arrangements to manage the pipeline of articles we have, but it’s been difficult to make it work. We still want this to be a place to promote good work and writing from the ML community, so we intend to continue using this Substack for that purpose. If we have more editing bandwidth on our team in the future, we want to continue doing that work.

* Newsletter: We’ll aim to continue the newsletter as before, but with a “Best from the Community” section highlighting posts. We’ll have a way for you to send articles you want to be featured, but for now you can reach us at our editor@thegradient.pub.

* Podcast: I’ll be continuing this (at a slower pace), but eventually transition it away from The Gradient given the expanded range. If you’re interested in following, it might be worth subscribing on another player like Apple Podcasts, Spotify, or using the RSS feed.

* Sigmoid Social: We’ll keep this alive as long as there’s financial support for it.

If you like what we do and/or want to help us out in any way, do reach out to editor@thegradient.pub. We love hearing from you.

Timestamps

* (0:00) Intro

* (01:55) How The Gradient began

* (03:23) Changes and announcements

* (10:10) More Gradient history! On our involvement, favorite articles, and some plugs

Some of our favorite articles!

There are so many, so this is very much a non-exhaustive list:

* NLP’s ImageNet moment has arrived

* The State of Machine Learning Frameworks in 2019

* Why transformative artificial intelligence is really, really hard to achieve

* An Introduction to AI Story Generation

* The Artificiality of Alignment (I didn’t mention this one in the episode, but it should be here)

Places you can find us!

Hugh:

* Twitter

* Personal site

* Papers/things mentioned!

* A Careful Examination of LLM Performance on Grade School Arithmetic (GSM1k)

* Planning in Natural Language Improves LLM Search for Code Generation

* Humanity’s Last Exam

Andrey:

* Twitter

* Personal site

* Last Week in AI Podcast

Daniel:

* Twitter

* Substack blog

* Personal site (under construction)



Get full access to The Gradient at thegradientpub.substack.com/subscribe

Hosted by Daniel Bashir, The Gradient: Perspectives on AI moves beyond surface-level headlines to explore the intricate machinery and human ideas shaping artificial intelligence. Each episode is built on a foundation of deep research, leading to conversations that are both technically substantive and broadly accessible. You'll hear from researchers, engineers, and philosophers who are actively building and critiquing our technological future, discussing not just how AI systems work, but the larger implications of their integration into society. This isn't about speculative hype; it's a grounded examination of real progress, persistent challenges, and ethical considerations from those on the front lines. The discussions peel back layers on topics like model architecture, policy, and the fundamental science behind the algorithms becoming part of our daily lives. For anyone curious about the substance behind the buzz-whether you have a technical background or are simply keen to understand a defining technology of our age-this podcast offers a crucial and thoughtful resource. Tune in for a consistently detailed and nuanced take that treats artificial intelligence with the complexity it deserves.
Author: Language: English Episodes: 100

The Gradient: Perspectives on AI
Podcast Episodes
L.M. Sacasas: The Questions Concerning Technology [not-audio_url] [/not-audio_url]

Duration: 1:47:20
Episode 135I spoke with L. M. Sacasas about:* His writing and intellectual influences* The value of asking hard questions about technology and our relationship to it* What happens when we decide to outsource skills and c…
Pete Wolfendale: The Revenge of Reason [not-audio_url] [/not-audio_url]

Duration: 2:52:57
Episode 134I spoke with Pete Wolfendale about:* The flaws in longtermist thinking* Selections from his new book, The Revenge of Reason* Metaphysics* What philosophy has to say about reason and AIEnjoy—and let me know wha…
Peter Lee: Computing Theory and Practice, and GPT-4's Impact [not-audio_url] [/not-audio_url]

Duration: 1:01:48
Episode 133I spoke with Peter Lee about:* His early work on compiler generation, metacircularity, and type theory* Paradoxical problems* GPT-4s impact, Microsoft’s “Sparks of AGI” paper, and responses and criticismEnjoy—…
Manuel & Lenore Blum: The Conscious Turing Machine [not-audio_url] [/not-audio_url]

Duration: 2:23:04
Episode 132I spoke with Manuel and Lenore Blum about:* Their early influences and mentors* The Conscious Turing Machine and what theoretical computer science can tell us about consciousnessEnjoy—and let me know what you…
Kevin Dorst: Against Irrationalist Narratives [not-audio_url] [/not-audio_url]

Duration: 2:15:21
Episode 131I spoke with Professor Kevin Dorst about:* Subjective Bayesianism and epistemology foundations* What happens when you’re uncertain about your evidence* Why it’s rational for people to polarize on political mat…
David Pfau: Manifold Factorization and AI for Science [not-audio_url] [/not-audio_url]

Duration: 2:00:52
Episode 130I spoke with David Pfau about:* Spectral learning and ML* Learning to disentangle manifolds and (projective) representation theory* Deep learning for computational quantum mechanics* Picking and pursuing resea…
Sergiy Nesterenko: Automating Circuit Board Design [not-audio_url] [/not-audio_url]

Duration: 1:03:35
Episode 128I spoke with Sergiy Nesterenko about:* Developing an automated system for designing PCBs* Difficulties in human and automated PCB design* Building a startup at the intersection of different areas of expertiseB…
C. Thi Nguyen: Values, Legibility, and Gamification [not-audio_url] [/not-audio_url]

Duration: 1:30:13
Episode 127I spoke with Christopher Thi Nguyen about:* How we lose control of our values* The tradeoffs of legibility, aggregation, and simplification* Gamification and its risksEnjoy—and let me know what you think!C. Th…