An Observation on Generalization - YouTube
Ilya Sutskever of OpenAI explores unsupervised learning theory. The presentation examines existing supervised learning models and contrasts them with the complexities of unsupervised learning. It proposes a novel approach using compression algorithms to address this challenge. Follow along using the transcript. Ilya Sutskever of OpenAI explores unsupervised learning theory. The presentation examines existing supervised learning models and contrasts them with the complexities of unsupervised learning. It proposes a novel approach using compression algorithms to address this challenge. Follow along using the transcript.
Ilya Sutskever (OpenAI) https://simons.berkeley.edu/talks/ilya-sutskever-openai-2023-08-14 Large Language Models and Transformers YEJIN CHOI: It has a citation count that's six digits. It's more than 139,000, and then many more. So super excited to hear what Ilya has to say about LLMs and the future. Take it away. ILYA SUTSKEVER: OK. Hi. Hi. Hi, everyone. Thank you for the introduction. When Umesh invited me to attend this event, I got really excited. I saw all the speaker list. And I thought, great, I'll go and I'll talk about something. And then I ran into a problem, which is that a lot…
saved by
related reading
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
- Just Ask for Generalization | Eric Jangevjang.com
- Compression and Intelligencegreene.sh
- [2309.10668] Language Modeling Is Compressionarxiv.org
- Deep Dive into LLMs like ChatGPTyoutube.com
- LLMs can invent their own compression - Rajan Agarwalrajan.sh
- John Schulman - Reinforcement Learning from Human Feedback: Progress and Challengesyoutube.com
- To Understand Language is to Understand Generalization | Eric Jangevjang.com
- Unsupervised Elicitationalignment.anthropic.com
- AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyartyoutube.com
- Understanding deep learning requires rethinking generalizationarxiv.org