Special Topics in Kernels, RL, Reward Hacking in Agents — Daniel Han, Unsloth - YouTube
An advanced seminar (good prerequisites: Daniel's 2024 and 2025 hit AIE workshops, but all are welcome!)PLS WATCH: https://www.youtube.com/@aiDotEngineer/sea...
An advanced seminar (good prerequisites: Daniel's 2024 and 2025 hit AIE workshops, but all are welcome!) PLS WATCH: https://www.youtube.com/@aiDotEngineer/search?query=daniel%20han Timestamps: 0:00 Introduction to Unsloth and model distribution 2:32 The State of AI: Meter plots and performance trends 20:26 Open Source vs. Closed Source models 38:51 Throughput maxing and accuracy minimizing 1:03:00 Benchmarking and cheating in AI 1:37:49 Kernels and algorithmic improvements 2:04:16 Reinforcement learning primer 2:05:19 Reward hacking and AI agents Viral Quotes & Pull Quotes: "If you make…
saved by
related reading
- Recursive Language Models — Alex Zhang, MIT PhDyoutube.com
- Why Inference Matters 12x More Than Training | YC Paper Clubyoutube.com
- AI researchers talk continual learning over a game of HORSEyoutube.com
- AI researchers debate how close we are to recursive self-improvementyoutube.com
- Stanford CS25: Transformers United V6 I Serving Transformers: Lessons from the Trenchesyoutube.com
- Why Sam Altman is against a single superintelligenceyoutube.com
- Why Frontier AI Labs Fight to Hide Chain of Thought — Ilia Shumailov & Alexander Panfilovyoutube.com
- What's New in Inference Engineering — Philip Kiely, Basetenyoutube.com
- How AI is Changing Programmingyoutube.com
- How trillion-parameter AI models work and how to serve themyoutube.com
- Stanford CS25: Transformers United V6 I From Representation Learning to World Modelingyoutube.com
- RLHF & Post-Training Course by Nathan Lambertrlhfbook.com