The Mismanaged Geniuses Hypothesis | Alex L. Zhang
We propose the mismanaged geniuses hypothesis, which posits that existing frontier language models are severely underutilized due to sub-optimal use of individual language model calls.
Alex Zhang, Zhening (Zed) Li, and Omar Khattab. tldr; AI models are already good enough for the next leap in capabilities. For the last decade, scaling the size and data of AI models has led to groundbreaking, super-human achievements in the capabilities of these systems. The recent success of RL and reasoning in particular implies that models can be trained to generalize on tasks we have never even solved ourselves. It is natural to believe that continuing this trend of scaling across a single neural model will be the recipe that gets us to the next jump in AI capabilities. We have an…
saved by
related reading
- RLMs are Compositional Generalizers with Alex Zhang from MITyoutube.com
- Recursive Language Models — Alex Zhang, MIT PhDyoutube.com
- alex zhang (@a1zhang) on Xx.com
- Language model harnesses are compositional generalizersalexzhang13.github.io
- Recursive Language Models | Alex L. Zhangalexzhang13.github.io
- Generalization Dynamics of LM Pre-training — Jiaxin Wenjiaxin-wen.github.io
- Language Models will be Scaffoldsalexzhang13.github.io
- Your Evals Will Break and You Won't See It Coming - Lun Wangwanglun1996.github.io
- Large Language Model: world models or surface statistics?thegradient.pub
- To Understand Language is to Understand Generalization | Eric Jangevjang.com
- Thoughts on AI in academiatheinfinitesimal.substack.com
- MIT CSAIL Explains: Recursive Language Modelsyoutube.com