flâneur

The Mismanaged Geniuses Hypothesis | Alex L. Zhang

alexzhang13.github.io · 1,583 words · saved by 3 readers

We propose the mismanaged geniuses hypothesis, which posits that existing frontier language models are severely underutilized due to sub-optimal use of individual language model calls.

Alex Zhang, Zhening (Zed) Li, and Omar Khattab. tldr; AI models are already good enough for the next leap in capabilities. For the last decade, scaling the size and data of AI models has led to groundbreaking, super-human achievements in the capabilities of these systems. The recent success of RL and reasoning in particular implies that models can be trained to generalize on tasks we have never even solved ourselves. It is natural to believe that continuing this trend of scaling across a single neural model will be the recipe that gets us to the next jump in AI capabilities. We have an…

saved by

related reading