flâneur

Training as we know it will end | Vintage Data

vintagedata.org · 1,860 words · saved by 1 readers

Old data, new models

Training as we know it will end | Vintage Data Training as we know it might end Pierre-Carl Langlais, May 8, 2025 This post was originally supposed to be about synthetic data. It is finally about a vibe shift. Over the last months, there is an accumulated amount of evidence that models are changing and synthetic data is roughly at the center of it. Too many developments have suddenly challenged firmly held assumptions: the rise of tiny reasoners, the incredible data efficiency of reinforcement learning, the rapid expansion of agentified training run into entire simulated environment. All this

related reading