flâneur

[Jan 7 2026] nanochat miniseries v1 · karpathy/nanochat · Discussion #420

github.com · 2,859 words · saved by 2 readers

Why miniseries. The correct way to think about LLMs is that you are not optimizing for a single specific model but for a family models controlled by a single dial (the compute you wish to spend) to...

Why miniseries. The correct way to think about LLMs is that you are not optimizing for a single specific model but for a family models controlled by a single dial (the compute you wish to spend) to achieve monotonically better results. This allows you to do careful science of scaling laws and ultimately this is what gives you the confidence that when you pay for "the big run", the extrapolation will work and your money will be well spent. For the first public release of nanochat my focus was on end-to-end pipeline that runs the whole LLM pipeline with all of its stages. Now, I'm coming back…

saved by

related reading