flâneur

Introducing nanocode: The best Claude Code that $200 can buy. · salmanmohammadi/nanocode · Discussion #1

github.com · 4,601 words · saved by 1 readers

I'm so excited to share nanocode. This is a library showing you how to train your own Claude Code end-to-end. To a first approximation, we will follow the simplest possible approach for training us...

I'm so excited to share nanocode. This is a library showing you how to speedrun your own Claude Code end-to-end: from pretraining, to SFT, and RLHF using DPO. To a first approximation, we will follow the simplest possible approach for training using Constitutional AI - the approach used by Anthropic to train their Claude models. We'll write our own SOUL.md, define the agentic interface which our model will use to interact with the world, generate synthetic data, and use preference optimisation to align the model with our SOUL. nanocode is written entirely in JAX and designed to be trained…

saved by

related reading