✳flâneur — a map of the web's best reading

Nemotron 3 Ultra: what distillation can't fix

maximelabonne.substack.com · 1,354 words · saved by 1 readers

Ten specialist teachers distilled into one open 550B model

Nemotron 3 Ultra: what distillation can't fix Ten specialist teachers distilled into one open 550B model Maxime Labonne Jun 08, 2026 19 3 2 Share On June 4, 2026, Nvidia closed out its Nemotron 3 lineup with Nemotron 3 Ultra , a 550B-parameter MoE with 55B active and fully open weights. It is the most intelligent open-weight model from a US lab, but it still trails the Chinese open frontier led by Kimi K2.6. Nvidia's pitch is not the highest benchmark scores, but the highest throughput on long-running agentic workloads . Let's walk through the recipe and poke at the inference numbers behind th

Explore this link on the map →

saved by

related reading