Pretraining at scale without a pretraining team — Mirendil

Mirendil-Base: a competitive coding model pretrained by one researcher, working with agents, in 3.5 months with less than $10M in compute.

saved by

• Elizabeth Qiu
• Ishan Mukherjee
• Ishaan Panigrahi
• Miguel Villa Floran