Rhythm Garg on X: "Should you post-train your own model? " / X
x.com · 643 words · saved by 1 readers
https://t.co/vWjJJZFj6s
@rhythmrg: Should you post-train your own model? General frontier models, both open and closed, are improving quickly. In many cases, they are the right starting point. If you are building a 0-to-1 prototype, trying to understand a workflow, or getting water running through the pipes, you should use the strongest general model available and move fast. But for the handful of power-law use cases that are critical to your company’s mission, product, and margin, the answer is increasingly yes: you should post-train your own model. Your most important use cases are usually where your differentiat
saved by
related reading
- Reinforcement learning is an infrastructure problemmodal.com
- Training Imperativesdan.io
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- The Model Is the Wrong Thing to Ownhamzamostafa.com
- Who’s Afraid of Chinese Models? – Stratechery by Ben Thompsonstratechery.com
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- RL Pet Peeves Part 1 · Aurielaurielws.github.io
- Own the Data Loopaspiringforintelligence.substack.com
- Clouded Judgement 8.7.26 - Custom Tokenscloudedjudgement.substack.com
- Open Weights isn't Open Trainingworkshoplabs.ai
- Clouded Judgement 7.10.26 - Own Your Weightscloudedjudgement.substack.com
- How much does it cost to train frontier AI models? | Epoch AIepoch.ai