What if RL Environments Aren't Mispriced?
In my last blog post, I laid out an argument for why startup founders should not try to build a business around selling RL gyms to AI labs. One of the reasons basically amounted to: this is a bubble, the prices being paid for these things make no sense, and this apparent labor "arbitrage" cannot last. In this post, I want to consider the reverse: what if the hype and seemingly endless cash surrounding RL environments (which are, at bottom, sparkling data annotation) is completely rational? The impetus for writing my last post was a gut feeling more than anything. A feeling that the amount of cash sloshing around the AI ecosystem, especially for producing mediocre-quality training data, is... off. If you asked me to support this feeling with an argument, I would tell you to read my previous blog post, but if you didn't want to do that, one argument would go something like this: I think (1) is just obviously true. If you are building software for AIs to play with, it doesn't need to be s
--> What if RL Environments Aren't Mispriced? What if RL Environments Aren't Mispriced? The future of work nobody asked for Posted Sep 25, 2025 by Benjamin Anderson In my last blog post, I laid out an argument for why startup founders should not try to build a business around selling RL gyms to AI labs. One of the reasons basically amounted to: this is a bubble, the prices being paid for these things make no sense, and this apparent labor "arbitrage" cannot last. In this post, I want to consider the reverse: what if the hype and seemingly endless cash surrounding RL environments (which are, at
Explore this link on the map →saved by
related reading
- Cheap RL tasks will waste compute | Mechanize, Inc.mechanize.work
- The Bitter Lesson - RL Environments Versionseancai.com
- Don't Build an RL Environment Startupbenanderson.work
- A World of Verifiable Domainsseancai.com
- RL Environments and RL for Science: Data Foundries and Multi-Agent Architecturesnewsletter.semianalysis.com
- Trust me bro, just one more RL scale up, this one will be the real scale up with the good environments, the actually legit one, trust me bro — AI Alignment Forumalignmentforum.org
- State of Data (Jan 2026)seancai.com
- Akash Bajwa on X: "RL Environments with Scale AI" / Xx.com
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- Pavlov's List: A List of RL Environment Startupspavlovslist.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- AI Is Slowing Downwheresyoured.at