So You Think You Can Scale Up Autonomous Robot Data Collection?
This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions.
So You Think You Can Scale Up Autonomous Robot Data Collection? Abstract A long-standing goal in robot learning is to develop methods for robots to acquire new skills autonomously. While reinforcement learning (RL) comes with the promise of enabling autonomous data collection, it remains challenging to scale in the real-world partly due to the significant effort required for environment design and instrumentation, including the need for designing reset functions or accurate success detectors. On the other hand, imitation learning (IL) methods require little to no environment design effort, but
related reading
- State of Robot Learning, December 2025vedder.io
- Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
- Reward Isn’t Free: Supervising Robot Learning with Language and Video from the Web | SAIL Blogai.stanford.edu
- [2103.06326] S4RL: Surprisingly Simple Self-Supervision for Offline Reinforcement Learningarxiv.org
- Emergent Dexterity via Diverse Resets and Large-Scale Reinforcement Learningarxiv.org
- [2503.24278] AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldarxiv.org
- Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? | Rhoda AIrhoda.ai
- How Can We Make Robotics More like Generative Modeling? | Eric Jangevjang.com
- Open X-Embodiment: Robotic Learning Datasets and RT-X Modelsarxiv.org
- Reinforcement Learning via Implicit Imitation Guidancearxiv.org
- Imitation Bootstrapped Reinforcement Learningarxiv.org
- RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiesarxiv.org