flâneur

Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? | Rhoda AI

rhoda.ai · 6,991 words · saved by 1 readers

We investigate scaling model size and pre-training compute for video-based robot policies, and benchmark on a real industrial manipulation task.

Video pre-training has recently become a cornerstone of robot foundation models, and with it, a widely held belief: scaling web-video pre-training leads to better downstream robot task performance. This belief has not been rigorously tested. Few studies examine the effect of scaling model size and compute, instead often substituting a binary comparison against a model trained from scratch. Fewer still have stepped beyond proxy metrics and simple lab tasks to investigate scaling on complex, long-horizon tasks representative of real-world use cases. We put this belief to the test with Direct…

saved by

related reading