1X World Model | From Video to Action: A New Way Robots Learn

Home robots need common sense behavior and a deep understanding of the physical world.

Home robots need common sense behavior and a deep understanding of the physical world. Many robot foundation models today are vision-language-action models (VLAs), which take a pretrained VLM and add an output head to predict robot actions (PI0.6, Helix, Groot N1.5). VLMs benefit from internet-scale knowledge, but are trained on objectives that emphasize visual and semantic understanding over prediction of physical dynamics. Tens of thousands of hours of costly robot data are needed to teach a model how to solve tasks considered simple for a human. Additionally, auxiliary objectives are…

saved by

• Shiza Charania

related reading

• Anirudha Majumdar (@Majumdar_Ani) on Xx.com
• Causal Video Models Are Data-Efficient Robot Policy Learners | Rhoda AIrhoda.ai
• The First Fully General Computer Action Model | blogsi.inc
• Pretrained to Imagine, Fine-Tuned to Act: The Rise of World-Action Models | NVIDIA Technical Blogdeveloper.nvidia.com
• Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
• Generalist - GEN-0 / Embodied Foundation Models That Scale with Physical Interactiongeneralistai.com
• World Models | Rohit Bandarurohitbandaru.github.io
• General Instinct | Any frontier model. Any edge device.general-instinct.com
• Learning Robot World Models from Autonomous Playrobot-playworld.github.io
• Dexterous Robotic Foundation Modelsyoutube.com
• The Model That Dreams the Worldmoe-capital.com
• [2506.09985] V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningarxiv.org