[2409.05864] Neural MP: A Generalist Neural Motion Planner
The current paradigm for motion planning generates solutions from scratch for every new problem, which consumes significant amounts of time and computational resources. For complex, cluttered scenes, motion planning approaches can often take minutes to produce a solution, while humans are able to accurately and safely reach any goal in seconds by leveraging their prior experience. We seek to do the same by applying data-driven learning at scale to the problem of motion planning. Our approach builds a large number of complex scenes in simulation, collects expert data from a motion planner, then distills it into a reactive generalist policy. We then combine this with lightweight optimization to obtain a safe path for real world deployment. We perform a thorough evaluation of our method on 64 motion planning tasks across four diverse environments with randomized poses, scenes and obstacles, in the real world, demonstrating an improvement of 23%, 17% and 79% motion planning success rate over state of the art sampling, optimization and learning based planning methods. Video results available at mihdalal.github.io/neuralmotionplanner
View PDF HTML (experimental) Abstract:The current paradigm for motion planning generates solutions from scratch for every new problem, which consumes significant amounts of time and computational resources. For complex, cluttered scenes, motion planning approaches can often take minutes to produce a solution, while humans are able to accurately and safely reach any goal in seconds by leveraging their prior experience. We seek to do the same by applying data-driven learning at scale to the problem of motion planning. Our approach builds a large number of complex scenes in simulation,…
saved by
related reading
- [2509.05397] RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learningarxiv.org
- Diffusion Policy: Visuomotor Policy Learning via Action Diffusiondiffusion-policy.cs.columbia.edu
- GEN-1.5: Embodied Foundation Models are One-Shot Learners - Generalist AIgeneralistai.com
- Introducing Reinforced Planning (RP-1)pantheon.inc
- [2210.08408] Learning-based Motion Planning in Dynamic Environments Using GNNs and Temporal Encodingar5iv.labs.arxiv.org
- Causal Video Models Are Data-Efficient Robot Policy Learners | Rhoda AIrhoda.ai
- Generalist - GEN-0 / Embodied Foundation Models That Scale with Physical Interactiongeneralistai.com
- Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningarxiv.org
- [2506.09985] V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningarxiv.org
- Video Language Planningvideo-language-planning.github.io
- Frontier of General-Purpose Robotics (2025)adampatni.com
- Generalist - GEN-1: Scaling Embodied Foundation Models to Masterygeneralistai.com