[2209.10788] How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability
Abstract:Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to create informative labels to learn a model in a supervised manner for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of incorporating robot velocity in the costmap prediction pipeline. We validate our method in multiple short and large-scale navigation tasks on challenging off-road terrains using two different large, all-terrain robots. Our short-scale navigation results show that using our learned costmaps leads to overall smoother navigation, and provides the robot with a more fine-grained understanding of the robot-terrain interactions. Our large-scale navigation trials show that we can reduce the number of interventions by up to 57% compared to an occupancy-based navigation baseline in challenging off-road courses ranging from 400 m to 3150 m. Appendix and full experiment videos can be found in our website: this https URL.
How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to create informative labels to learn a model in a supervised manner for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of inc
saved by
related reading
- roboticsproceedings.org/rss19/p103.pdfroboticsproceedings.org
- [2303.15771] TerrainNet: Visual Modeling of Complex Terrain for High-speed, Off-road Navigationarxiv.org
- ProNav: Proprioceptive Traversability Estimation for Legged Robot Navigation in Outdoor Environmentsarxiv.org
- [2506.09985] V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningarxiv.org
- A Unified Model for Motion-Conditioned Robot Co-designtransformer-transformer.github.io
- [2109.01115] Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationarxiv.org
- [2204.05186] Correcting Robot Plans with Natural Language Feedbackar5iv.labs.arxiv.org
- Differentiable Robot Renderingdrrobot.cs.columbia.edu
- [2503.24278] AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldarxiv.org
- [2509.05397] RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learningarxiv.org
- [2603.08546] Interactive World Simulator for Robot Policy Training and Evaluationarxiv.org
- Reward Isn’t Free: Supervising Robot Learning with Language and Video from the Web | SAIL Blogai.stanford.edu