[2209.10788] How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability
Abstract:Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to create informative labels to learn a model in a supervised manner for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of incorporating robot velocity in the costmap prediction pipeline. We validate our method in multiple short and large-scale navigation tasks on challenging off-road terrains using two different large, all-terrain robots. Our short-scale navigation results show that using our learned costmaps leads to overall smoother navigation, and provides the robot with a more fine-grained understanding of the robot-terrain interactions. Our large-scale navigation trials show that we can reduce the number of interventions by up to 57% compared to an occupancy-based navigation baseline in challenging off-road courses ranging from 400 m to 3150 m. Appendix and full experiment videos can be found in our website: this https URL.
How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to create informative labels to learn a model in a supervised manner for these interactions. We propose a method that learns to predict traversability costmaps by combining exteroceptive environmental information with proprioceptive terrain interaction feedback in a self-supervised manner. Additionally, we propose a novel way of inc
Explore this link on the map →saved by
related reading
- roboticsproceedings.org/rss19/p103.pdfroboticsproceedings.org
- [2303.15771] TerrainNet: Visual Modeling of Complex Terrain for High-speed, Off-road Navigationarxiv.org
- [2008.05711] Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Darxiv.org
- [1811.01848] Plan Online, Learn Offline: Efficient Learning and Exploration via Model-Based Controlarxiv.org
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dresearch.nvidia.com
- When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub
- pdfopenreview.net
- State of Robot Learning, December 2025vedder.io
- A VLA with Open-World Generalizationpi.website
- Fully autonomous robots are much closer than you think – Sergey Levinedwarkesh.com
- OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Roboticsarxiv.org
- Learning Beyond Gradientstrinkle23897.github.io