Updating Robot Safety Representations Online from Natural Language Feedback ∗ Equal Contribution. † Equal Advising. 1School of Engineering, Federal University of Minas Gerais, Brazil. Email: leohmcs@ufmg.br. Work done during Robotics Institute Summer Scholars (RISS) Program at Carnegie Mellon University. 2Electrical and Computer Engineering, University of Rochester. Email: zli133@u.rochester.edu. 3Department of Cognitive Robotics, Delft University of Technology. Email: l.peters@tudelft.nl. 4Electrical and Computer Engineering, University of Southern California. Email: somilban@usc.edu. 5Robotics Institute, Carnegie Mellon University. Email: abajcsy@cmu.edu

This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions.

Updating Robot Safety Representations Online from Natural Language Feedback † † thanks: ∗ Equal Contribution. † Equal Advising. † † thanks: 1 School of Engineering, Federal University of Minas Gerais, Brazil. Email: leohmcs@ufmg.br . Work done during Robotics Institute Summer Scholars (RISS) Program at Carnegie Mellon University. 2 Electrical and Computer Engineering, University of Rochester. Email: zli133@u.rochester.edu . 3 Department of Cognitive Robotics, Delft University of Technology. Email: l.peters@tudelft.nl . 4 Electrical and Computer Engineering, University of Southern California. E

related reading

• Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
• [2204.05186] Correcting Robot Plans with Natural Language Feedbackar5iv.labs.arxiv.org
• [2109.01115] Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationarxiv.org
• Yell At Your Robot \emojishout Improving On-the-Fly from Language Correctionsarxiv.org
• [2301.02555] “No, to the Right” – Online Language Corrections for Robotic Manipulation via Shared Autonomyar5iv.labs.arxiv.org
• Reward Isn’t Free: Supervising Robot Learning with Language and Video from the Web | SAIL Blogai.stanford.edu
• Robotic Task Ambiguity Resolution via Natural Language Interactionarxiv.org
• [2310.17555] Interactive Robot Learning from Verbal Correctionar5iv.labs.arxiv.org
• [2602.10556] LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transferarxiv.org
• Trajectory Improvement and Reward Learning from Comparative Language Feedbackarxiv.org
• A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationtoyotaresearchinstitute.github.io
• Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationarxiv.org