Continual Skill and Task Learning via Dialogue

This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions.

Continual Skill and Task Learning via Dialogue Weiwei Gu Arizona State University weiweigu@asu.edu &Suresh Kondepudi Arizona State University nkondepu@asu.edu \AND Lixiao Huang Arizona State University lixiao.huang@asu.edu &Nakul Gopalan Arizona State University ng@asu.edu Abstract Continual and interactive robot learning is a challenging problem as the robot is present with human users who expect the robot to learn novel skills to solve novel tasks perpetually with sample efficiency. In this work we present a framework for robots to query and learn visuo-motor robot skills and task relevant i

related reading

• Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
• [2109.01115] Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationarxiv.org
• Learning Novel Skills from Language-Generated Demonstrationsarxiv.org
• [2310.17555] Interactive Robot Learning from Verbal Correctionar5iv.labs.arxiv.org
• Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationarxiv.org
• Self-Distillation Enables Continual Learningarxiv.org
• [2201.07207] Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentsarxiv.org
• [2602.10556] LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transferarxiv.org
• [2301.02555] “No, to the Right” – Online Language Corrections for Robotic Manipulation via Shared Autonomyar5iv.labs.arxiv.org
• RT-2: Vision-Language-Action Modelsrobotics-transformer2.github.io
• Language Models can Solve Computer Tasksarxiv.org
• Reward Isn’t Free: Supervising Robot Learning with Language and Video from the Web | SAIL Blogai.stanford.edu