Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation

This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions. HTML conversions sometimes display errors due to content that did not convert correctly from the source. This paper uses the following packages that are not yet supported by the HTML conversion tool. Feedback on these issues are not necessary; they are known and are being worked on. Authors: achieve the best HTML results from your LaTeX submissions by following these best practices. Effective robotic systems for long-horizon human-robot collaboration must adapt to a wide range of human partners, whose physical behavior, willingness to assist, and understanding of the robot’s capabilities may change over time. This demands a tightly coupled communication loop that grants both agents the flexibility to propose, accept, or decline requests as they coordinat

Mixed-Initiative Dialog for Human-Robot Collaborative Manipulation Albert Yu &Chengshu Li &Luca Macesanu &Arnav Balaji &Ruchira Ray &Ray Mooney &Roberto Martín-Martín Albert Yu 1 , Chengshu Li 2 , Luca Macesanu 1 , Arnav Balaji 1 , Ruchira Ray 1 , Raymond Mooney 1 , and Roberto Martín-Martín 1 1 UT Austin, 2 Stanford albertyu@utexas.edu Abstract Effective robotic systems for long-horizon human-robot collaboration must adapt to a wide range of human partners, whose physical behavior, willingness to assist, and understanding of the robot’s capabilities may change over time. This demands a tightl

related reading

• Interaction Models: A Scalable Approach to Human-AI Collaboration - Thinking Machines Labthinkingmachines.ai
• Yell At Your Robot \emojishout Improving On-the-Fly from Language Correctionsarxiv.org
• Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
• [2301.02555] “No, to the Right” – Online Language Corrections for Robotic Manipulation via Shared Autonomyar5iv.labs.arxiv.org
• Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?arxiv.org
• Continual Skill and Task Learning via Dialoguearxiv.org
• A Unified Model for Motion-Conditioned Robot Co-designtransformer-transformer.github.io
• RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiesarxiv.org
• How Claude Performs on Robotics Tasks \ Anthropicanthropic.com
• A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationtoyotaresearchinstitute.github.io
• Theory of Mind for Multi-Agent Collaboration via Large Language Modelsarxiv.org
• [2204.05186] Correcting Robot Plans with Natural Language Feedbackar5iv.labs.arxiv.org