Frontiers | Recent advancements in multimodal human–robot interaction
Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the
Abstract Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as…
saved by
related reading
- Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
- GitHub - adam-maj/robotics: A deep dive on the history of robotics and the future of humanoidsgithub.com
- State of Robot Learning, December 2025vedder.io
- [2501.12493] ELEGNT: Expressive and Functional Movement Design for Non-anthropomorphic Robotarxiv.org
- A novel sEMG-based force interaction strategy of supernumerary robotic limbslink.springer.com
- [1912.00312] Embodiment in Socially Interactive Robotsar5iv.labs.arxiv.org
- Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensingarxiv.org
- Mixed-Initiative Dialog for Human-Robot Collaborative Manipulationarxiv.org
- Generating Robot Hands from Human Demonstrationsarxiv.org
- Empathetic Motion Generation for Humanoid Educational Robots via Reasoning-Guided Vision--Language--Motion Diffusion Architecturearxiv.org
- The state of the robotics ecosystem: The tech, use cases, and field deploymentinsightpartners.com
- RI Seminar: Jitendra Malik : Robot Learning, With Inspiration From Child Developmentyoutube.com