Common reality: An interface of human-robot communication and mutual understanding

No Thumbnail Available
Issue Date
2021-11-02
Authors
Yan, Fujian
Namboodiri, Vinod
He, Hongsheng
Advisor
Citation

Yan F., Namboodiri V., He H. (2021) Common Reality: An Interface of Human-Robot Communication and Mutual Understanding. In: Li H. et al. (eds) Social Robotics. ICSR 2021. Lecture Notes in Computer Science, vol 13086. Springer, Cham. https://doi.org/10.1007/978-3-030-90525-5_27

Abstract

An interface that can share effective and comprehensive mutual understanding is critical for human-robot interaction. This paper designs a novel human-robot interaction interface that enables humans and robots to interact by their shared mutual understanding of the context. The interface superimposes robot-centered reality and human-centered reality on the working space to construct a mutual understanding environment. The common-reality interface enables humans to communicate with robots through speech and immersive touching. The mutual understanding is constructed by the user’s commands, localization of objects, recognition of objects, object semantics, and augmented trajectories. The user’s vocal commands are interpreted to formal logic, and finger touching is detected and represented by coordinates. Real-world experiments have been done to show the effectiveness of the proposed interface.

Table of Content
Description
Click on the DOI link to access the conference paper (may not be free).
publication.page.dc.relation.uri