Robotic scene understanding by using a dictionary

No Thumbnail Available
Authors
Yan, Fujian
Nannapaneni, Saideep
He, Hongsheng
Advisors
Issue Date
2020-01-20
Type
Conference paper
Keywords
Autonomous robots , Cognitive human-robot interaction , Robot reasoning , Semantic scene understanding
Research Projects
Organizational Units
Journal Issue
Citation
F. Yan, S. Nannapaneni and H. He, "Robotic Scene Understanding by Using a Dictionary," 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), Dali, China, 2019, pp. 895-900
Abstract

Scene understanding is a fundamental task for intelligent robots, especially in human-robot interaction. It is challenging due to the complexity of the human environment. In this paper, the proposed method integrates semantic analysis with object detection that enables robots to perceive scenes and deeply understands working environments. The model can extract deterministic entities of objects by analyzing their dictionary definitions. Therefore, robots can understand a scene at the object-level. These deterministic entities include the category, function, property, and composition of objects, and they can be used to generate feedback on how much robots can understand a scene by describing it in natural language. The feedback on how well robots understand the working space is an essential aspect to eliminate confusion during human-robot interactions. The experiment part of this paper discussed the applicability of the proposed method on robots.

Table of Contents
Description
Click on the DOI link to access the article (may not be free).
Publisher
IEEE
Journal
Book Title
Series
2019 IEEE International Conference on Robotics and Biomimetics (ROBIO);2019
PubMed ID
DOI
ISSN
EISSN