Building Information-rich Maps for Intuitive Human Interface Using Networked Knowledge Base

Despite significant advances in multimedia transferring technologies in various fields of robotics, it is sometimes quite difficult for the operator to fully understand the context of 3D remote environments from 2D image feedback. Particularly, in the remote control of mobile robots, the recognition of the object associated with the task is very important, because the operator has to control the robot safely in various situations not through trial and error. Therefore, it is necessary to provide the operator with 3D volumetric models of the object and object-related information as well such as locations, shape, size, material properties, and so on. Thus, in this paper, we propose a vision-based human interface system that provides an interactive, information-rich map through network-based information brokering. The system consists of an object recognition part, a 3D map building part, a networked knowledge base part, and a control part of the mobile robot.