Journal of the HCI Society of Korea (한국HCI학회논문지)

The HCI Society of Korea (한국HCI학회)
권호 표지

Using Spatial Ontology in the Semantic Integration of Multimodal Object Manipulation in Virtual Reality

  • Irawati, Sylvia (Graduate research student in Human Computer Interaction and Robotics Department at University of Science and Technology in collaboration with Korea Institute of Science and Technology) ;
  • Calderon, Daniela (Graduate research student in Human Computer Interaction and Robotics Department at University of Science and Technology in collaboration with Korea Institute of Science and Technology) ;
  • Ko, Hee-Dong (Head of Human Computer Interaction and Robotics Department in University of Science and Technology and Principal Researcher of Imaging Media Research Center in Korea Institute of Science and Technology)
  • Published : 2006.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper describes a framework for multimodal object manipulation in virtual environments. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. These commands are used to reposition the objects in the virtual environments. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment as it will be in the real world.

Keywords