• Journal of the HCI Society of Korea
• /
• v.6 no.1
• /
• pp.1-8
• /
• 2011

As virtual realty has become an issue of providing immersive services, in the area of virtual realty, it has been actively investigated to develop user interfaces for immersive interaction. In this paper, we propose a gesture recognition based immersive user interface by using an IR LED embedded helmet and data gloves in order to reflect the user's movements to the virtual reality environments effectively. The system recognizes the user's head movements by using the IR LED embedded helmet and IR signal transmitter, and the hand gestures with the data gathered from data gloves. In case of hand gestures recognition, it is difficult to recognize accurately with the general recognition model because there are various hand gestures since human hands consist of many articulations and users have different hand sizes and hand movements. In this paper, we applied the Mixture-of-Experts based gesture recognition for various hand gestures of multiple users accurately. The movement of the user's head is used to change the perspection in the virtual environment matching to the movement in the real world, and the gesture of the user's hand can be used as inputs in the virtual environment. A head mounted display (HMD) can be used with the proposed system to make the user absorbed in the virtual environment. In order to evaluate the usefulness of the proposed interface, we developed an interface for the virtual orchestra environment. The experiment verified that the user can use the system easily and intuituvely with being entertained.

• Journal of Digital Convergence
• /
• v.16 no.9
• /
• pp.413-419
• /
• 2018

Nowadays, smart phone became an important part of communication media and integrated into people's life. If callers rely on helmet-mounted display(HMD) augmented reality technique to add two-way user's facial expression, appearance, actions during the calling process, it will let callers have a visualized fantastic sensual experience. And through that method can break the limitations of vision, so research that technical problem can promote the development of visual arts, that is meaningful. This paper will choose and composite several existed technologies to set up two hypothesis, try to realize AR video calling. Through comparison and analysis to find those two hypothesis' problem, and create design solutions to solve problems. And use case study method to present two cases for prove my paper's result that is those two hypothesis can be realize in future. Use those technologies can bring more convenience and enjoyment to people's life. It can be predicted that AR video calling process can be successfully realized and will have unlimited development in future.