• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.685-686
• /
• 2006

Recently, various AR-based product design methodologies have been introduced. In this paper, we propose technologies for enhancing robust augmentation and immersive realization of virtual objects. A robust augmentation technology is developed for various lighting conditions and a partial solution is proposed for the hand occlusion problem that occurs when the virtual objects overlay the user' hands. It provides more immersive or natural images to the users. Finally, vibratory haptic cues by page motors as well as button clicking force feedback by modulating pneumatic pressures are proposed while interacting with virtual widgets. Also our system reduces gabs between modeling spaces and user spaces. An immersive game-phone model is selected to demonstrate that the users can control the direction of the car in the racing game by tilting a tangible object with the proposed augmented haptic and robust non-occluded visual feedback. The proposed methodologies will be contributed to the immersive realization of the conventional AR system.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.8
• /
• pp.815-821
• /
• 2014

In this paper, we propose a novel CALL (Computer-Assisted Language Learning) system, which is called POMY (POSTECH Immersive English Study). In our system, students can study English while talking to characters in a computer-generated virtual environment. POMY also supports haptic feedback, so students can study English in a more interesting manner. Haptic feedback is provided by two platforms, a haptic chair and a force-feedback device. The haptic chair, which is equipped with an array of vibrotactile actuators, delivers directional information to the student. The force-feedback device enables the student to feel the physical properties of an object. These haptic systems help the student better understand English conversations and focus on studying. We conducted a user experiment and its results showed that our haptic-enabled English study contributes to better learning of English.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.420-430
• /
• 2003

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.25 no.6
• /
• pp.12-16
• /
• 2002

Virtual reality (VR) opened the possibility of moving beyond the 2-D world of conventional desktop systems to an immersive, multi-sensory environment generated by computer graphics. Haptic feedback (Haptics) is now starting to get recognition and use in intensive applications for manipulation, while smell and taste feedback are at the stage of early research. This paper reviews some current works on increased haptic feedback augmentation in virtual reality applications.

• The Journal of the Korea Contents Association
• /
• v.10 no.8
• /
• pp.1-10
• /
• 2010

For virtual education, the multimodal learning environment with haptic feedback, termed 'immersive textbook', is necessary to enhance the learning effectiveness. However, the learning contents for immersive textbook are not widely available due to the constraints in creation and playback environments. To address this problem, we propose a framework for producing and displaying the multimodal contents for immersive textbook. Our framework provides an XML-based meta-language to produce the multimodal learning contents in the form of intuitive script. Thus it can help the user, without any prior knowledge of multimodal interactions, produce his or her own learning contents. The contents are then interpreted by script engine and delivered to the user by visual and haptic rendering loops. Also we implemented a prototype based on the aforementioned proposals and performed user evaluation to verify the validity of our framework.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.203-213
• /
• 2009

Medicine is one of great application fields where Virtual Reality (VR) technologies have been successfully utilized. The VR technologies in medicine bring together an interdisciplinary community of computer scientists and engineers, physicians and surgeon, medical educator and students, military medical specialists, and biomedical futurists. The primary feedback of a VR system has been visual feedback. The complex geometry for graphic objects and utilizing hardware acceleration can be incorporated with in order to produce realistic virtual environments. To enhance human-computer interaction (HCI), in term of immersive experiences perceived by users, haptic, speech, olfactory and other non-traditional interfaces should also be exploited. Among those, hapic feedback has been tightly coupled with visual feedback. The combination of the two sensory feedbacks can give users more immersive, realistic and perceptive VR environments. Haptic feedback has been studied over decades and many haptic based VR systems have been developed. This paper focuses on haptic feedback in term of its medical usages. It presents a survey of haptic feedback techniques with their applications in medicine.

• The Journal of Korea Robotics Society
• /
• v.3 no.2
• /
• pp.137-145
• /
• 2008

We present the initial results of on-going research for building a novel Mobile Haptic Interface (MHI) that can provide an unlimited haptic workspace in large immersive virtual environments. When a user explores a large virtual environment, the MHI can sense the position and orientation of the user, place itself to an appropriate configuration, and deliver force feedback, thereby enabling a virtually limitless workspace. Our MHI (PoMHI v0.5) features with omnidirectional mobility, a collision-free motion planning algorithm, and force feedback for general environment models. We also provide experimental results that show the fidelity of our mobile haptic interface.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.1-5
• /
• 2009

In this paper, we develop a haptic mouse system for immersive human computer interaction. The proposed haptic mouse system can provide vibrotactile feedback as well as thermal feedback for realistic virtual experience. For vibrotactile and thermal feedback, we use eccentric motors, a solenoid, and a peltier actuator. In order to evaluate the proposed haptic mouse, we implement a racing game prototype system. The experimental result shows that our haptic mouse is expected to be useful in experiencing virtual world.

• Journal of Korea Game Society
• /
• v.14 no.5
• /
• pp.61-68
• /
• 2014

In the generalization of mobile content use, feedback is a kind of alert that affects content immersion. An alert leads to separation from the content currently being used to transfer to content that raises the alert. Immersive interference can be recognized as a problem in mobile contents use. In this paper, we propose a serious game for overcomes immersion. interference from feedback and the foundation for interrelation research between feedback and immersion. The proposed serious game has been designed to present three kinds of feedback, specifically positive, negative, and hybrid feedback, through social information about the user. We also conducted an experiment to examine the correlation between three kinds of feedback and immersion while consuming digital content. The result of the experiment showed that negative feedback leads to higher immersion than positive feedback.

• The Journal of Korea Robotics Society
• /
• v.3 no.1
• /
• pp.58-67
• /
• 2008

This study developed a novel augmented reality interface for minimally invasive surgery. The augmented reality technique can alleviate the sensory feedback problem inherent to laparoscopic surgery. An augmented reality system merges real laparoscope image and reconstructed 3D patient model based on diagnostic medical image such as CT, MRI data. By using reconstructed 3D patient model, AR interface could express structure of patient body that is invisible outside visual field of laparoscope. Therefore, an augmented reality system improved sight information of limited laparoscope. In our augmented reality system, the laparoscopic view is located at the center of a wide-angle concave screen and reconstructed 3D patient model is displayed outside the laparoscope. By using a joystick, the laparoscopic view and the reconstructed 3D patient model view are changed concurrently. With our augmented reality system, the surgeon can see the peritoneal cavity from a wide angle of view, without having to move the laparoscope. Since the concave screen serves immersive environments, the surgeon can feel as if she is in the patient body. For these reasons, a surgeon can recognize easily depth information about inner parts of patient and position information of surgical instruments without laparoscope motion. It is possible for surgeon to manipulate surgical instruments more exact and fast. Therefore immersive augmented reality interface for minimally invasive surgery will reduce bodily, environmental load of a surgeon and increase efficiency of MIS.