• 제어로봇시스템학회:학술대회논문집
• /
• 2002.10a
• /
• pp.51.4-51
• /
• 2002

$\textbullet$ A noval haptic mouse system is developed for human computer interface. $\textbullet$ Five bar mechanism is adapted for 2 dof force feedback with virtual environment. $\textbullet$ Double prismatic joint type mechanism is adapted to reflect 1 dof grabbing force feedback. $\textbullet$ Cable driven mechansim is used for actuation to reduce backlash and endow backdrivability. $\textbullet$ Virtual wall perception experiment is conducted to obtain force specification for haptic mouse. $\textbullet$ Average mouse workspace is measured using magnetic position tracker.

• Journal of Korea Multimedia Society
• /
• v.14 no.9
• /
• pp.1210-1220
• /
• 2011

In this paper, we suggest a haptic mouse system as an immersive interface between virtual environment and a human operator. The proposed haptic mouse creates vibrotacitle and thermal sensation to increase the immersion. The vibrotactile module is composed of eccentric motors and a solenoid actuator, and the thermal module consists of a thin-film resistance temperature detector and a Peltier thermoelectric heat pump. In order to evaluate the proposed haptic mouse system, we develop a simple racing game and conduct an experiment. The result of the experiment shows that the proposed haptic mouse system can improve the sense of reality in virtual environment and can be used as an effective interface between virtual environment and a human operator.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.1-5
• /
• 2009

In this paper, we develop a haptic mouse system for immersive human computer interaction. The proposed haptic mouse system can provide vibrotactile feedback as well as thermal feedback for realistic virtual experience. For vibrotactile and thermal feedback, we use eccentric motors, a solenoid, and a peltier actuator. In order to evaluate the proposed haptic mouse, we implement a racing game prototype system. The experimental result shows that our haptic mouse is expected to be useful in experiencing virtual world.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.11 no.2
• /
• pp.57-62
• /
• 2011

Recently, various interaction was demanded from rapid development and use of portable device. So, operation of touch interface in tablet and smart phone needs many requirements and proactivity. In this paper, for variety of users and convenient interaction, It is aimed to realize virtual reality mouse of portable device. It reflected similar interaction of an existing mouse and it used infrared image without intensity of illumination. Also, It analyzed finger point information of middle and index finger of users and it designed virtual mouse without proactivity and constraint of space.

• Journal of Computing Science and Engineering
• /
• v.10 no.1
• /
• pp.32-38
• /
• 2016

Navigating a large 3D virtual environment using a generic haptic device can be challenging since the haptic device is usually bounded by its own physical workspace. On the other hand, mouse interaction easily handles the situation with a clutching mechanism-simply lifting the mouse and repositioning its location in the physical space. Since the haptic device is used for both input and output at the same time, in many cases, its freedom needs to be limited in order to accommodate such a situation. In this paper, we propose a new mechanism called Z-Clutching for 3D navigation of a virtual environment by using only the haptic device without any interruption or sacrifice in the given degrees of freedom of the device's handle. We define the clutching state which is set by pulling the haptic handle back into space. It acts similarly to lifting the mouse off the desk. In this way, the user naturally feels the haptic feedback based on the depth (z-direction), while manipulating the haptic device and moving the view as desired. We conducted a user study to evaluate the proposed interaction technique, and the results are promising in terms of the usefulness of the proposed mechanism.

• Journal of Digital Contents Society
• /
• v.15 no.4
• /
• pp.473-480
• /
• 2014

As the use of computer has been popularized these days, an active research is in progress to make much more convenient and natural interface compared to the existing user interfaces such as keyboard or mouse. For this reason, there is an increasing interest toward Microsoft's motion sensing module called Kinect, which can perform hand motions and speech recognition system in order to realize communication between people. Kinect uses its built-in sensor to recognize the main joint movements and depth of the body. It can also provide a simple speech recognition through the built-in microphone. In this paper, the goal is to use Kinect's depth value data, skeleton tracking and labeling algorithm to recognize information about the extraction and movement of hand, and replace the role of existing peripherals using a virtual mouse, a virtual keyboard, and a speech recognition.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.1
• /
• pp.49-61
• /
• 2000

An experiment was designed to evaluate Fitts' law for the three-dimensional virtual pointing task and to compare the three input devices; Spaceball, Spacemouse, and 3D-Mouse. The result showed that Fitts law fitted poorly for the three-dimensional pointing tasks with relatively low coefficients of determinant. Three reasons, high degree-of-freedom, dynamic egocentric viewpoint change, and clutching problem were discussed to explain the poor fitness of Fitts' law. In terms of device comparison, the 3D-Mouse was superior to the other input devices. Also, the stereoscopic display significantly increased the performance. The results of this study can be used for the design of virtual control tasks and the selection of suitable input devices.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.11-21
• /
• 2015

As growing interest in Human-Computer Interaction(HCI), research on HCI has been actively conducted. Also with that, research on Natural User Interface/Natural User eXperience(NUI/NUX) that uses user's gesture and voice has been actively conducted. In case of NUI/NUX, it needs recognition algorithm such as gesture recognition or voice recognition. However these recognition algorithms have weakness because their implementation is complex and a lot of time are needed in training because they have to go through steps including preprocessing, normalization, feature extraction. Recently, Kinect is launched by Microsoft as NUI/NUX development tool which attracts people's attention, and studies using Kinect has been conducted. The authors of this paper implemented hand-mouse interface with outstanding intuitiveness using the physical features of a user in a previous study. However, there are weaknesses such as unnatural movement of mouse and low accuracy of mouse functions. In this study, we designed and implemented a hand mouse interface which introduce a new concept called 'Virtual monitor' extracting user's physical features through Kinect in real-time. Virtual monitor means virtual space that can be controlled by hand mouse. It is possible that the coordinate on virtual monitor is accurately mapped onto the coordinate on real monitor. Hand-mouse interface based on virtual monitor concept maintains outstanding intuitiveness that is strength of the previous study and enhance accuracy of mouse functions. Further, we increased accuracy of the interface by recognizing user's unnecessary actions using his concentration indicator from his encephalogram(EEG) data. In order to evaluate intuitiveness and accuracy of the interface, we experimented it for 50 people from 10s to 50s. As the result of intuitiveness experiment, 84% of subjects learned how to use it within 1 minute. Also, as the result of accuracy experiment, accuracy of mouse functions (drag(80.4%), click(80%), double-click(76.7%)) is shown. The intuitiveness and accuracy of the proposed hand-mouse interface is checked through experiment, this is expected to be a good example of the interface for controlling the system by hand in the future.

• Proceedings of the KIEE Conference
• /
• 2006.04a
• /
• pp.78-80
• /
• 2006

Mouse is widely used in multimedia education. However, using mouse is not easy for user to get exact three dimentional (3D) user input and to manipulate delicately as the user can not know the surface information of virtual objects, which are typical drawbacks of using mouse in multimedia education, especially in 3D multimedia contents authoring. In this paper, haptic device is introduced to the 3D multimedia education. The haptic device provides 3D user's input information as well as haptic information of virtual objects such as surface textures, collisions and etc. which thus allow to enhance the task efficiency in multimedia education. Simple experiment results are presented to show the positive results of using the haptic device in multimedia education.

• Journal of the Institute of Convergence Signal Processing
• /
• v.11 no.3
• /
• pp.221-225
• /
• 2010

This paper presents the preliminary study of an interactive rehabilitation support system for both dementia patients and their caregivers, the goal of which is to improve the quality of life(QOL) of the patients suffering from dementia through virtual interaction. To achieve the virtual interaction, three kinds of recognition modules for speech, facial image and pen-mouse gesture are studied. The results of both practical tests and questionnaire surveys show that the proposed system had to be further improved, especially in both speech recognition and user interface for real-world applications. The surveys also revealed that the pen-mouse gesture recognition, as one of possible interactive aids, show us a probability to support weakness of speech recognition.