• Journal of the Ergonomics Society of Korea
• /
• v.35 no.3
• /
• pp.175-184
• /
• 2016

Objective: In this study, two types of foot-controlled mouse devices are compared with a hand mouse in the input tasks requiring repetitively switching between a keyboard and a mouse. Background: Foot-controlled mouse devices have been developed for persons with impairments in the mobility of their hands. However, some researchers insisted that the foot-controlled mouse devices could be effectively used by the persons with no limits to their hand mobility. There are needs to investigate the efficiency of the foot-controlled mouse devices, when they are used by the nondisabled people. Method: Participants conducted the input tasks, requiring repetitive switches between a keyboard and a computer mouse. The used computer mouse devices were two types of foot-controlled mouse and a typical hand mouse. Participants performed three types of input task for five days and three types of task performance were measured; the number of completed input tasks within a given practice time, subjective satisfaction level and the time wasted for the mouse control. Results: For five days, the performance of input tasks sharply increased in input tasks by foot-controlled mouse devices rather than a hand mouse. After five days, the level of satisfaction on the foot-controlled mouse devices approached to about 76% of a hand mouse satisfaction level. The control time of the foot-controlled mouse devices also approached to about 109% of a hand mouse control time. Conclusion: After only five-day practice, the input task performance by foot-controlled mouse devices approached to that of a hand mouse. This result may suggest that the foot-controlled mouse devices can be effectively used as an alternative input device for the nondisabled people, if input tasks are easy and enough practice time is provided. Application: The results of this study might help to design foot-controlled mouse devices and to expend the usage of them.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.6
• /
• pp.725-731
• /
• 2012

Objective: The aim of this study is to investigate visual feedback effects and human performance in the foot mouse control. Background: Generally, computer mouse tasks are controlled by visual feedback. In order to understand the characteristics of a foot mouse control, it is important to investigate the patterns of visual feedback involved in foot-mouse control tasks. Human performance of foot mouse control is also an important factor to understand the foot mouse control. Method: Three types of mouse control were determined to investigate visual feedback effects and human performance in the foot mouse control. Visual feedback effects in the foot mouse control were compared with those of a typical hand mouse. The cursor movement speed and mental workload were measured in the three types of tasks and two types of mouses. Results: Mouse control tasks with an element of homing-in to the target were more quickly performed by the hand mouse than the foot mouse. Mental workload was also higher in the foot mouse than the hand mouse. However, in the steering movement, human performance of the foot mouse control was not lower than that of the hand mouse control. Visual feedback in the foot mouse control was less required than in the hand mouse control. Conclusion: The foot mouse was not efficient in the most mouse control tasks, compared to the hand mouse. However, the foot mouse was efficient in the steering movement, moving a cursor within a path with lateral constraints. Application: The results of this study might help to develop the foot mouse.

• Journal of Korean Institute of Industrial Engineers
• /
• v.37 no.3
• /
• pp.209-215
• /
• 2011

The objective of this study was to determine whether there are differences in hand muscle activities (APB : abductor pollicis brevis, ED : extensor digitorum, ECU : extensor carpi ulnaris, and EI : extensor indicis) and subjective discomfort according to the three mouse sizes (small, medium, large) and two task types (pointing and scrolling). The mouse size and task type showed significant interaction effects on the total NEMG (p = 0.004) and on the NEMG of the abductor pollicis brevis muscle (p = 0.001). The total NEMG and the NEMG of APB showed the highest value in the 'scrolling' task using the 'small' mouse. However, the NEMG of the EI was different according to the mouse size, and the 'small' mouse showed the lowest value. The subjective discomfort was the lowest in the 'medium' mouse, and all nine subjects preferred the 'medium' size. The hand-size related anthropometric variables showed different correlations according to the task type and mouse size with the NEMGs and subjective discomfort. The results of this study could be used as a basic information for the determination of the proper mouse size according to the hand size.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.5
• /
• pp.1060-1065
• /
• 2011

In this paper, the proposed method is recognized the hands using color information with input image of the camera. It controls the mouse pointer using recognized hands. In addition, specific commands with the mouse pointer is designed to perform. Most users felt uncomfortable since existing interaction multimedia systems depend on a particular external input devices such as pens and mouse However, the proposed method is to compensate for these shortcomings by hand without the external input devices. In experimental methods, hand areas and backgrounds are separated using color information obtaining image from camera. And coordinates of the mouse pointer is determined using coordinates of the center of a separate hand. The mouse pointer is located in pre-filled area using these coordinates, and the robot will move and execute with the command. In experimental results, the recognition of the proposed method is more accurate but is still sensitive to the change of color of light.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.2
• /
• pp.365-373
• /
• 2011

The existing GOMS model overestimates the performance time of mouse activities because it describes them in a serial sequence. However, parallel movements of eye and hand(eye-hand coordination) have been dominant in mouse activities and this eye-hand coordination is the main factor for the overestimation of performance time. In this study, therefore, the revised CGOMSL model was developed to implement eye-hand coordination to the mouse activity to overcome one of the limitations of GOMS model, the lack of capability for parallel processing. The suggested revised CGOMSL model for drag activity, as an example for one of mouse activities in this study, begins visual search processing before a hand movement but ends the visual search processing with the hand movement in the same time. The results show that the revised CGOMSL model made the prediction of human performance more accurately than the existing GOMS model. In other words, one of the limitations of GOMS model, the incapability of parallel processing, could be overcome with the revised CGOMSL model so that the performance time should be more accurately predicted.

• Journal of Korea Multimedia Society
• /
• v.15 no.11
• /
• pp.1377-1383
• /
• 2012

This paper proposes a human mouse system that replaces mouse input by human hand movement. As the resolution of monitors increases, it is not quite possible, due to the resolution difference between web cameras and monitors, to place the cursor in the entire range of a monitor by simply moving the pointer which recognizes the position of the hand from the web camera. In this regard, we propose an effective method of placing the position of the mouse, without repeating the returning hand movements, in the corners of the monitor in which the user wants it to be. We also proposes the recognition method of finger movements in terms of using thumb and index finger. The measurement that we conducted shows the successful recognition rate of 97% that corroborates the effectiveness of our method.

• IEIE Transactions on Smart Processing and Computing
• /
• v.1 no.2
• /
• pp.88-94
• /
• 2012

Many hand gesture recognition systems using advanced computer vision techniques to eliminate the need for a TV remote controller have been proposed. Nevertheless, some issues still remain, such as high computational complexity and insufficient information on the target object and background. Moreover, none of the proposed techniques consider how to enter the control mode of the system. This means that they may need a TV remote controller to enter the control mode. This paper proposes a hand mouse system using a pre-defined gesture with high background adaptability. By doing so, a remote controller to enter the control mode of the IPTV system can be eliminated.

• ETRI Journal
• /
• v.30 no.4
• /
• pp.621-623
• /
• 2008

We propose a novel input pointing device called the multimodal mouse (MM) which uses two modalities: face recognition and speech recognition. From an analysis of Microsoft Office workloads, we find that 80% of Microsoft Office Specialist test tasks are compound tasks using both the keyboard and the mouse together. When we use the optical mouse (OM), operation is quick, but it requires a hand exchange delay between the keyboard and the mouse. This takes up a significant amount of the total execution time. The MM operates more slowly than the OM, but it does not consume any hand exchange time. As a result, the MM shows better performance than the OM in many cases.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.11-21
• /
• 2015

As growing interest in Human-Computer Interaction(HCI), research on HCI has been actively conducted. Also with that, research on Natural User Interface/Natural User eXperience(NUI/NUX) that uses user's gesture and voice has been actively conducted. In case of NUI/NUX, it needs recognition algorithm such as gesture recognition or voice recognition. However these recognition algorithms have weakness because their implementation is complex and a lot of time are needed in training because they have to go through steps including preprocessing, normalization, feature extraction. Recently, Kinect is launched by Microsoft as NUI/NUX development tool which attracts people's attention, and studies using Kinect has been conducted. The authors of this paper implemented hand-mouse interface with outstanding intuitiveness using the physical features of a user in a previous study. However, there are weaknesses such as unnatural movement of mouse and low accuracy of mouse functions. In this study, we designed and implemented a hand mouse interface which introduce a new concept called 'Virtual monitor' extracting user's physical features through Kinect in real-time. Virtual monitor means virtual space that can be controlled by hand mouse. It is possible that the coordinate on virtual monitor is accurately mapped onto the coordinate on real monitor. Hand-mouse interface based on virtual monitor concept maintains outstanding intuitiveness that is strength of the previous study and enhance accuracy of mouse functions. Further, we increased accuracy of the interface by recognizing user's unnecessary actions using his concentration indicator from his encephalogram(EEG) data. In order to evaluate intuitiveness and accuracy of the interface, we experimented it for 50 people from 10s to 50s. As the result of intuitiveness experiment, 84% of subjects learned how to use it within 1 minute. Also, as the result of accuracy experiment, accuracy of mouse functions (drag(80.4%), click(80%), double-click(76.7%)) is shown. The intuitiveness and accuracy of the proposed hand-mouse interface is checked through experiment, this is expected to be a good example of the interface for controlling the system by hand in the future.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.337-341
• /
• 2008

This paper presents a vibrotactile space mouse which use pin-type vibrotactile display modules and a gyroscope chip. This mouse is a new interface device which is not only an input device as an ordinary space mouse but also a tactile output device. It consists of a space mouse which use gyroscope chip and vibrotactile display modules which have been developed in our own laboratory. Lately, by development of vibrotactile display modules which have small size and consume low power, vibrotactile displays are available in small sized embedded systems such as wireless mouses or mobile devices. Also, development of new sensors like miniature size gyroscope by MEMS technology enables manufacturing of a small space mouse which can be used in the air not in a plane. The vibrotactile space mouse proposed in this paper recognizes motion of a hand using the gyroscope chip and transmits the data to PC through Bluetooth. PC application receives the data and moves pointer. Also, 2 by 3 arrays of pin-type vibrotactile actuators are mounted on the front side of the mouse where fingers of a user's hand contact, and those actuators could be used to represent various information such as gray-scale of an image or Braille patterns for visually impared persons.