• Journal of the Korea Society of Computer and Information
• /
• v.17 no.12
• /
• pp.219-228
• /
• 2012

In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.

• Journal of Korean Institute of Industrial Engineers
• /
• v.39 no.2
• /
• pp.99-104
• /
• 2013

With diversity of mobile services (e.g., messenger, and social network service) on smartphone, the demand of text input using a soft keyboard is increasing. However, studies on subjective and physiological responses of users for various touch locations are lacking. The present study investigated the ergonomic effects according to touch locations of a soft keyboard on smartphone. The experiment of the present study measured perceived discomfort using Borg's CR-10 scale and electromyography (EMG) on forearm (abductor pollicis longus, and extensor digitorum communis) and thumb (abductor pollicis brevis, and first dorsal interossei) muscles. Perceived discomfort was significantly varied from 0.7 (extremely weak discomfort) to 2.5 (weak discomfort) depending on touch locations. %MVC according to touch locations was only significant at abductor pollicis brevis which varied from 10% to 23%. The experimental results of the present study can be utilized in the ergonomic design of a soft keyboard.

• Journal of Digital Convergence
• /
• v.12 no.7
• /
• pp.253-259
• /
• 2014

A new style keyboard which is user friendly and can be used efficiently in a small area is proposed in this paper. The most pre-existing keyboards were using the style of selecting a key among the arranged keys even the formats of key arrangement and the ways of using them were different. A new style of information input device called Dynamic Keyboard(DynaKey) is designed in this paper. Dynakey is a useful information input device which can be used efficiently for a mobile device with small display and for handicapped persons who has difficulties of selecting precise positions.

• Proceedings of the Korea Contents Association Conference
• /
• 2010.05a
• /
• pp.272-273
• /
• 2010

The method of interrupt control is attempted to recognize the button-pushed result from a keyboard scan through control of 30ms appropriate period instead of key scan control method for a microprocessor system. This experimental study shows the reduced processing load of a microprocessor and prevention of the error by an algorithm when the keyboard buttons are both pushed at the same time as we recognize the result of a keyboard scanning by an interrupt method. In addition, an algorithm is provided to recognize the result of scanning by C programming as the keyboard button of a microprocessor system is pushed.

• Journal of Mechanical Science and Technology
• /
• v.17 no.12
• /
• pp.2004-2009
• /
• 2003

The purpose of this study is to define how wrist motion is affected by different postures and supporting devices and to discover functional range of wrist motion for keyboard typing. The range of wrist motion (ROM) needed for fourteen experienced typists to type on a computer keyboard was measured by flexible and biaxial electrogoniometers. The most frequent wrist motion during typing was in extended and ulnarly deviated positions in both wrists. Range of wrist motion was similar in both wrists. The average ROM for keyboard typing with the typists' own posture was about 39 in flexion/extension (FEM) and 29 in radial/ulnar deviation (RUD) in both wrists. The range of wrist motion was significantly reduced to 30 in FEM and 27 in RUD with use of either wrist or forearm supporting devices, which suggests that these devices might help to relieve fatigue, discomfort, or pain during and/or after typing. Results of this study will be of interest to clinicians and helpful to those who are professionally or non-professionally involved in typing.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.9
• /
• pp.720-726
• /
• 2003

A virtual keyboard may be efficient as a new mobile input device supporting QWERTY keyboard layout. As a preliminary study for developing a virtual keyboard, the typing pattern of a skilled human is investigated. In the study the touch-positions of the fingers are measured with a touchscreen while five skilled typists perform typing of long sentences. From these measurements it can be observed that the groups of touch-positions are classified into alphabetic characters. Though there are some mismatches, we can find constant distances capable of being discriminated among the groups. Based on the analysis the prediction algorithm of the constant distance is proposed and evaluated, which is useful for realization of a portable virtual keyboard.

• Journal of Korea Multimedia Society
• /
• v.18 no.3
• /
• pp.368-375
• /
• 2015

Nowaday, financial institutions provide secure mobile keyboard solutions to keep their mobile banking services safe. However, these are still vulnerable to attacks, such as shoulder surfing attack. Especially, in the case of handicapped person such as visual impairment and blindness, they are more vulnerable than ordinary person because of inconvenience of secure information input. Among them, we focused on the color blind. For the color blind, 4-color based secure keyboard method causes more inconvenience to notify exact color. Thus, we propose a secure mobile keyboard solution to provide advanced functionality for the color blind users. Our method is based on 4-color theorem to support color blind users. In addition, our scheme is robust against shoulder surfing attack. According to the evaluation result, our method offers increased security against shoulder surfing attack compare with existing methods.

• Journal of Korea Multimedia Society
• /
• v.21 no.11
• /
• pp.1263-1270
• /
• 2018

Dynamic adaptation method is an effective technique to enhance the usability by personalizing the soft keyboard layout using the user's key input information. In this paper, we propose a dynamic adaptation method of a keyboard by automatically extracting typos from key input information and using adjacent-typo information classified through the relationship between typos. This technique does not limit a range of adaptation to the inside of the key but extends the range to the neighbor key so that the adaptation effect can be achieved in a wide range at a high speed, thereby the proposed method improves the usability of the keyboard with a small number of inputs. The proposed method showed 25% increase in usability compared to the existing method through experiment and it was confirmed that usability improves up to 33% when used with the existing method.

• Journal of Korean Institute of Industrial Engineers
• /
• v.42 no.1
• /
• pp.57-64
• /
• 2016

Pen-based interaction is universally available on smart devices and especially on Tablet PCs. Previous studies compared various input methods like fingers, a mouse or a stylus pen on PCs or on a touchscreen based devices such as smart phones. At the same time, various soft keyboard applications are being developed on application stores of smart devices. However, these previous studies did not suggest which one is a suitable keyboard application for Tablet PCs when users perform a certain interaction as input type. In this study, we compared two types of input methods (finger and pen) and three types of soft keyboard applications (QWERTY, Gesture and Swype) in a Tablet PC using performance measurements (accuracy and input speed) and discussed what types of applications showed better performance with each interaction on tablet PC. From these results, recommendations for the keyboard types depending on the input methods on tablet PCs were developed.

• Journal of Korea Multimedia Society
• /
• v.15 no.1
• /
• pp.51-62
• /
• 2012

In this paper, we propose a self instrument learning tool using a PC-based software and an external electronic keyboard instrument with USB interface to help primary school students to learn playing piano more easily and effectively. The PC-based learning software and the external electronic keyboard instrument interact through the USB interface. This tool has a help window to provide information how to play and support interesting game mode for exercise. The external electronic keyboard instrument receives a selective information through the USB interface and display it on LEDs and 7-segment for novices to easily know the relation between the notes and the positions in the keyboard. The external keyboard instrument can detect false inputs, display them on LEDs and on the information window. We implemented a self instrument learning system and our feasibility tests showed its validity of the self learning tool to improve the learning efficiency.