• Archives of design research
• /
• v.17 no.3
• /
• pp.441-448
• /
• 2004

Mobile devices such as mobile phones or PDAs are considered as main interlace tools in ubiquitous computing environment. For searching information in mobile device, it should be possible for user to input some text as well as to control cursor for navigation. So, we should find efficient interlace method for text input in limited dimension of mobile devices. This study intends to suggest a new approach to mobile interaction using camera based virtual keyboard for text input in mobile devices. We developed a camera based virtual keyboard prototype using a PC camera and a small size LCD display. User can move the prototype in the air to control the cursor over keyboard layout in screen and input text by pressing a button. The new interaction method in this study is evaluated as competitive compared to mobile phone keypad in left input efficiency. And the new method can be operated by one hand and make it possible to design smaller device by eliminating keyboard part. The new interaction method can be applied to text input method for mobile devices requiring especially small dimension. And this method can be modified to selection and navigation method for wireless internet contents on small screen devices.

• 제어로봇시스템학회:학술대회논문집
• /
• 2002.10a
• /
• pp.51.5-51
• /
• 2002

In this paper, we propose and developed a keyglove using the touch-typing method as new solutions to the problem of text input into the mobile computing devices. This device recognizes that character is typed in though the hand's movements analysis and requires no additional space on a person's desktop or work surface, and can be easily used with computers of any size, even the smallest mobile computer, and is designed as an input device for wearable computers and virtual environment. The concept of the wearable input device based on human hand-molies recognition.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2001.04a
• /
• pp.125-130
• /
• 2001

Skilled typists can type characters or words without looking at keyboard, relying on the finger's relative position. If the relative positions of the fingers can be identified, a virtual keyboard may be accomplished by applying the concept of "DataGlove" or "FingerRing". The virtual keyboard may be efficient as a new mobile input device supporting QWERTY keyboard layout. For the purpose of investigating skilled typing pattern, in this paper the touch-positions of the fingers are measured with a touchscreen while five skilled typists type a long sentence. From these measurements it can be observed that the groups of touch-positions are classified into alphabet characters. Though there are some overlapped groups we can find constant distances capable of being discriminated among the groups from investigation of the change of touch-position for touch-time. Based on the analysis, the prediction algorithm of the constant distance is proposed and evaluated, which is useful for realization of a portable virtual keyboard.le virtual keyboard.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.4
• /
• pp.493-498
• /
• 2012

Objective: The purpose of this study is to suggest the hierarchical structure with three layers of input task, input interaction, and input device. Background: Understanding the input interaction is very helpful to design an interface design. Method: We made a model of three layered input structure based on empirical approach and applied to a gesture interaction in TV. Result: We categorized the input tasks into six elementary tasks which are select, position, orient, text, and quantify. The five interactions described in this paper could accomplish the full range of input interaction, although the criteria for classification were not consistent. We analyzed the Microsoft kinect with this structure. Conclusion: The input interactions of command, 4 way, cursor, touch, and intelligence are basic interaction structure to understanding input system. Application: It is expected the model can be used to design a new input interaction and user interface.

• Journal of Korea Game Society
• /
• v.7 no.3
• /
• pp.67-76
• /
• 2007

As the performance of game consoles is so highly progressed that services such as internet browsing become available on the consoles, the need for text input schemes on game consoles is rapidly raised. In this paper, we present a text input method of alphabet characters and several symbols using a gamepad, which is a widely used input device for most game consoles. Just like other text input methods using gamepad, our method allows users to enter texts by manipulating the gamepad with a user interface displayed on the screen of the console. A key idea of this paper is to present the user interface that is similar to the $4{\times}3$ keypad on mobile phones. The motivation of this idea is a principle that the experience of using a text input tool can be transferred to another tool that has similar interface. Another motivation is that the keyboard-based interface is too complex to be easily manipulated by simple input from a keypad, which is four orthogonal directions and several fire signals. Since most of keys on keypad of $4{\times}3$ keys are represented by a combination of two orthogonal directions, users feel easier in entering texts using keypad-based interface. We prove this argument in this paper by a user test of ten subjects. After about two experiment sessions, subjects reach 13 WPM in average, which proves that the proposed text input method enables much faster text input than the existing keyboard-based text input methods.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.1
• /
• pp.29-34
• /
• 2022

We propose a novel network architecture and build dataset for recognizing clickable objects on mobile device screens. The data was collected based on clickable objects on the mobile device screen that have numerous resolution, and a total of 24,937 annotation data were subdivided into seven categories: text, edit text, image, button, region, status bar, and navigation bar. We use the Deconvolution Single Shot Detector as a baseline, the backbone network with Squeeze-and-Excitation blocks, the Single Shot Detector layer structure to derive inference results and the Feature pyramid networks structure. Also we efficiently extract features by changing the input resolution of the existing 1:1 ratio of the network to a 1:2 ratio similar to the mobile device screen. As a result of experimenting with the dataset we have built, the mean average precision was improved by up to 101% compared to baseline.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.9
• /
• pp.720-726
• /
• 2003

A virtual keyboard may be efficient as a new mobile input device supporting QWERTY keyboard layout. As a preliminary study for developing a virtual keyboard, the typing pattern of a skilled human is investigated. In the study the touch-positions of the fingers are measured with a touchscreen while five skilled typists perform typing of long sentences. From these measurements it can be observed that the groups of touch-positions are classified into alphabetic characters. Though there are some mismatches, we can find constant distances capable of being discriminated among the groups. Based on the analysis the prediction algorithm of the constant distance is proposed and evaluated, which is useful for realization of a portable virtual keyboard.

• Journal of Advanced Navigation Technology
• /
• v.19 no.5
• /
• pp.452-457
• /
• 2015

Recently, wearable devices have gained popularity with familiar form factors and designs of eye-wear and watch to satisfy wearers' various preferences. Since UI/UX of smartphones can not be applied directly on smaller wearable devices, text entry on wearable devices is still problematic. In this paper, we first identify UI/UX problems of existing input methods and propose a new input method for wearable devices specifically targeting smartwatch platforms. We design and implement an efficient text entry method for wearable devices using trackball sensor and evaluate its performance and usability.

• Journal of the HCI Society of Korea
• /
• v.1 no.1
• /
• pp.21-28
• /
• 2006

Most of the commercialized wearable text input devices are wrist-worn keyboards that have adopted the minimization method of reducing keys. Generally, a drastic key reduction in order to achieve sufficient wearability increases KSPC(Keystrokes per Character), decreases text entry performance, and requires additional effort to learn a new typing method. We are faced with wearability-usability tradeoff problems in designing a good wearable keyboard. To address this problem, we introduced a new keyboard minimization method of reducing key pitch. From a series of empirical studies, we found the potential of a new method which has a keyboard with a 7mm key pitch, good wearability and social acceptance in terms of physical form factors, and allows users to type 15.0WPM in 3 session trials. However, participants point out that a lack of passive haptic feedback in keying action and visual feedback on users' input deteriorate the text entry performance. We have developed the One-key Keyboard that addresses this problem. The traditional desktop keyboard has one key per character, but the One-key Keyboard has only one key ($70mm{\times}35mm$) on which a 10*5 QWERTY key array is printed. The One-key Keyboard detects the position of the fingertip at the time of the keying event and figures out the character entered. We conducted a text entry performance test comprised of 5 sessions. The participants typed 18.9WPM with a 6.7% error rate over all sessions and achieved up to 24.5WPM. From the experiment's results, the One-key Keyboard was evaluated as a potential text input device for wearable computing, balancing wearability, social acceptance, input speed, and learnability.

• The KIPS Transactions:PartA
• /
• v.18A no.2
• /
• pp.53-60
• /
• 2011

Touch screen technologies are widely used as the basic input for mobile devices. However, for smartphones, touch screens have been utilized as a simple device that merely process text data. It has been considered an inappropriate multimedia input device for one to use design applications, such as painting, due to its narrow touch screen space, which makes it inconvenient to draw pictures. In this study, we propose to enhance this weakness by using infrared approach on a smartphone's input interface. The usage of infrared approach will allow for quick and accurate operations without facing any space constraints. In this paper, we provide a detailed description of the design and implementation of a smartphone user interface using infrared pointing device. Additionally, using experimental results, we prove that our proposed approach is more convenient and efficient than traditional touch screen approaches used in smartphones.