• Journal of Broadcast Engineering
• /
• v.21 no.1
• /
• pp.11-23
• /
• 2016

Recent days, touch interaction interface is the most widely used interaction interface to communicate with digital devices. Because of its usability, touch technology is applied almost everywhere from watch to advertising boards and it is growing much bigger. However, this technology has a critical weakness. Normally, touch input device needs a contact surface with touch sensors embedded in it. Thus, touch interaction through general objects like books or documents are still unavailable. In this paper, a human-object interaction framework based on RGB-D camera is proposed to overcome those limitation. The proposed framework can deal with occluded situations like hovering the hand on top of the object and also moving objects by hand. In such situations object recognition algorithm and hand gesture algorithm may fail to recognize. However, our framework makes it possible to handle complicated circumstances without performance loss. The framework calculates the status of the object with fast and robust object recognition algorithm to determine whether it is an object or a human hand. Then, the hand gesture recognition algorithm controls the context of each object by gestures almost simultaneously.

• Journal of Digital Convergence
• /
• v.19 no.2
• /
• pp.409-414
• /
• 2021

In this paper, we investigated the touch gestures of the scroll direction of a small and long UI due to the characteristics of a device in a smartphone environment that has become popular and used. Touch gestures are touched and directed by triggers such as metaphors and affordances based on past experiences. Different types of touch gestures are used depending on the type of navigation, motion, and transformation gesture, but scrolling is the most frequently used among them. In general, the scroll is vertically scrolled, but recently, a design pattern that can be scrolled left and right inside is arranged to cause cognitive dissonance of users. In the use of an inner scroll that can scroll left and right by covering a part of the right content, the mixing of a non-scrollable design pattern becomes a factor that requires attention to the user. Therefore, it was found that the use of triggers and the use of consistent design patterns can enhance the user experience even in the inner scroll environment.

• Journal of the Korea Society of Computer and Information
• /
• v.19 no.9
• /
• pp.39-44
• /
• 2014

In this paper, we study the light pen emulator implementation that can be used in industrial computer. For use in industrial control field, an input device of an industrial machine is an electronic pen is usually used, but now many cases, a light pen cannot be used to the computer. In this study, the light pen emulator to substitute for the function that is available to the peripheral device on the PC, now. So we want to increase the utilization of industrial computer in this research. The light pen emulator was designed by USB HOST, CPLD and MPU. Light pen signal, after interpret the input from the touch screen and mouse and USB system data, was output by calculating screen coordinates. As a result, we showed that it is possible to use the computer in a variety of industrial devices such as a mouse, digitizer, touch screen, stylus, and designed emulator.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.15 no.2
• /
• pp.167-173
• /
• 2015

Extraction of Finger-end points is one of the most process for user multi-commands in the Hand-Gesture interface technology. However, most of previous works use the geometric and morphological method for extracting a finger-end points. Therefore, this paper proposes the method of user finger-end points extraction that is motivated a ultrared diffused illumination, which is used for the user commands in the multi-touch display device. Proposed air-mouse is worked by the quantity state and moving direction of extracted finger-end points. Also, our system includes a basic mouse event, as well as the continuous command function for expending a user multi-gesture. In order to evaluate the performance of the our proposed method, after applying to the web browser application as a command device. As a result, the proposed method showed the average 90% success-rate for the various user-commands.

• Journal of Korea Multimedia Society
• /
• v.15 no.7
• /
• pp.870-878
• /
• 2012

Recently, very rapid development of computer and sensor technologies induces various kinds of user interface (UI) technologies based on user experience (UX). In this study, we investigate and develop a smart touch projector system technology on the basis of IR sensor and image processing. In the proposed system, a user can control computer by understanding the control events based on gesture of IR pen as an input device. In the IR image, we extract the movement (or gesture) of the devised pen and track it for recognizing gesture pattern. Also, to correct the error between the coordinate of input image sensor and display device (projector), we propose a coordinate correction algorithm to improve the accuracy of operation. Through this system technology as the next generation human-computer interaction, we can control the events of the equipped computer on the projected image screen without manipulating the computer directly.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.6 no.4
• /
• pp.304-313
• /
• 2006

This paper describes a novel way of applying capacitive sensing technology to a mobile user interface. The key idea is to use grip-pattern, which is naturally produced when a user tries to use the mobile device, as a clue to determine an application to be launched. To this end, a capacitive touch sensing system is carefully designed and installed underneath the housing of the mobile device to capture the information of the user's grip-pattern. The captured data is then recognized by dedicated recognition algorithms. The feasibility of the proposed user interface system is thoroughly evaluated with various recognition tests.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.27 no.2
• /
• pp.361-371
• /
• 2017

The increase in user data stored in the device implies the increase in threats of users' sensitive data. Currently, smartphone authentication mechanisms such as Pattern Lock, fingerprint recognition are widely used. Although, there exist disadvantages of inconvenience use and dependence that users need to depend on their own memory. User behavior based authentication mechanism have advantages of high convenience by offering continuous authentication when using the mobile device. However, these mechanisms show limitations on low accuracy of authentication and there are researches to improve the accuracy. This paper proposes improved authentication mechanism that uses user's smartphone application usage pattern which has not considered on earlier studies. Also, we analyze performance of proposed mechanism with collected datasets from actual use of smartphone applications.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.4
• /
• pp.585-591
• /
• 2012

Objective: The aim of this study is to propose the contactless gesture-based interface on smart mobile devices for especially rhythm action games. Background: Most existing approaches about interactions of smart mobile games are tab on the touch screen. However that way is such undesirable for someone or for sometimes, because of the disabled person, or the inconvenience that users need to touch/tab specific devices. Moreover more importantly, new interaction can derive new possibilities from stranded game genre. Method: In this paper, I present a smart mobile game with contactless gesture-based interaction and the interfaces using computer vision technology. Discovering the gestures which are easy to recognize and research of interaction system that fits to game on smart mobile device are conducted as previous studies. A combination between augmented reality technique and contactless gesture interaction is also tried. Results: The rhythm game allows a user to interact with smart mobile devices using hand gestures, without touching or tabbing the screen. Moreover users can feel fun in the game as other games. Conclusion: Evaluation results show that users make low failure numbers, and the game is able to recognize gestures with quite high precision in real time. Therefore the contactless gesture-based interaction has potentials to smart mobile game. Application: The results are applied to the commercial game application.

• The Journal of the Korea Contents Association
• /
• v.13 no.11
• /
• pp.59-68
• /
• 2013

iPod Touch provided so various application software beyond the early music playback function, and enhanced its UI to the level of UX. Because of these, it was evaluated as innovative. In addition, even though various images were provided through the Internet, some people still classify MP3P as audio device in its product category. As for how audio device became video or image device and which factor contributed to such happening, there may be various factors, such as social, cultural, and technical change, other than fundamental change of medium itself. This study is regarding medium characteristics of MP3Player. In other words, this study classified genealogical changes, which can be categorized into 4 points. This study also analyzed the property of each point according to this classification. The result of analysis showed that there is a relation with technological as well as social context in such genealogical change in MP3player. Even though there are various elements in the change of a device, it can be suggested that the factors of genealogical change in MP3player are influenced by a totality of social needs and contexts and technical changes.

• Journal of rehabilitation welfare engineering & assistive technology
• /
• v.8 no.1
• /
• pp.47-55
• /
• 2014

Almost of alternate computer access devices which assist people with disabilities to utilize the computer connected to computer by some cables or installed in as a S/W program. These devices have some spatial limitations to the people with disabilities, it can't guarantee the free and diverse access to the computer. For these reasons, in this paper, an Android-based mouse program for alternative computer access was developed. A people with physical disabilities who has some limitation of hand movements can use it in anywhere and anytime using only the fine motor skill of the upper limbs. The developed device recognizes the user's point touch and transforms it into the location of mouse cursor. The location information transferred to the computer via Bluetooth communication module equipped in smart devices. Also the group scanning method which can reduce the user's fatigue degree was employed and click, double click, drag & drop functions by hand's movements were equipped. The developed device will help the people with disabilities to use computer with brief touch and convenient operation without spatial limitation.