• The KIPS Transactions:PartB
• /
• v.13B no.5 s.108
• /
• pp.561-568
• /
• 2006

WPS(Wearable Personal Station) for next generation PC can define as a core terminal of 'Ubiquitous Computing' that include information processing and network function and overcome spatial limitation in acquisition of new information. As a way to acquire significant dynamic gesture data of user from haptic devices, traditional gesture recognizer based on desktop-PC using wire communication module has several restrictions such as conditionality on space, complexity between transmission mediums(cable elements), limitation of motion and incommodiousness on use. Accordingly, in this paper, in order to overcome these problems, we implement hand gesture recognition system using fuzzy algorithm and neural network for Post PC(the embedded-ubiquitous environment using blue-tooth module and WPS). Also, we propose most efficient and reasonable hand gesture recognition interface for Post PC through evaluation and analysis of performance about each gesture recognition system. The proposed gesture recognition system consists of three modules: 1) gesture input module that processes motion of dynamic hand to input data 2) Relational Database Management System(hereafter, RDBMS) module to segment significant gestures from input data and 3) 2 each different recognition modulo: fuzzy max-min and neural network recognition module to recognize significant gesture of continuous / dynamic gestures. Experimental result shows the average recognition rate of 98.8% in fuzzy min-nin module and 96.7% in neural network recognition module about significantly dynamic gestures.

• Journal of Digital Contents Society
• /
• v.10 no.2
• /
• pp.291-298
• /
• 2009

In this paper we proposed a vision based realtime hand gesture recognition method. To extract skin color, we translate RGB color space into YCbCr color space and use CbCr color for the final extraction. To find the center of extracted hand region we apply practical center point extraction algorithm. We use Kalman filter to tracking hand region and use HMM(Hidden Markov Model) algorithm (learning 6 type of hand gesture image) to recognize it. We demonstrated the effectiveness of our algorithm by some experiments.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.900-902
• /
• 2018

본 논문에서는 키넥트 센서와 아이트랙킹 센서를 이용하여 동작 제스처와 시선 추적하는 방법을 나타내고 이것을 사격 게임에 적용한다. 제스처는 키넥트 센서로 인식이 되고 모델로는 팔목, 손을 이용한다. 시선 추적은 아이트랙킹을 이용하였고 더불어 눈의 위치 값을 이용해 사람이 고개를 돌렸는지까지 알 수 있다. 이 시스템을 통해 키넥트와 아이트랙킹의 연동을 통한 컨텐츠가 얼마나 가능성이 있는지 제시하고 평가하였고, 앞으로도 새로운 활용방안이 나올 수 있음을 확인하였다.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.6
• /
• pp.201-211
• /
• 2013

In this paper, we propose a hand tracking and gesture recognition system. Our system employs a depth capture device to obtain 3D geometric information of user's bare hand. In particular, we build a flexible tracking volume and restrict the hand tracking area, so that we can avoid diverse problems caused by conventional object detection/tracking systems. The proposed system computes running average of the hand position, and tracking volume is actively adjusted according to the statistical information that is computed on the basis of uncertainty of the user's hand motion in the 3D space. Once the position of user's hand is obtained, then the system attempts to detect stretched fingers to recognize finger gesture of the user's hand. In order to test the proposed framework, we built a NUI system using the proposed technique, and verified that our system presents very stable performance even in the case that multiple objects exist simultaneously in the crowded environment, as well as in the situation that the scene is occluded temporarily. We also verified that our system ensures running speed of 24-30 frames per second throughout the experiments.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.2
• /
• pp.143-149
• /
• 2019

Floating holograms are technologies that provide rich 3D stereoscopic images in a wide space such as advertisement, concert. In addition, It is possible to reduce the 3D glasses inconvenience, eye strain, and space distortion, and to enjoy 3D images with excellent realism and existence. Therefore, this paper implements a user gesture recognition system for manipulating a floating hologram characters that can be used in a small space devices. The proposed method detects face region using haar feature-based cascade classifier, and recognizes the user gestures using a user gesture-occurred position information that is acquired from the gesture difference image in real time. And Each classified gesture information is mapped to the character motion in floating hologram for manipulating a character action. In order to evaluate the performance of the proposed user gesture recognition system for manipulating a floating hologram character, we make the floating hologram display devise, and measures the recognition rate of each gesture repeatedly that includes body shaking, walking, hand shaking, and jumping. As a results, the average recognition rate was 88%.

• Journal of the Korea Society of Computer and Information
• /
• v.10 no.4 s.36
• /
• pp.47-56
• /
• 2005

With the development of wearable(ubiquitous) computers, those traditional interfaces between human and computers gradually become uncomfortable to use, which directly leads to a requirement for new one. In this paper, we study on a new interface in which computers try to recognize the gesture of human through a digital camera. Because the method of recognizing hand gesture through camera is affected by the surrounding environment such as lighting and so on, the detector should be a little sensitive. Recently, Viola's detector shows a favorable result in face detection. where Adaboost learning algorithm is used with the Haar features from the integral image. We apply this method to hand area detection and carry out comparative experiments with the classic method using skin color. Experimental results show Viola's detector is more robust than the detection method using skin color in the environment that degradation may occur by surroundings like effect of lighting.

• Journal of Platform Technology
• /
• v.11 no.1
• /
• pp.38-51
• /
• 2023

We propose an intelligent interface algorithm using hand gesture recognition information based on artificial intelligence. This method is functionally an interface that recognizes various motions quickly and intelligently by using MediaPipe and artificial intelligence techniques such as KNN, LSTM, and CNN to track and recognize user hand gestures. To evaluate the performance of the proposed algorithm, it is applied to a self-made 2D top-view racing game and robot control. As a result of applying the algorithm, it was possible to control various movements of the virtual object in the game in detail and robustly. And the result of applying the algorithm to the robot control in the real world, it was possible to control movement, stop, left turn, and right turn. In addition, by controlling the main character of the game and the robot in the real world at the same time, the optimized motion was implemented as an intelligent interface for controlling the coexistence space of virtual and real world. The proposed algorithm enables sophisticated control according to natural and intuitive characteristics using the body and fine movement recognition of fingers, and has the advantage of being skilled in a short period of time, so it can be used as basic data for developing intelligent user interfaces.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.8 no.4
• /
• pp.43-52
• /
• 1998

We extract a hand region by using color information, which is an important feature for human vision to distinguish objects. Because pixel values in images are changed according to the luminance and lighting source, it is difficult to extract a hand region exactly without previous knowledge. We generate a hand skin model at learning stage, and extract a hand region from images by using the model. We also use a Kalman filter to consider changes of pixel values in a hand skin model. A Kalman filter restricts a search area for extracting a hand region at next frame also. The validity of the proposed method is proved by implementing the hand-region acquisition module.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.39-41
• /
• 2018

본 논문은 본인이 제작한 라는 인터랙티브 미디어 아트 작품에 관련한 글이다. 발전하는 디지털 기술 안에서 아날로그 감성을 이끌어내기 위한 작품 제작 방법으로 손으로 그린 나뭇잎을 입자로 사용한 파티클 시스템을 이용하였다. 그리고 NUI 인터페이스인 립모션 센서를 사용해 자연스러운 손 동작 인식을 하여 파티클 시스템과 연동하였다. 관람자는 바람을 일으키는 손 동작을 하며 가을 풍경과 같은 나뭇잎 파티클의 변화를 느끼게 되고, 계속되는 손동작에 따라 나타난 새로운 동영상을 감상하며 잃어버린 감성을 느끼게 된다. 아날로그 컨텐츠와 디지털 기술의 융합은 관람자에게 친근한 접근과 감성을 자극함으로써 인터렉티브 미디어 아트의 새로운 확장의 가능성을 보여준다.

• Proceedings of the IEEK Conference
• /
• 1999.11a
• /
• pp.483-486
• /
• 1999

In this paper, we present a real-time hand gesture recognition system that controls motion of a human avatar based on the pre-defined dynamic hand gesture commands in a virtual environment. Each motion of a human avatar consists of some elementary motions which are produced by solving inverse kinematics to target posture and interpolating joint angles for human-like motions. To overcome processing time of the recognition system for teaming, we use a Fuzzy Min-Max Neural Network (FMMNN) for classification of hand postures