• Journal of Intelligence and Information Systems
• /
• 제16권2호
• /
• pp.95-108
• /
• 2010

In this paper, we present a hybrid neural network model for dynamic hand gesture recognition. The model consists of two modules, feature extraction module and pattern classification module. We first propose a modified CNN(convolutional Neural Network) a pattern recognition model for the feature extraction module. Then we introduce a weighted fuzzy min-max(WFMM) neural network for the pattern classification module. The data representation proposed in this research is a spatiotemporal template which is based on the motion information of the target object. To minimize the influence caused by the spatial and temporal variation of the feature points, we extend the receptive field of the CNN model to a three-dimensional structure. We discuss the learning capability of the WFMM neural networks in which the weight concept is added to represent the frequency factor in training pattern set. The model can overcome the performance degradation which may be caused by the hyperbox contraction process of conventional FMM neural networks. From the experimental results of human action recognition and dynamic hand gesture recognition for remote-control electric home appliances, the validity of the proposed models is discussed.

• Journal of KIISE:Software and Applications
• /
• 제35권4호
• /
• pp.265-279
• /
• 2008

The idea of using hand gestures for human-computer interaction is not new and has been studied intensively during the last dorado with a significant amount of qualitative progress that, however, has been short of our expectations. This paper describes a dynamic Bayesian network or DBN based approach to both two-hand gestures and one-hand gestures. Unlike wired glove-based approaches, the success of camera-based methods depends greatly on the image processing and feature extraction results. So the proposed method of DBN-based inference is preceded by fail-safe steps of skin extraction and modeling, and motion tracking. Then a new gesture recognition model for a set of both one-hand and two-hand gestures is proposed based on the dynamic Bayesian network framework which makes it easy to represent the relationship among features and incorporate new information to a model. In an experiment with ten isolated gestures, we obtained the recognition rate upwards of 99.59% with cross validation. The proposed model and the related approach are believed to have a strong potential for successful applications to other related problems such as sign languages.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• 제15권9호
• /
• pp.5440-5445
• /
• 2014

Many studies have examined robot control using human bio signals but complicated signal processing and expensive hardware are necessary. This study proposes a method to recognize a human's hand motion using a low-cost EMG sensor and Flex sensor. The method to classify movement of the hand and finger is determined from the change in output voltage measured through MCU. The analog reference voltage is determined to be 3.3V to increase the resolution of movement identification through experiment. The robotic hand is designed to realize the identified movement. The hand has four fingers and a wrist that are controlled using pneumatic cylinders and a DC servo motor, respectively. The results show that the proposed simple method can realize human hand motion in a remote environment using the fabricated robotic hand.

• Smart Media Journal
• /
• 제9권4호
• /
• pp.102-108
• /
• 2020

In this paper, we propose a real-time method of detecting hand motions and extracting the signal frame induced by EF(Electric Field) sensors. The signal induced by hand motion includes not only noises caused by various environmental sources as well as sensor's physical placement, but also different initial off-set conditions. Thus, it has been considered as a challenging problem to detect the motion signal and extract the motion frame automatically in real-time. In this study, we remove the PLN(Power Line Noise) using LPF with 10Hz cut-off and successively apply MA(Moving Average) filter to obtain clean and smooth input motion signals. To sense a hand motion, we use two thresholds(positive and negative thresholds) with offset value to detect a starting as well as an ending moment of the motion. Using this approach, we can achieve the correct motion detection rate over 98%. Once the final motion frame is determined, the motion signals are normalized to be used in next process of classification or recognition stage such as LSTN deep neural networks. Our experiment and analysis show that our proposed methods produce better than 98% performance in correct motion detection rate as well as in frame-matching rate.

• Journal of Advanced Navigation Technology
• /
• 제17권2호
• /
• pp.247-254
• /
• 2013

The task of 3D gesture recognition for controlling equipments is highly challenging due to the propagation of 3D smart TV recently. In this paper, the AdaBoost algorithm is applied to 3D gesture recognition by using Kinect sensor. By tracking time interval trajectory of hand, wrist and arm by Kinect, AdaBoost algorithm is used to train and classify 3D gesture. Experimental results demonstrate that the proposed method can successfully extract trained gestures from continuous hand, wrist and arm motion in real time.

• Journal of Internet Computing and Services
• /
• 제15권3호
• /
• pp.11-19
• /
• 2014

The natural user interface/experience (NUI/NUX) is used for the natural motion interface without using device or tool such as mice, keyboards, pens and markers. Up to now, typical motion recognition methods used markers to receive coordinate input values of each marker as relative data and to store each coordinate value into the database. But, to recognize accurate motion, more markers are needed and much time is taken in attaching makers and processing the data. Also, as NUI/NUX framework being developed except for the most important intuition, problems for use arise and are forced for users to learn many NUI/NUX framework usages. To compensate for this problem in this paper, we didn't use markers and implemented for anyone to handle it. Also, we designed multi-modal NUI/NUX framework controlling voice, body motion, and facial expression simultaneously, and proposed a new algorithm of mouse operation by recognizing intuitive hand gesture and mapping it on the monitor. We implement it for user to handle the "hand mouse" operation easily and intuitively.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 한국해양정보통신학회 2010년도 추계학술대회
• /
• pp.329-330
• /
• 2010

Classic game Pac-Man (Pacman) is playing a game using a somple hand gasture without using a keyboard or a mouse. In other words, it is a joystick game by motion to replace the arrow keys using the center coordinates of the hand. In addition, the pointer of hand is extracted by accepting images to MFC dialog using cam. Thus, movements of the monsters is to be replaced by hand movements. In this paper, smoothing, expansion, and erosion operation for the skin color extraction, and RGB images are converted to YCbCbr images.

• Journal of Institute of Control, Robotics and Systems
• /
• 제15권11호
• /
• pp.1122-1129
• /
• 2009

Recently taping robot with smart recognition function have been studied in the coil manufacturing field. Due to the difficulty of 3D surface processing from the complicated working environment, it is not easy to accomplish smart tape attachment motion with non-contact sensor. To solve these problems the applicable surface recognition algorithm and a flexible sensing device has been recommended. In this research, the fusion method between 1D displacement and 3D laser scanner is applied for robust tape attachment about cold rolled coil. With these sensors we develop a two-step exploration and the smart algorithm for the awareness of non-aligned coil's information. In the proposed robot system for tape attachment, the problem is reduced to coil's radius searching with laser displacement sensor at first, and then position and orientation detection with 3D laser scanner. To get the movement at the robot's base frame, the hand-eye compensation between robot's end effector and sensing device should be also carried out respectively. In this paper, we examine the auto-coordinate transformation method in the calibration step for the real environment usage. From the experimental results, it was shown that the taping motion of robot had a robust under the non-aligned cold rolled coil.

• Journal of Korea Game Society
• /
• 제13권2호
• /
• pp.29-38
• /
• 2013

Recently there has been an increasing interest on tangible games in which human motions are recognized rather than the handling of keyboards and mouses. Such games require a motion controller for recognizing the motions of users. In this paper, we analyze the characteristics of values of accelerator sensors which are generated by a user who perform a tennis swing while holding a smartphone with his/her hand, and propose a method for motion recognition based on DWT(Discrete Wavelet Transform). The proposed method enables a smartphone to serve as a motion controller, so that a user can enjoy a tangible tennis game without eliminates a need for buying the device. We developed a tennis game prototype using the proposed method. To our experiment, our method showed a high recognition rate and the usefulness in the game.

• Journal of Korea Game Society
• /
• 제15권1호
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.