• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.41 no.3
• /
• pp.103-114
• /
• 2004

This paper deals with a system that is capable of recognizing hand-signals in 3-dimensional space. The system uses 2 color cameras as input devices. Vision-based gesture recognition system is known to be user-friendly because of its contact-free characteristic. But as with other applications using a camera as an input device, there are difficulties under complex background and varying illumination. In order to detect hand region robustly from a input image under various conditions without any special gloves or markers, the paper uses previous position information and adaptive hand color model. The paper defines a hand-signal as a combination of two basic elements such as 'hand pose' and 'hand trajectory'. As an extensive classification method for hand pose, the paper proposes 2-stage classification method by using 'small group concept'. Also, the paper suggests a complementary feature selection method from images from two color cameras. We verified our method with a hand-signal application to our driving simulator.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.10
• /
• pp.2180-2188
• /
• 2009

This paper is study on real-time hand gesture recognition system based on vision for intelligent robot control. We are proposed a recognition system using PCA and BP algorithm. Recognition of hand gestures consists of two steps which are preprocessing step using PCA algorithm and classification step using BP algorithm. The PCA algorithm is a technique used to reduce multidimensional data sets to lower dimensions for effective analysis. In our simulation, the PCA is applied to calculate feature projection vectors for the image of a given hand. The BP algorithm is capable of doing parallel distributed processing and expedite processing since it take parallel structure. The BP algorithm recognized in real time hand gestures by self learning of trained eigen hand gesture. The proposed PCA and BP algorithm show improvement on the recognition compared to PCA algorithm.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2007.05a
• /
• pp.459-462
• /
• 2007

본 연구에서는 동적 수신호 인식문제를 위하여 CNN 모델을 사용한 특징추출 기법과, FMM 신경망을 사용한 특징 분석 기법을 상호 결합한 형태의 패턴 인식 모델을 제안한다. 수신호 인식을 위하여 영상패턴에서 대상물의 움직임 정보에 기초한 3 차원 형식의 데이터 표현 기법과, 이로부터 인식을 위한 특징추출 기법을 제시한다. 특징추출 모듈에서는 3 차원으로 확장된 구조의 수용영역을 고려한 CNN 모델을 제안하며, 이로부터 학습패턴에서 특징점의 공간적 변이에 대한 영향을 최소화할 수 있음을 고찰한다. 또한 인식효율의 개선을 위하여 방대한 양의 특징집합으로부터 효과적인 특징을 선별하기 위한 방법론으로서 WFMM 모델 기반의 특징분석 기법을 정의하고 이로부터 선별된 특징을 사용하는 인식 기법을 소개한다.

• Journal of Internet Computing and Services
• /
• v.15 no.4
• /
• pp.33-42
• /
• 2014

Hand-signal is an effective communication means in the situation where voice cannot be used for expression especially for soldiers. Vision-based approaches using cameras as input devices are widely suggested in the literature. However, these approaches are not suitable for soldiers that have unseen visions in many cases. in addition, existing special-glove approaches utilize the information of fingers only. Thus, they are still lack for soldiers' hand-signal recognition that involves not only finger motions, but also additional information such as the rotation of a hand. In this paper, we have designed and implemented a new recognition system for six military hand-signal motions, i. e., 'ready', 'move', quick move', 'crawl', 'stop', and 'lying-down'. For this purpose, we have proposed a finger-recognition method and motion-recognition methods. The finger-recognition method discriminate how much each finger is bended, i. e., 'completely flattened', 'slightly flattened', 'slightly bended', and 'completely bended'. The motion-recognition algorithms are based on the characterization of each hand-signal motion in terms of the three axes. Through repetitive experiments, our system have shown 91.2% of correct recognition.

• Proceedings of the Korean Information Science Society Conference
• /
• 2007.06c
• /
• pp.287-292
• /
• 2007

본 연구에서는 동적 수신호 패턴에 대한 효과적인 인식을 위하여, 특징추출 단계와 패턴 분류 단계의 두 모듈로 이루어지는 복합형 신경망 모델을 제안한다. 특징추출 모듈을 위하여 고유의 특징표현 기법과 3차원 수용영역 구조의 CNN 모델을 제안한다. 이는 3차원 형식의 데이터로 표현되는 수신호 패턴으로부터 특징점의 공간적 변이뿐만 아니라 시간적 변이에 강인한 특징추출 기능을 제공한다. 패턴 분류 모듈에서는 효율적인 학습과 인식 기능을 위하여 수정된 구조의 GFMM 모델을 제안한다. 또한 학습패턴의 빈도를 고려한 활성화 특성과 학습 방법을 정의함으로써 기존의 GFMM 모델이 갖는 단점인 학습결과가 학습순서에 종속되는 특성과 비정상적 패턴 및 노이즈 패턴에 민감한 현상을 개선한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.677-678
• /
• 2020

본 연구는 자율주행 시대에 자동차의 외부통제를 가능하게 하는데 목적이 있다. 자율주행 자동차의 외부통제를 하기 위해 교통경찰 수신호를 사용한다. 교통이라는 특별한 상황을 고려하여 실시간 객체 검출이 가능한 YOLO모델을 사용하였고, 수신호 데이터 학습을 위해 Data Argumentation 기법을 사용하여 데이터를 확보한 후 이를 바탕으로 YOLO모델을 학습하였다. 학습된 YOLO모델을 이용하여 교통의 흐름에서 교통 통제자를 실시간으로 검출하였다. 이후 검출된 객체를 이용하여 객체 확인 알고리즘과 수신호 의미파악 알고리즘을 사용하여 수신호의 의미를 파악하고 이를 사용자에게 전달한다. 이와 같은 시스템을 통해 자율주행 자동차에 돌발 상황 발생 시 보다 정확하고 빠르게 교통의 흐름을 정상화 할 수 있는 장점이 있다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2006.11a
• /
• pp.43-46
• /
• 2006

본 논문에서는 호프변환을 이용한 실시간 수신호 인식시스템에서 대상영역 분할의 오차와 추출된 특징의 위치 변화등의 영향을 개선하는 방법론을 제안한다. 원형호프변환을 기반으로 생성한 특징정보로부터 CNN(Convolution Neural Network) 모델의 계층적 구조를 통하여 단계적으로 일련의 특징지도가 추출된다. CNN 모델에서 샘플링 계층의 연결구조는 특징의 위치 변화에 강인한 추출기능을 지원하며, 상위계층에서 보다 함축적인 특징지도를 생성하게 된다. 원형 호프 변환은 손의 형태학적 주요 포인트를 효과적으로 추출할 수 있게 하고 또한 입력 영상의 회전으로 인한 제약을 극복할 수 있게 한다. 본 연구에서는 제안된 이론을 TV 원격 제어를 위한 수신호 인터페이스 시스템을 대상으로 적용함으로써 그 유용성을 고찰한다.

• KIPS Transactions on Computer and Communication Systems
• /
• v.5 no.10
• /
• pp.331-338
• /
• 2016

In this paper, we propose a system for transmitting army hand signals using motion sensors. The proposed system consists of a squad commander device, squad member devices, and a server. The squad command device and squad member device have been implemented using a micro arduino, an accelerometer sensor, and a gyroscope sensor, and the server has been implemented using a Rasberry Pi 3. Because the devices are made in the form of band, they are lightweight and portable. The proposed system can transmit the hand signals through vibration in conditions of poor visibility. We have designed and implemented the squad member device to be able to recognize four military hand signals. Through experiments, the proposed system have shown 88.82% of correct recognition. In conclusion, we expect to increase effectiveness of army operations and survival rate of soldiers.

• Journal of Intelligence and Information Systems
• /
• v.16 no.2
• /
• pp.95-108
• /
• 2010

In this paper, we present a hybrid neural network model for dynamic hand gesture recognition. The model consists of two modules, feature extraction module and pattern classification module. We first propose a modified CNN(convolutional Neural Network) a pattern recognition model for the feature extraction module. Then we introduce a weighted fuzzy min-max(WFMM) neural network for the pattern classification module. The data representation proposed in this research is a spatiotemporal template which is based on the motion information of the target object. To minimize the influence caused by the spatial and temporal variation of the feature points, we extend the receptive field of the CNN model to a three-dimensional structure. We discuss the learning capability of the WFMM neural networks in which the weight concept is added to represent the frequency factor in training pattern set. The model can overcome the performance degradation which may be caused by the hyperbox contraction process of conventional FMM neural networks. From the experimental results of human action recognition and dynamic hand gesture recognition for remote-control electric home appliances, the validity of the proposed models is discussed.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.4
• /
• pp.30-37
• /
• 2011

This paper proposes a language set of hand motions for enhancing the performance of vision-based hand signal recognizer. Based on the statistical analysis of the angular tendency of hand movements in sign language and the hand motions in practical use, we construct four motion primitives as building blocks for basic hand motions. By combining these motion primitives, we design a discernable 'fundamental hand motion set' toward increasing the hand signal recognition. To demonstrate the validity of proposed designing method, we develop a 'fundamental hand motion set' recognizer based on hidden Markov model (HMM). The recognition system showed 99.01% recognition rate on the proposed language set. This result validates that the proposed language set enhances discernaility among the hand motions such that the performance of hand signal recognizer is improved.