• 한국멀티미디어학회논문지
• /
• 제16권12호
• /
• pp.1393-1402
• /
• 2013

Hand gesture is one of the most popular communication methods in everyday life. In human-computer interaction applications, hand gesture recognition provides a natural way of communication between humans and computers. There are mainly two methods of hand gesture recognition: glove-based method and vision-based method. In this paper, we propose a vision-based hand gesture recognition method using Kinect. By using the depth information is efficient and robust to achieve the hand detection process. The finger labeling makes the system achieve pose classification according to the finger name and the relationship between each fingers. It also make the classification more effective and accutate. Two kinds of gesture sets can be recognized by our system. According to the experiment, the average accuracy of American Sign Language(ASL) number gesture set is 94.33%, and that of general gestures set is 95.01%. Since our system runs in real-time and has a high recognition rate, we can embed it into various applications.

• 제어로봇시스템학회논문지
• /
• 제20권6호
• /
• pp.593-598
• /
• 2014

Hand gesture recognition based on vision is a challenging task in human-robot interaction. The sign language of finger spelling alphabets has been tested as a kind of hand gesture. In this paper, we test hand gesture recognition by detecting the contour shape and orientation of hand with visual image. The method has three stages, the first stage of finding hand component separated from the background image, the second stage of extracting the contour feature over the hand component and the last stage of comparing the feature with the reference features in the database. Here, finger spelling alphabets are used to verify the performance of our system and our method shows good performance to discriminate finger alphabets.

• 한국정보전자통신기술학회논문지
• /
• 제4권3호
• /
• pp.197-201
• /
• 2011

최근 들어 인간과 컴퓨터와의 상호작용을 위한 인터페이스 분야에서 컴퓨터 시각 방식으로 손짓을 인식하고자 하는 연구가 널리 진행되고 있다. 손짓 인식에서 가장 중요한 이슈는 손가락의 방향성을 효율적으로 인식하는 것이다. 손짓 형상으로부터 얻은 원시형상요소들의 방향성은 손짓에 관한 중요한 정보를 내포하고 있으므로 본 논문에서는 형태론적 형상분해 기법을 사용하여 얻은 주 원시형상요소를 포함하는 원의 반경을 증가시키면서 부 원시형상요소와의 교차점을 구하여 손가락의 주 방향성을 인식하는 알고리즘을 제안하고, 실험을 통하여 그 유용성을 증명하였다.

• 한국인터넷방송통신학회논문지
• /
• 제13권4호
• /
• pp.91-97
• /
• 2013

본 논문에서는 단일 카메라를 사용하여 사용자 제스쳐 명령을 사용자의 손가락 개수 및 이동 방향을 기반으로 인식하는 손동작 리모트 컨트롤러 인터페이스를 구현한다. 구현한 손동작 리모트 컨트롤러 인터페이스는 손 영역의 추출을 위해서 RGB 컬러모델로부터 YCbCr 컬러모델로의 색 변환에 의한 색차정보를 이용하고, 추출된 손 영역의 중심에서 이중 원형 추적(Double Circle Tracing)에 의한 교차정보를 이용하여 손가락 개수 및 위치 정보를 계산한다. 특히, 제안하는 방법에서 지속적 사용자 명령은 제스쳐 단일 형상의 방향 이동에 의해서 반복 수행이 가능하고, 손가락 위치 정보는 사용자 경험(UX: User eXperience)에 기반 하여 사용자 명령을 증폭 수행한다. 또한 Intel사(社)의 OpenCV 라이브러리를 기반으로 C++언어를 사용하여 구현된 손동작 컨트롤러 인터페이스의 성능 평가를 위해서는 상용 비디오 플레이어 프로그램에 적용하여 각 컨트롤 모드별 인식률을 측정한 결과 평균 89%의 인식률을 보였다.

• 한국HCI학회:학술대회논문집
• /
• 한국HCI학회 2008년도 학술대회 1부
• /
• pp.847-850
• /
• 2008

오늘날 인간은 기계와의 상호의사소통을 이용하여 기계를 더욱 발전시켜가고 있다. 시각기반인지시스템을 비롯한 여러 HCI(Human Computer Interaction)시스템 중 손가락 제스처를 인식, 추적하는 기술은 HCI 시스템에서 매우 중요한 부분을 차지하고 있다. 이 논문에서는 손가락을 구분하기 위해서 제한된 배경과 복잡한 배경에서의 손가락을 구분할 뿐만 아니라 배경과 전경을 분리하는 차영상을 이용하여 더욱더 효과적으로 손가락을 구분해내는 방법을 이용한다. 손가락을 구분하기 위해서는 미리 정의해놓은 손가락 끝 이미지들과 Template-Matching 을 통하여 손가락을 인식한다. 그리고 인식된 손가락을 추적한 후 미리 정의해놓은 제스처들과 비교함으로써 제스처를 인식한다. 이 논문에서는 차영상과 Template Matching 반을 이용하지 않고 미리 관심영역을 획득한 후 그 영역 안에서 Template Matching 을 수행한다. 그래서, 실행속도 및 반응속도를 줄이는 데 중점을 두고 있으며 더욱 효과적으로 제스처를 인식하는 방법에 대해 제안한다.

• 대한인간공학회지
• /
• 제31권5호
• /
• pp.629-636
• /
• 2012

Objective: The purpose of this study is to compare the characteristics of single and double finger gestures related on the web browser and to extract the appropriate finger gestures. Background: As electronic equipment emphasizes miniaturization for improving portability various interfaces are being developed as input devices. Electronic devices are made smaller, the gesture recognition technology using the touch-based interface is favored for easy editing. In addition, user focus primarily on the simplicity of intuitive interfaces which propels further research of gesture based interfaces. In particular, the fingers in these intuitive interfaces are simple and fast which are users friendly. Recently, the single and double finger gestures are becoming more popular so more applications for these gestures are being developed. However, systems and software that employ such finger gesture lack consistency in addition to having unclear standard and guideline development. Method: In order to learn the application of these gestures, we performed the sketch map method which happens to be a method for memory elicitation. In addition, we used the MIMA(Meaning in Mediated Action) method to evaluate gesture interface. Results: This study created appropriate gestures for intuitive judgment. We conducted a usability test which consisted of single and double finger gestures. The results showed that double finger gestures had less performance time faster than single finger gestures. Single finger gestures are a wide satisfaction difference between similar type and difference type. That is, single finger gestures can judge intuitively in a similar type but it is difficult to associate functions in difference type. Conclusion: This study was found that double finger gesture was effective to associate functions for web navigations. Especially, this double finger gesture could be effective on associating complex forms such as curve shaped gestures. Application: This study aimed to facilitate the design products which utilized finger and hand gestures.

• 한국멀티미디어학회논문지
• /
• 제8권6호
• /
• pp.768-775
• /
• 2005

For sign languages are main communication means among hearing-impaired people, there are communication difficulties between speaking-oriented people and sign-language-oriented people. Automated sign-language recognition may resolve these communication problems. In sign languages, finger spelling is used to spell names and words that are not listed in the dictionary. There have been research activities for gesture and posture recognition using glove-based devices. However, these devices are often expensive, cumbersome, and inadequate for recognizing elaborate finger spelling. Use of colored patches or gloves also cause uneasiness. In this paper, a vision-based finger spelling recognition system is introduced. In our method, captured hand region images were separated from the background using a skin detection algorithm assuming that there are no skin-colored objects in the background. Then, hand postures were recognized using a two-dimensional grid analysis method. Our recognition system is not sensitive to the size or the rotation of the input posture images. By optimizing the weights of the posture features using a genetic algorithm, our system achieved high accuracy that matches other systems using devices or colored gloves. We applied our posture recognition system for detecting Korean Sign Language, achieving better than $93\%$ accuracy.

• 제어로봇시스템학회논문지
• /
• 제21권2호
• /
• pp.150-156
• /
• 2015

In this paper, a marionette control system using wrist and finger gestures through an IMU sensor is studied. The signals from the sensor device are conditioned and recognized, then the commands are sent to the 8 motors of the marionette via Bluetooth (5 motors control the motion of the marionette, and 3 motors control the location of the marionette). It is revealed that the degree of freedom of fingers are not independent from each other, therefore, some gestures are hardly made. Gesture mode changes for difficult postures of the fingers in cases of a lack of finger DOF are proposed. Therefore, the gesture mode change switches the assignment of gesture as required. Experimental results show that gesture mode change is successful for appropriate postures of a marionette.

• 한국정보통신학회논문지
• /
• 제19권12호
• /
• pp.2956-2962
• /
• 2015

본 논문에서는 저가의 웹 카메라를 사용하여 영상을 입력받아 손 부분 영상을 추출한 후 동심원 추적 알고리즘을 사용하여 손가락 동작을 인식하는 기법을 제안한다. 제안하는 알고리즘은 기존의 인터페이스처럼 손에 별도의 센서를 부착하지 않음으로 신체에 불편함을 주지 않는다. 또한 저가인 웹 카메라를 사용해서 비용적인 측면에서 활용성을 증가 시켰다. 동심원 추적 알고리즘을 사용하여 펴진 손가락의 개수뿐 만아니라, 손가락 접힘 여부 정보를 효율적으로 추출할 수 있다. 본 논문에서 제안한 알고리즘을 사용하여, 손가락 동작을 평균 95.48%의 정확도로 인식할 수 있음을 확인했으며, 손을 사용한 HCI 및 원격 제어 명령어 입력수단으로 활용가능성을 확인하였다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제9권1호
• /
• pp.378-390
• /
• 2015

Image projectors can turn any surface into a display. Integrating a surface projection with a user interface transforms it into an interactive display with many possible applications. Hand gesture interfaces are often used with projector-camera systems. Hand detection through color image processing is affected by the surrounding environment. The lack of illumination and color details greatly influences the detection process and drops the recognition success rate. In addition, there can be interference from the projection system itself due to image projection. In order to overcome these problems, a gesture interface based on depth images is proposed for projected surfaces. In this paper, a depth camera is used for hand recognition and for effectively extracting the area of the hand from the scene. A hand detection and finger tracking method based on depth images is proposed. Based on the proposed method, a touch interface for the projected surface is implemented and evaluated.