KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Gesture Spotting by Web-Camera in Arbitrary Two Positions and Fuzzy Garbage Model

임의 두 지점의 웹 카메라와 퍼지 가비지 모델을 이용한 사용자의 의미 있는 동작 검출

  • Received : 2012.07.25
  • Accepted : 2012.09.05
  • Published : 2012.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Many research of hand gesture recognition based on vision system have been conducted which enable user operate various electronic devices more easily. 3D position calculation and meaningful gesture classification from similar gestures should be executed to recognize hand gesture accurately. A simple and cost effective method of 3D position calculation and gesture spotting (a task to recognize meaningful gesture from other similar meaningless gestures) is described in this paper. 3D position is achieved by calculation of two cameras relative position through pan/tilt module and a marker regardless with the placed position. Fuzzy garbage model is proposed to provide a variable reference value to decide whether the user gesture is the command gesture or not. The reference is achieved from fuzzy command gesture model and fuzzy garbage model which returns the score that shows the degree of belonging to command gesture and garbage gesture respectively. Two-stage user adaptation is proposed that off-line (batch) adaptation for inter-personal difference and on-line (incremental) adaptation for intra-difference to enhance the performance. Experiment is conducted for 5 different users. The recognition rate of command (discriminate command gesture) is more than 95% when only one command like meaningless gesture exists and more than 85% when the command is mixed with many other similar gestures.

각종 지능형 전자장비의 개발과 사용자 편의성 증대를 위해 영상기반의 손 동작 인식시스템이 다양하게 개발, 적용되고 있다. 손 동작 인식을 위해 손의 3차원 위치를 계산하고 오 동작 방지를 위해 명령 동작을 다른 유사동작과 구분하여 정확히 검출해야 한다. 본 논문에서는 설치가 쉽고 저렴한 비용으로 3차원 위치를 계산하는 시스템과 다양한 유사 동작 중 정의된 동작만을 검출해 내는 방법에 대해 다룬다. 팬/틸트 가능한 두 대의 USB 카메라와 표식을 이용하여 카메라를 임의의 위치에 두더라도 부착된 표식을 통해 자동으로 두 카메라간 상대위치를 구해 3차원 위치를 계산할 수 있다. 사용자의 명령 동작을 다른 유사 동작과 구분하기 위해 퍼지 가비지 모델을 개발 하였는데 퍼지 명령모델과 가비지 모델 두 가지를 이용하여 행동 인식에 대한 가변적 문턱 값을 구할 수 있다. 또한 두 단계의 적응 과정을 통해 각 사용자마다 다르게 나타나는 행동 특성 및 동일 사용자가 환경에 따라 다르게 나타내는 행동 특성을 반영 하여 성능을 개선한다. 개발된 시스템을 5명의 사용자를 대상으로 실험을 실시하였는데 명령 동작과 하나의 유사동작만 있을 경우 95% 이상, 다양한 유사동작이 혼재되어 있을 경우 85%이상의 인식률(명령 동작 검출)을 보였다.

Keywords

References

  1. Matthew Turk, "Computer Vision in the Interface," Communications of the ACM-Multimodal interfaces that flex, adapt, and persist, Vol.47, No.1, pp.60-67, 2004.
  2. Jun-Hyeong Do, Jung-Bae Kim, Kwang-Hyun Park, Won-Chul Bang and Z.Zenn Bien, "Soft Remote Control System using Hand Pointing Gesture," International Journal of Human-friendly Welfare Robotic Systems, Vol.3, No.1, pp. 27-30, 2002.
  3. Hyoyoung Jang, Jun-Hyeong Do, Jinwoo Jung, Kwang-Hyun Park, and Z. Zenn Bien, "View-invariant Hand-posture Recognition Method for Soft-Remocon System," in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2004), Alberat, Canada, 2004, pp.295-300.
  4. Z. Zenn Bien, Kwang-Hyun Park, Jin-Woo Jung and Jun-Hyeong Do, "Intention Reading is Essential in Human-friendly Interfaces for the Elderly and the Handicapped," IEEE Transactions on Industrial Electronics, Vol.52, No.6, pp.1500-1505, 2005. https://doi.org/10.1109/TIE.2005.858734
  5. Dimitar H. Stefanov, Z. Zenn Bien, and Won-Chul Bang, "The Smart House for Older Persons and Persons With Physical Disabilities: Structure, Technology Arrangements, and Perspectives," IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol.12, No.2, pp.228-250, 2004. https://doi.org/10.1109/TNSRE.2004.828423
  6. Jun-Hyeong Do, Hyoyoung Jang, Sung Hoon Jung, Jinwoo Jung and Zeungnam Bien, "Soft Remote Control System in the Intelligent Sweet Home," in proceeding of the International Conference on Intelligent Robots and Systems, Edmonton, Canada, 2005, pp.2193-2198.
  7. Kevin M. Passino, Stephen Yurkovich, Fuzzy Control, ADDISON-WESLEY, 1998.
  8. M. Kohler, "Vision Based Remote Control in Intelligent Home Environments," in Proceedings of 3D Image Analysis and Synthesis, Erlangen, Germany, 1996, pp.147-154.
  9. 한정수, "새로운 특징 집합 선택 방법과 근전도 신호 인식에의 응용", 박사학위논문, 한국과학기술원, 2006.
  10. 변증남, "퍼지논리 제어", 홍릉과학출판사, 1997.
  11. T.K. Teng, J.S. Shieh, and C.S. Chen, "Genetic algorithms applied in online autotuning PID parameters of a liquid-level control system," Transaction of the Institute of Measurement and Control, Vol.25, No.5, pp.433-450, 2003. https://doi.org/10.1191/0142331203tm0098oa
  12. Hsin-Chia Fu, Hung-Yuan Chang, Yeong Yuh Xu, and H.-T. Pao, "User Adaptive Handwriting Recognition by Self-Growing Probabilistic Decision-Based Neural Networks," IEEE Transactions on Neural Networks, Vol.11, No.6, pp.1373-1384, 2000. https://doi.org/10.1109/72.883451
  13. Ahcene Habbi, Mimoun Zelmat, "An Improved Self-Tuning Mechanism of Fuzzy Control by Gradient Descent Method," in proceeding of the 17th European Simulation Multiconference ESM 2003, Nottinghan, England, 2003, pp.43-47.
  14. R.J. Marks II, S. Oh, P. Arabshahi, T.P. Caudell, J.J. Choi and B.G. Song, "Steepest Descent Adaptation of Min-Max Fuzzy If-Then Rules," in proceeding of the IEEE/INNS International Joint Conference on Neural Networks, Beijing, China, 1992, pp.471-477.
  15. Payman Arabshahi, Robert J. Marks, Seho Oh, Thomas P. Caudell, J. J. Choi, and Bong-Gee Song, "Pointer Adaptation and Pruning of Min-Max Fuzzy Inference and Estimation," IEEE Trans. Circuits and systems-II: Analog and Digital Signal Processing, Vol.44, No.9, pp.696-709, 1997. https://doi.org/10.1109/82.624992