Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Motion Control of a Mobile Robot Using Natural Hand Gesture

자연스런 손동작을 이용한 모바일 로봇의 동작제어

  • Kim, A-Ram (Department of Advanced Engineering, Graduate School, Kyungnam University) ;
  • Rhee, Sang-Yong (Department of Computer Engineering, Kyungnam University)
  • Received : 2014.01.24
  • Accepted : 2014.02.16
  • Published : 2014.02.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a method that gives motion command to a mobile robot to recognize human being's hand gesture. Former way of the robot-controlling system with the movement of hand used several kinds of pre-arranged gesture, therefore the ordering motion was unnatural. Also it forced people to study the pre-arranged gesture, making it more inconvenient. To solve this problem, there are many researches going on trying to figure out another way to make the machine to recognize the movement of the hand. In this paper, we used third-dimensional camera to obtain the color and depth data, which can be used to search the human hand and recognize its movement based on it. We used HMM method to make the proposed system to perceive the movement, then the observed data transfers to the robot making it to move at the direction where we want it to be.

오늘날 일상생활에서 인간과 함께 생활하는 로봇들은 자연스러운 의사소통 방법이 요구된다. 따라서 기존의 단순한 로봇 제어 방식을 이용하여 제어하는 것 보다 실제 사람과 상호작용 하는 것과 같은 방식의 제어방식이 요구되고 있다. 기존의 연구들은 사람의 행동 자체를 인식하는 것에 초점이 맞추어져 있어서 자연스러운 의사소통을 하기 어렵다. 본 논문에서는 모바일 로봇을 제어하는 방법으로 자연스러운 손동작을 은닉 마르코프 모델(HMM: hidden markov model) 과 퍼지추론을 이용하는 방법을 제안한다. 키넥트 센서를 이용해 색상 데이터와 깊이 데이터를 획득하고 사람의 손을 검색하고 HMM과 Mamdani 퍼지추론을 이용하여 손동작을 인식한다. 인식된 결과를 로봇에게 전달하여 원하는 방향으로 이동시킨다.

Keywords

References

  1. Jun-Hyeong Do, Hyoyoung Jang, Sung Hoon Jung, Jinwoo Jung, Zeungnam Bien, "Soft Remote Control System in the Intelligent Sweet Home," Proc. of IEEE Int. conf. on IROS, pp. 3984-3989, 2005.
  2. Kwonhyun Kim, Seungho Nam, Jungsoo Mok, and Jaeil Kwon, Understanding of Languages, Press of Korea National Open University, 2012.
  3. Shogo Okada, Yoichi Kobayashi, Satoshi Ishibashi, Toyoaki Nishida, "Incremental learning of hestures for human-robot interaction," AI & SOCIETY, vol. 25, Issue 2, pp. 155-168, 2010. https://doi.org/10.1007/s00146-009-0248-8
  4. B. R. C. Bedregal, Gracaliz, P. D Antonio, C. Rocha Costa, "Interval Fuzzy Rule-Based Hand Gesture Recognition," IMACS International Symposium on Scientific Computing, Computer Arithmetic and Validated Numerics, 2006.
  5. Hee-Deok Yang, A-Yeon Park, and Seong-Whan Lee, "Gesture Spotting and Recognition for Human-Robot Interaction," IEEE Transactions on Robots, vol. 23, no. 2, pp. 256-270, 2007. https://doi.org/10.1109/TRO.2006.889491
  6. Akihiro Mimura, Shinichi Nishibe and Shohei Kato, "Kinetic Chained Throwing Humanoid Robots using Reinforcement Learning," Proceedings of 12th International Symposium on Advanced Intelligent Systems, pp. 188-191, 2011.
  7. Akinori Wakabayashi, Satona Motomura and Shohei Kato, "Body Movement Control System for Humanoid Robot Based on Associative Motion Generation," Proceedings of 12th International Symposium on Advanced Intelligent Systems, pp. 192-195, 2011.
  8. Jong-Ho Kim, Yo-Seop Yun, Tae-Young Kim and Cheol-Su Lim, "Human Primitive Motion Recognition Based on the Hidden Markov Models." Journal of Korea Multimedia Society, vol. 12, no. 4, 2009.
  9. Il-Myung Kim, Wan-Cheol Kim, Kyoung-Sil Yun and Jang-Myung Lee, "Navigation of a Mobile Robot Using Hand Gesture Recognition," Journal of Control, Automation and Systems Engineering, vol. 8, no. 7, pp. 599-606, 2002. https://doi.org/10.5302/J.ICROS.2002.8.7.599
  10. Seok-Ju Hong, and Chil-Woo Lee, "Human-Computer Interaction Survey for Intelligent Robot," The Korea Contents Society, vol. 4, no. 2, pp. 507-511, 2006.
  11. Sang-Kyoon Kim, "Gesture Recognition using MHI Shape Information," Korean Society of Computer Information, vol. 16, no. 4, pp. 1-13, 2011. https://doi.org/10.9708/jksci.2011.16.4.001
  12. M. Elmezain, A. Al-Hamadi, J. Appenrodt and B. Michaelis, "A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory," ICPR 2008, pp. 1-4, 2008.
  13. In Cheol Kim, "Recognition of 3D gesture using partially tuned composited hidden Markov models," International Journal of Fuzzy Logic and Intelligent Systems, vol. 4, no. 2, pp. 236-240, 2004. https://doi.org/10.5391/IJFIS.2004.4.2.236
  14. Nomi Lee, "A Comparative Study on Hand Gestures between Koreans and Other Asians in Intercultural Nonverbal Communication," Korean Journal of Communication, vol. 16, no. 2, pp. 5-34, 2008.

Cited by

  1. Development of a Robotic Hand using Shape Memory Alloy Actuators vol.26, pp.2, 2016, https://doi.org/10.5391/JKIIS.2016.26.2.147