Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Recognition and Generation of Facial Expression for Human-Robot Interaction

로봇과 인간의 상호작용을 위한 얼굴 표정 인식 및 얼굴 표정 생성 기법

  • 정성욱 (한국전자통신연구원) ;
  • 김도윤 (한국과학기술원 전자전산학과) ;
  • 정명진 (한국과학기술원 전자전산학과) ;
  • 김도형 (한국과학기술원 전자전산학과)
  • Published : 2006.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

In the last decade, face analysis, e.g. face detection, face recognition, facial expression recognition, is a very lively and expanding research field. As computer animated agents and robots bring a social dimension to human computer interaction, interest in this research field is increasing rapidly. In this paper, we introduce an artificial emotion mimic system which can recognize human facial expressions and also generate the recognized facial expression. In order to recognize human facial expression in real-time, we propose a facial expression classification method that is performed by weak classifiers obtained by using new rectangular feature types. In addition, we make the artificial facial expression using the developed robotic system based on biological observation. Finally, experimental results of facial expression recognition and generation are shown for the validity of our robotic system.

Keywords

References

  1. 정명진, 이희승, 김도형, '로봇의 얼굴 표정을 통한 감정 표현 기법,' 로봇공학회지, 제2권, 제3호, pp. 68-76, Summer 2005
  2. D. Evans, Emotion, Oxford University Press, New York, 2001
  3. C. Darwin and P. Ekman, The Expression of The Emotions in Man and Animals, Oxford University Press, New York, 1998
  4. P. Ekman and W. V. Friesen, Unmasking the Face, Malor Books, Cambridge, 2003
  5. M. Pantic and L. J. M. Rothkrantz, 'Automatic analysis of facial expressions: the state of the art,' IEEE Trans. on Pattern Recognition and Machine Intelligence, vol. 21, no. 12, pp. 1357-1362, 1999 https://doi.org/10.1109/34.895976
  6. Y. Wang, H. AI, B. Wu, and C. Huang, 'Real time facial expression recognition with adaboost,' Proc. of the 17th Int'l Conf. on Pattern Recognition, vol. 3, no. 3, pp. 926-929, Cambridge, UK, August 2004 https://doi.org/10.1109/ICPR.2004.1334680
  7. F. Hara, H. Akazawa and H. Kobayashi, 'Realistic facial expressions by SMA driven face robot,' Proc. of IEEE Int'l Workshop on Robot and Human Interactive Communication, pp. 504-511, 2001 https://doi.org/10.1109/ROMAN.2001.981954
  8. http://www.kobalab.com
  9. http://robotic.media.mit.edu/projects/Leonardo/Leo-intro.html
  10. http://iiae.utdallas.edu/projects/hanson.htm
  11. C. Breazeal, Designing Sociable Robots, The MIT Press, Cambridge, 2002
  12. C. Breazeal, 'How to build robots that make friends and influence people,' Proc. of the 1999 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, Kyongju, Korea, Oct. 1999, pp. 858-863 https://doi.org/10.1109/IROS.1999.812787
  13. http://www.ai.mit.edu/projects/humanoid-robotics-group/kismet/kismet.html
  14. A. Takanishi, H. Takanobu, I. Kato, and T. Umetsu, 'Development of the anthropomorphic head-eye robot WE-3RII with an autonomous facial expression mechanism,' Proc. of IEEE Int'l Conf. on Robotics and Automation, pp. 3255-3260, 1999 https://doi.org/10.1109/ROBOT.1999.774094
  15. H. Miwa, T. Okuchi, K. Itoh, H. Takanobu and A. Takanishi, 'A new mental model for humanoid robots for human friendly communication,' Proc. of the 2003 IEEE Int'l Conf. on Robotics and Automation, pp. 3588-3593, Sept. 2003 https://doi.org/10.1109/ROBOT.2003.1242146
  16. H. Miwa, T. Okuchi, H. Takanobu, and A. Takanishi, 'Development of a new human-like head robot WE-4,' Proc. of 2002 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, pp. 2443-2448, Oct. 2002 https://doi.org/10.1109/IRDS.2002.1041634
  17. H. Miwa, K. Itoh, M. Matsumoto, M. Zecca, H. Takanobu, S. Roccella, M. C. Carrozza, P. Dario, and A. Takanishi, 'Effective emotional expressions with emotion expression humanoid robot WE-4RII,' Proc. of 2004 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, pp. 2203-2208, Oct. 2004 https://doi.org/10.1109/IROS.2004.1389736
  18. http://www.takanishi.mech.waseda.ac.jp/reserach/
  19. http://www-2.cs.cmu.edu/~nursebot/
  20. http://www.research.philips.com/technologies/syst_softw/robotics
  21. A. J. N. van Breemen, 'Animation engine for believable interactive user-interface robots,' Proc. of IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2004 https://doi.org/10.1109/IROS.2004.1389845
  22. 정성욱, AdaBoost 기반 실시간 얼굴 표정 인식을 위한 효과적인 사각 특징점 추출, 석사학위논문, 한국과학기술원, 2005
  23. P. Viola and M. Jones, 'Rapid object detection using a boosted cascade of simple features,' Proc. of IEEE Int'l Conf. on Computer Vision and Pattern Recognition, pp. 511-518, 2001 https://doi.org/10.1109/CVPR.2001.990517
  24. D. H. Kim, D. Kim and M. J. Chung, 'An active vision system with facial expressions,' Proc. of 8th Int'l Conf. on Control, Automation, Robotics and Vision, pp. 1553-1558, Dec. 2004 https://doi.org/10.1109/ICARCV.2004.1469082