Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Emotion Recognition and Expression System of Robot Based on 2D Facial Image

2D 얼굴 영상을 이용한 로봇의 감정인식 및 표현시스템

  • 이동훈 (중앙대학교 전자전기공학부) ;
  • 심귀보 (중앙대학교 전자전기공학부)
  • Published : 2007.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents an emotion recognition and its expression system of an intelligent robot like a home robot or a service robot. Emotion recognition method in the robot is used by a facial image. We use a motion and a position of many facial features. apply a tracking algorithm to recognize a moving user in the mobile robot and eliminate a skin color of a hand and a background without a facial region by using the facial region detecting algorithm in objecting user image. After normalizer operations are the image enlarge or reduction by distance of the detecting facial region and the image revolution transformation by an angel of a face, the mobile robot can object the facial image of a fixing size. And materialize a multi feature selection algorithm to enable robot to recognize an emotion of user. In this paper, used a multi layer perceptron of Artificial Neural Network(ANN) as a pattern recognition art, and a Back Propagation(BP) algorithm as a learning algorithm. Emotion of user that robot recognized is expressed as a graphic LCD. At this time, change two coordinates as the number of times of emotion expressed in ANN, and change a parameter of facial elements(eyes, eyebrows, mouth) as the change of two coordinates. By materializing the system, expressed the complex emotion of human as the avatar of LCD.

Keywords

References

  1. C. H. Park and K. B. Sim, 'The novel feature selection method based on emotion recognition system,' Lecture Notes in Computer Science(LNCS) puhlished in Springer Berlin/ Heidelberg, vol. 4115, pp. 731-740, Aug. 2006 https://doi.org/10.1007/11816102_77
  2. M. Kugler and H, S. Lopes, 'Using a chain of LVQ neural networks for pattern recognition of EEG signals related to intermittent photic-stimulation,' IEEE, vol. 2, no. 3, pp. 173-177, 2002 https://doi.org/10.1109/SBRN.2002.1181465
  3. K.S. Byun and K.B. Sim, 'Hybrid Reature extraction for the facial emotion recognition,' proc. of ICCAS 2004(The International Conference on Control, Automation, and Systems), pp. 1281-1285, Aug.2004
  4. H. J. Go, K. C. Kwak, D. J. Lee, and M.-G. Chun, ' Emotion recognition from the facial image and speech signal,' SICE Annual Conference in Fukui, August 4-6, 2003 https://doi.org/10.1109/SICE.2003.1323838
  5. L. C. Silva and S. C. Hui, 'Real-time facial feature extraction and emotion recognition,' IClCS-PCM, pp. 15-18, December 2003 https://doi.org/10.1109/ICICS.2003.1292676
  6. M. S . Jiajun, B. C. Chen, and N. Li, 'Audio-visual based emotion recognition-A new approach,' Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04) https://doi.org/10.1109/CVPR.2004.1315276
  7. R. C. Gonzalez, Digital Image Processing 2/E, Prentice Hall, 2003
  8. J. S. R . Jang, Neuro-Fuzzy and Soft Computing, Prentice Hall, 1996
  9. 오창석, 뉴로컴퓨터개론, 내하출판사, 2000