정보처리학회논문지B (The KIPS Transactions:PartB)

한국정보처리학회 (Korea Information Processing Society)
권호 표지
DOI QR코드

DOI QR Code

상황에 민감한 베이지안 분류기를 이용한 얼굴 표정 기반의 감정 인식

Emotion Recognition Based on Facial Expression by using Context-Sensitive Bayesian Classifier

  • 김진옥 (대구한의대학교 정보경영대학 모바일콘텐츠학부)
  • 발행 : 2006.12.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

사용자의 상황에 따라 적절한 서비스를 제공하는 컴퓨팅 환경을 구현하려는 유비쿼터스 컴퓨팅에서 사람과 기계간의 효과적인 상호작용과 사용자의 상황 인식을 위해 사용자의 얼굴 표정 기반의 감정 인식이 HCI의 중요한 수단으로 이용되고 있다. 본 연구는 새로운 베이지안 분류기를 이용하여 상황에 민감한 얼굴 표정에서 기본 감정을 강건하게 인식하는 문제를 다룬다. 표정에 기반한 감정 인식은 두 단계로 나뉘는데 본 연구에서는 얼굴 특징 추출 단계는 색상 히스토그램 방법을 기반으로 하고 표정을 이용한 감정 분류 단계에서는 학습과 테스트를 효과적으로 실행하는 새로운 베이지안 학습 알고리즘인 EADF(Extended Assumed-Density Filtering)을 이용한다. 상황에 민감한 베이지안 학습 알고리즘은 사용자 상황이 달라지면 복잡도가 다른 분류기를 적용할 수 있어 더 정확한 감정 인식이 가능하도록 제안되었다. 실험 결과는 표정 분류 정확도가 91% 이상이며 상황이 드러나지 않게 얼굴 표정 데이터를 모델링한 결과 10.8%의 실험 오류율을 보였다.

In ubiquitous computing that is to build computing environments to provide proper services according to user's context, human being's emotion recognition based on facial expression is used as essential means of HCI in order to make man-machine interaction more efficient and to do user's context-awareness. This paper addresses a problem of rigidly basic emotion recognition in context-sensitive facial expressions through a new Bayesian classifier. The task for emotion recognition of facial expressions consists of two steps, where the extraction step of facial feature is based on a color-histogram method and the classification step employs a new Bayesian teaming algorithm in performing efficient training and test. New context-sensitive Bayesian learning algorithm of EADF(Extended Assumed-Density Filtering) is proposed to recognize more exact emotions as it utilizes different classifier complexities for different contexts. Experimental results show an expression classification accuracy of over 91% on the test database and achieve the error rate of 10.6% by modeling facial expression as hidden context.

키워드

참고문헌

  1. P. Ekman and W. Fresen, 'Facial Action Coding System,' Consulting Psychologist Press, 1978
  2. K. Mace, 'Recognition of Facial Expression from Optical Flow,' IEICE Transactions. Vol.E74, No.10, pp.3474-3483, 1991
  3. M. Pantie, L. J. M. Rothkrantz, 'Automatic Analysis fo Facial Expressions: The state of the art,' IEEE Trans. Pattern Anal. Mach. Intel., Vol.22. No.12, pp.1424-1445, 2000 https://doi.org/10.1109/34.895976
  4. I. Essa, A. Pentland, 'Coding, Analysis, Interpretation and Recognition of Facial Expressions,' IEEE Trans. PAMI, Vol.19, No.7, pp. 757-763, 1997 https://doi.org/10.1109/34.598232
  5. C. Darwin, 'The Expression of the Emotions in Man and Animals,' Univ. of Chicgo Press, 1965
  6. D. Keltner and P. Ekman, 'Facial Expression of Emotion,' Handbook of Emotions, pp.236-249, 2000
  7. Y. Tian, T. Kanade, J. F. Cohn, 'Recognizing Action Unts for Facial Expression Analysis,' IEEE Trans. PAMI, Vol.23, No.2, pp.97-115, 2001 https://doi.org/10.1109/34.908962
  8. T. Kanade, J. Cohn, Y. Tian, 'Comprehensive Database for Facial Expression Analysis,' Proc. IEEE Conf. FGR, pp.46-53, 2000 https://doi.org/10.1109/AFGR.2000.840611
  9. M. S. Bartlett, 'Machine Learning Methods for Fully Automatic Recognition of Facial Expressions and Actions,' Proc. IEEE Conf. SMC, pp.592-597, 2004 https://doi.org/10.1109/ICSMC.2004.1398364
  10. M. F. Valstar, M. Pantic and I. Patras, 'Motion History for Facial Action Detection from Face Video,' Proc. IEEE Conf. SMC, pp.635-640, 2004 https://doi.org/10.1109/ICSMC.2004.1398371
  11. C. Padget, G. Cottrell, 'Identifying Emotion in Static Imges,' Proc. 2nd Joint Symp. Neural Computation, Vol.5, pp.91-101, 1997
  12. G. Gottrell, J. Metcalfe, 'Face, Gender and Emotion Recognition using Holons,' Adv. Neural Inform. Process. Syst. Vol. 3, pp. 564-571, 1991
  13. A. Rahardja, A. Sowmya, W. Wilson, 'A Neural Network Approach to Compnent vs. Holistic Recognition of Facial Expressions in Images,' SPIE Proc. Intelligent Robots and Computer Vision X : Algorithms and Techniques, Vol.1607, pp.62-70, 1991 https://doi.org/10.1117/12.57047
  14. A. Lanitis, C. Taylor, T. Cootes, 'Automatic Interpretation and Coding ace Images using Flexible Models,' IEEE Trans. Pattern Anal. Mach. Intel., Vol. 19, No.7. pp.743-756, 1997 https://doi.org/10.1109/34.598231
  15. M. J. Lyongs, J. Budynek, S. Akamatsu, 'Automatic classification of single facial images,' IEEE Trans. Pattern Anal. Mach, Intel., Vol.21, No.12, pp.1357-1362, 1999 https://doi.org/10.1109/34.817413
  16. Z. Zhang, M. Lyongs, M. Schuster, S. Akamatsu, 'Feature Comparison between Geometry Based and Gabor-Wavelets Based Facial Expression Recognition using Multi-layer Perceptron,' Proc. 3rd IEEE Int. Conf. Automatic Face and Gesture Recognition, pp.454-459, 1998 https://doi.org/10.1109/AFGR.1998.670990
  17. G. Guo, C. R. Dyer, 'Learning from Examples in the Small Sample Case: Face Expression Recognition,' IEEE Trans. On Systems, Man and Cybernetics, Part B: Cybernetics, Vol.35, No.3, pp.477-489, 2005 https://doi.org/10.1109/TSMCB.2005.846658
  18. A. Pentland, 'Looking at People: Sensing for ubiquitous and wearable computing,' IEEE Trans. on PAMI, Vol. 22, No.1, January. 2000 https://doi.org/10.1109/34.824823
  19. J. O. Kim, K. H. Jung, C. H. Chung, 'On a Face Recognition by the Modified Nonsingular Discriminant Analysis for a Ubiquitous Computing,' Lecture Notes in Computer Science 3980, Vol.1, pp. 929-937, May., 2006 https://doi.org/10.1007/11751540_101
  20. 김진옥, '빛보상과 외형기반의 특징을 이용한 얼굴 특징 검출,' 한국인터넷정보학회 논문지, 제7권 제4호, pp. 143-153, 2006
  21. T. Minka, 'A Family of Algorithms for Approximate Bayesian Inference,' Ph.D. Thesis, MIT, 2001
  22. M. Harries, K. Horn, 'Learing Static Concepts in Domains with Hidden Changes in Context,' 13th ICML, workshop on Learing in Context Sensitive Domains, Italy, 1996
  23. H. J. Kushner, A. S. Budhiraja, 'A Nonlinear Filtering Algorithm based on an Appoximation of the Conditional Distribution,' IEEE Trans. Automatic Control, Vol.45, pp.580-585, 2000 https://doi.org/10.1109/9.847749
  24. M. J. Lyons, S. Akamatsu, M. Kamachi, J. Gyoba, 'Coding Facial Expressions with Gabor Wavelets,' Proceedings, Third IEEE International Conference on Automatic Face and Gesture Recognition, pp.200-205, 1998 https://doi.org/10.1109/AFGR.1998.670949

피인용 문헌

  1. A Study on Visual Perception based Emotion Recognition using Body-Activity Posture vol.18B, pp.5, 2011, https://doi.org/10.3745/KIPSTB.2011.18B.5.305
  2. Model based Facial Expression Recognition using New Feature Space vol.17B, pp.4, 2010, https://doi.org/10.3745/KIPSTB.2010.17B.4.309