Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Facial Expression Classification through Covariance Matrix Correlations

  • Received : 2011.07.15
  • Accepted : 2011.09.05
  • Published : 2011.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper attempts to classify known facial expressions and to establish the correlations between two regions (eye + eyebrows and mouth) in identifying the six prototypic expressions. Covariance is used to describe region texture that captures facial features for classification. The texture captured exhibit the pattern observed during the execution of particular expressions. Feature matching is done by simple distance measure between the probe and the modeled representations of eye and mouth components. We target JAFFE database in this experiment to validate our claim. A high classification rate is observed from the mouth component and the correlation between the two (eye and mouth) components. Eye component exhibits a lower classification rate if used independently.

Keywords

References

  1. P. Ekman and W.V. Friesen, Facial Action Coding System (FACS), Consulting Psychologist Press, Inc., 1978.
  2. Y. Yacoob and L. S. Davis, "Recognizing Human Facial Expressions from Long Image Sequences Using Optical Flow", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, pp. 636-642, June 1996. https://doi.org/10.1109/34.506414
  3. P. Michael, R. E. Kaliouby, "Real Time Facial Expression Recognition in Video using Support Vector Machines", ICMI 2003, pp.258-264, 2003.
  4. J. Zhang, Y. Yan, and M. Lades, " Face Recognition: Eigenface, Elastic Matching, and Neural Nets," Proc. IEEE, vol. 85, no. 9, pp. 1423 - 1435, 1997. https://doi.org/10.1109/5.628712
  5. P. S. Penev and J. J. Atick, "Local Feature Analysis: A General Statistical theory for Object Representation," Network: Computation in Neural Systems, vol. 7, no. 3, pp. 477-500, 1996. https://doi.org/10.1088/0954-898X/7/3/002
  6. M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, vol. 19, pp. 743-720, 1997.
  7. X. W. Chen and T. Huang, "Facial expression recognition: a clustering-based approach," Pattern Recognition Letter, vol. 24, pp.1295-1302, 2003. https://doi.org/10.1016/S0167-8655(02)00371-9
  8. Y. Zhu, L. C. De Silve, C. C. Ko, "Using Moment Invariants and HMM in Facial Expression Recognition", Pattern Recognition Letters, vol. 23, pp. 83-91, 2002. https://doi.org/10.1016/S0167-8655(01)00108-8
  9. G.J. Edwards, C.J. Taylor, T.F. Cootes, "Interpreting face images using active appearance models", 3rd IEEE Inter. Conf. of Automatic Face and Gesture Recognition, vol. 3, pp. 30, 1998.
  10. A. U. Batur and M.H. Hayes, "Adaptive Active Appearance Models", IEEE Transactions on Image Processing, vol. 14, no. 11, pp. 1707-1721, November 2005. https://doi.org/10.1109/TIP.2005.854473
  11. Haizhou Ai, L. Liang and G. Xu, "Face Detection based on Template Matching and Support Vector Machines", Proceedings of International Conference on Image Processing, pp. 1006-1009, 2001.
  12. Byungsung Lee, Junchul Chun, Peom Park, "Classification of Facial Expression Using SVM for Emotion Care Service System," 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, pp.8-12, 2008.
  13. O. Tuzel, F. Porikli, and P. Meer, "Region Covariance: A fast Descriptor for Detection and Classification", European Conference on Computer Vision (ECCV, 2006TR2005-111), May 2006.
  14. W. Forstner and B. Moonen, "A metric for covariance matrices", Technical report, Dept. of Geodesy and Geoinformatics, Struttgart University, 1999.
  15. M. J. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with Gabor Wavelets", Proceedings, Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara japan, IEEE Computer Society, pp. 200-205, 1998.
  16. W. O. Odoyo, G. B. Lee and J. J. Park and B. J. Cho, "Facial component features for facial expression identification using Active Appearance Model," IEEE Africon 2009, vol. 9, pp. 1-5, 2009.
  17. W. O. Odoyo and B. J. Cho, "Global Feature Extraction and Recognition from Matrices of Gabor Feature Faces," International Journal of Maritime Information and Communication Sciences, vol. 9, no. 2, pp. 207-211, April 2011.