Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Learning Directional LBP Features and Discriminative Feature Regions for Facial Expression Recognition

얼굴 표정 인식을 위한 방향성 LBP 특징과 분별 영역 학습

  • Received : 2017.03.24
  • Accepted : 2017.04.24
  • Published : 2017.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

In order to recognize the facial expressions, good features that can express the facial expressions are essential. It is also essential to find the characteristic areas where facial expressions appear discriminatively. In this study, we propose a directional LBP feature for facial expression recognition and a method of finding directional LBP operation and feature region for facial expression classification. The proposed directional LBP features to characterize facial fine micro-patterns are defined by LBP operation factors (direction and size of operation mask) and feature regions through AdaBoost learning. The facial expression classifier is implemented as a SVM classifier based on learned discriminant region and directional LBP operation factors. In order to verify the validity of the proposed method, facial expression recognition performance was measured in terms of accuracy, sensitivity, and specificity. Experimental results show that the proposed directional LBP and its learning method are useful for facial expression recognition.

Keywords

References

  1. Y. Cheon and D. Kim, "A Natural Facial Expression Recognition Using Differential-AAM and k-NNS," Journal of Pattern Recognition, Vol. 42, No. 7, pp. 1340-1350, 2008.
  2. Y. Tian, T. Kanade, and J. Cohn, "Recognizing Action Units for Facial Expression Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 2, pp. 97-115, 2001. https://doi.org/10.1109/34.908962
  3. N.D. Matthew, W. Garrison, P. Curtis, and A. Ralph, "EMPATH: A Neural Network that Categorizes Facial Expressions," Journal of Cognitive Neuroscience, Vol. 14, No. 8, pp. 1158-1173, 2002. https://doi.org/10.1162/089892902760807177
  4. C.L. Lisetti and D.E. Rumelhart, "Facial Expression Recognition Using a Neural Network," Proceeding of The 11th International Flairs Conference, pp. 323-332, 1998.
  5. C. Shan, S. Gong, and P.W. McOwan, "Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study," Journal of Image and Vision Computing, Vol. 27, No. 6, pp. 803-816, 2009. https://doi.org/10.1016/j.imavis.2008.08.005
  6. C. Won, "Recognition of Facial Emotion Using Multi-scale LBP," Journal of Korea Multimedia Society, Vol. 17, No. 12, pp. 1383-1392, 2014. https://doi.org/10.9717/kmms.2014.17.12.1383
  7. K.T. Lim and C. Won, "Face Image Analysis Using Adaboost Learning and Non-Square Differential LBP," Journal of Korea Multimedia Society, Vol. 19, No. 6, pp. 1014-1023, 2016. https://doi.org/10.9717/kmms.2016.19.6.1014
  8. T.F. Cootes, G.J. Edwards, and C.J. Taylor, "Active Appearance Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, pp. 681-685, 2001. https://doi.org/10.1109/34.927467
  9. A.B. Ashraf, K. Prkachin, T. Chen, S. Lucey, P. Solomon, Z. Ambadar, et al., "The Painful Face-Pain Expression Recognition Using Active Appearance Models," Journal of Image and Vision Computing, Vol. 12, No. 3, pp. 1788-1796, 2009.
  10. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multi-resolution Gray-scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 24, No. 7, pp. 971-987, 2002. https://doi.org/10.1109/TPAMI.2002.1017623
  11. C. Cortes and V. Vapnik, "Support-Vector Networks," Journal of Machine Learning, Vol. 20, No. 3, pp. 273-297, 1995.
  12. Y. Freund and R.E. Schapire. "A Short Introduction to Boosting," Journal of Japanese Society for Artificial Intelligence, Vol. 14, No. 5, pp. 771-780, 1999.
  13. C.W. Hsu and C.J. Lin, "A Comparison of Methods for Mu1ticlass Support Vector Machines," IEEE Transactions on Neural Networks, Vol. 13, No. 2, pp. 415-425, 2002. https://doi.org/10.1109/72.991427
  14. S. Junding, Z. Shisong, and W Xiaosheng, "Image Retrieval Based on an Improved CS-LBP Descriptor," Proceeding of The 2nd IEEE International Conference on Information Management and Engineering, pp. 115-117, 2010.

Cited by

  1. 이미지 시퀀스 얼굴표정 기반 감정인식을 위한 가중 소프트 투표 분류 방법 vol.20, pp.8, 2017, https://doi.org/10.9717/kmms.2017.20.8.1175
  2. 딥러닝 기반의 얼굴영상에서 표정 검출에 관한 연구 vol.21, pp.8, 2017, https://doi.org/10.9717/kmms.2018.21.8.917
  3. Driver Facial Expression Analysis Using LFA-CRNN-Based Feature Extraction for Health-Risk Decisions vol.10, pp.8, 2017, https://doi.org/10.3390/app10082956