Journal of Information Processing Systems

  • 제19권3호
  • /
  • Pages.323-333
  • /
  • 2023
  • /
  • 1976-913X(pISSN)
  • /
  • 2092-805X(eISSN)
한국정보처리학회 (Korea Information Processing Society)
권호 표지
DOI QR코드

DOI QR Code

Facial Expression Recognition Method Based on Residual Masking Reconstruction Network

  • Jianing Shen ( The 58th College of Computer Internet of Things Engineering, Wuxi Taihu University) ;
  • Hongmei Li ( The 58th Research Institute of China Electronics Technology Group Corporation)
  • 투고 : 2022.12.07
  • 심사 : 2023.02.25
  • 발행 : 2023.06.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Facial expression recognition can aid in the development of fatigue driving detection, teaching quality evaluation, and other fields. In this study, a facial expression recognition method was proposed with a residual masking reconstruction network as its backbone to achieve more efficient expression recognition and classification. The residual layer was used to acquire and capture the information features of the input image, and the masking layer was used for the weight coefficients corresponding to different information features to achieve accurate and effective image analysis for images of different sizes. To further improve the performance of expression analysis, the loss function of the model is optimized from two aspects, feature dimension and data dimension, to enhance the accurate mapping relationship between facial features and emotional labels. The simulation results show that the ROC of the proposed method was maintained above 0.9995, which can accurately distinguish different expressions. The precision was 75.98%, indicating excellent performance of the facial expression recognition model.

키워드

참고문헌

  1. A. R. Hazourli, A. Djeghri, H. Salam, and A. Othmani, "Multi-facial patches aggregation network for facial expression recognition and facial regions contributions to emotion display," Multimedia Tools and Applications, vol. 80, pp. 13639-13662, 2021.  https://doi.org/10.1007/s11042-020-10332-7
  2. B, Yang, Z. Li, and E. Cao, "Facial expression recognition based on multi-dataset neural network," Radioengineering, vol. 29, no. 1, pp. 259-266, 2020.  https://doi.org/10.13164/re.2020.0259
  3. X. Zhang, F. Zhang, and C. Xu, "Joint expression synthesis and representation learning for facial expression recognition," IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 3, pp. 1681-1695, 2022.  https://doi.org/10.1109/TCSVT.2021.3056098
  4. C. V. R. Reddy, U. S. Reddy, and K. V. K. Kishore, "Facial emotion recognition using NLPCA and SVM," Traitement du Signal, vol. 36, no. 1, pp. 13-22, 2019.  https://doi.org/10.18280/ts.360102
  5. D. Poux, B. Allaert, N. Ihaddadene, I. M. Bilasco, C. Djeraba, and M. Bennamoun, "Dynamic facial expression recognition under partial occlusion with optical flow reconstruction," IEEE Transactions on Image Processing, vol. 31, pp. 446-457, 2022.  https://doi.org/10.1109/TIP.2021.3129120
  6. C. Xu, Y. Cui, Y. Zhang, P. Gao, and J. Xu, "Person-independent facial expression recognition method based on improved Wasserstein generative adversarial networks in combination with identity aware," Multimedia Systems, vol. 26, pp. 53-61, 2020.  https://doi.org/10.1007/s00530-019-00628-6
  7. K. Talele and K. Tuckley, "Facial expression recognition using digital signature feature descriptor," Signal, Image and Video Processing, vol. 14, pp. 701-709, 2020.  https://doi.org/10.1007/s11760-019-01595-1
  8. Y. Yaermaimaiti, "Facial expression recognition based on local feature and deep belief network," Journal of Decision Systems, 2021. https://doi.org/10.1080/12460125.2021.1961378 
  9. I. Gogic, M. Manhart, I. S. Pandzic, and J. Ahlberg, "Fast facial expression recognition using local binary features and shallow neural networks," The Visual Computer, vol. 36, pp. 97-112, 2020.  https://doi.org/10.1007/s00371-018-1585-8
  10. L. Pham, T. H. Vu, and T. A. Tran, "Facial expression recognition using residual masking network," in Proceedings of 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy, 2021, pp. 4513-4519.