3차원 얼굴 인식을 위한 오류 보상 특이치 분해 기반 얼굴 포즈 추정

Head Pose Estimation Using Error Compensated Singular Value Decomposition for 3D Face Recognition

  • 송환종 (연세대학교 전기전자공학과 생체인식연구센터) ;
  • 양욱일 (연세대학교 전기전자공학과 생체인식연구센터) ;
  • 손광훈 (연세대학교 전기전자공학과 생체인식연구센터)
  • 발행 : 2003.11.01

초록

대부분의 얼굴인식 시스템은 현재 2차원 영상을 기반으로 많은 분야에 응용되고 있다. 그러나 2차원 얼굴인식 시스템은 심하게 변화된 얼굴 포즈에 강인한 얼굴인식이 매우 어렵다. 이에 얼굴 포즈 추정은 정면 영상이 아닐 경우 인식률 향상을 위한 필수적인 과정이라 할 수 있다. 그러므로, 본 논문은 3차원 얼굴인식을 위한 새로운 얼굴 포즈 추정 방식을 제안한다 먼저 3차원 거리(range) 영상이 입력될 때 얼굴 곡선에 기반한 자동 얼굴 특징점 추출 기법을 적용한다. 추출된 특징점을 바탕으로 오류 보상 특이치 분해를 적용 한 새로운 3차원 얼굴 포즈 추정 방식을 제안한다. 특이치 분해를 이용하여 초기 회전각을 획득한 후 존재하는 오류를 보다 세밀하게 보상한다. 제안 알고리즘은 정규화된 3차원 얼굴 공간에서 추출된 특징점의 기하학적 위치를 이용하여 수행된다. 또한 3차원 얼굴인식을 위하여 3차원 최근접 이웃 분류기를 이용한 데이터베이스내에서 후보 얼굴을 선택하는 방식을 제안한다. 실험 결과를 통해 다양한 얼굴 포즈에 대하여 제안 알고리즘의 효율성과 타당성을 검증하였다.

Most face recognition systems are based on 2D images and applied in many applications. However, it is difficult to recognize a face when the pose varies severely. Therefore, head pose estimation is an inevitable procedure to improve recognition rate when a face is not frontal. In this paper, we propose a novel head pose estimation algorithm for 3D face recognition. Given the 3D range image of an unknown face as an input, we automatically extract facial feature points based on the face curvature. We propose an Error Compensated Singular Value Decomposition (EC-SVD) method based on the extracted facial feature points. We obtain the initial rotation angle based on the SVD method, and perform a refinement procedure to compensate for remained errors. The proposed algorithm is performed by exploiting the extracted facial features in the normaized 3D face space. In addition, we propose a 3D nearest neighbor classifier in order to select face candidates for 3D face recognition. From simulation results, we proved the efficiency and validity of the proposed algorithm.

키워드

참고문헌

  1. R. Chellappa, C. L. Wilson, and S. Sirohey, 'Human and machine recognition of faces : A survey,' Proceedings of the IEEE, vol. 83, no. 5, pp. 705-740, May 1995 https://doi.org/10.1109/5.381842
  2. W. Zhao, R. Chellappa, A. Rosenfeld, and P.J.Phillips, 'Face recognition: A survey,' CVL Technical Report, Center for Automation Research, University of Maryland at College Park, Oct. 2000
  3. T. Maurer and C. Malsburg, 'Tracking and learning graphs and pose on image sequences on faces,' Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Vermont, USA, pp. 176-181, 1996 https://doi.org/10.1109/AFGR.1996.557261
  4. T. Horprasert, Y. Yacoob, and L.S. Davis, 'Computing 3-D head orientation from a monocular image sequence,' Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Vermont, USA, pp. 242-247, 1996 https://doi.org/10.1109/AFGR.1996.557271
  5. D. Machin, 'Real-time facial motion analysis for virtual teleconferencing,' Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Vermont, USA, pp. 340-344, 1996 https://doi.org/10.1109/AFGR.1996.557288
  6. E. Elagin, J. Steffens, and H. Neven, 'Automatic pose estimation system for human faces based on bunch graph matching technology,' Proceedings of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp. 136-141, 1998 https://doi.org/10.1109/AFGR.1998.670938
  7. Q. Chen, H Wu, T. Fukumoto, and M Yachida, '3D head pose estimation without feature tracking,' Proceedings of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp. 88-93, 1998 https://doi.org/10.1109/AFGR.1998.670930
  8. Q. Chen, H. Wu, T. Shioyarna, and J. Shimada, 'Head pose estimation using both color and feature information,' Proceedings of the Fifteenth International Conference on Pattern Recognition, Barcelona, Spain, vol. 2, pp. 2842-2847, 2000 https://doi.org/10.1109/ICPR.2000.906206
  9. K Hattori, S. Matsumori, and Y. Sato, 'Estimating pose of human face based on symmetry plane using range and intensity images, ' Proceedings of the Fifteenth International Conference on Pattern Recognition, Brisbane, Australia vol. 2, pp. 1183-1187, 1998 https://doi.org/10.1109/ICPR.1998.711908
  10. J.C. Lee and E. Milios, 'Matching range image of human faces,' Proceedings of the Third International Conference on Computer Vision, pp. 722-726, 1990 https://doi.org/10.1109/ICCV.1990.139627
  11. H. T. Tanaka, M. Ikeda and H. Chiaki, 'Curvature-based face surface recognition using spherical correlation,' Proceedings of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp.372-377, 1998 https://doi.org/10.1109/AFGR.1998.670977
  12. B. Acherrnann, X. Jiang, and H. Bunke, 'Face recognition using range images,' International Conference on Virtual Systems and MultiMedia '97 (VSMM '97), Geneva, Switzerland, pp. 129-136, 1997
  13. C.S. Chua, F. Han, and Y.K. Ho, '3D human face recognition using point signature,' Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition, Grenoble, France, pp.233-238, 2000 https://doi.org/10.1109/AFGR.2000.840640
  14. T. Nagamine, T. Uemura and I. Masuda, '3D facial image analysis for human identification,' Proceedings of the International Conference on Pattern Recognition, Amsterdam, Netherlands, pp.324-327, 1992 https://doi.org/10.1109/ICPR.1992.201567
  15. C. Beumier and M Acheroy, 'Automatic 3D face authentication,' Image and Vision Computing vol. 18, no. 4, pp.315-321, 2000 https://doi.org/10.1016/S0262-8856(99)00052-9
  16. R.M. Haralick, H.N. Joo, C.N. Lee, X. Zhuang, V.G. Vaidya, and M.B. Kim, 'Pose estimation from corresponding point data, ' IEEE Trans. On Systems, Man and Cybernetics vol. 19, no. 6, pp. 1426-1446, Nov. 1989 https://doi.org/10.1109/21.44063
  17. T.S. Huang, A.N. Netravali, 'Motion and structure from feature correspondences : A Review,' Proceedings of the IEEE, vol. 82 no. 2, pp. 252-268, Feb. 1994 https://doi.org/10.1109/5.265351