The Journal of Korean Institute of Communications and Information Sciences (한국통신학회논문지)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지

Pose-normalized 3D Face Modeling for Face Recognition

  • Received : 2010.11.26
  • Accepted : 2010.12.10
  • Published : 2010.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Pose variation is a critical problem in face recognition. Three-dimensional(3D) face recognition techniques have been proposed, as 3D data contains depth information that may allow problems of pose variation to be handled more effectively than with 2D face recognition methods. This paper proposes a pose-normalized 3D face modeling method that translates and rotates any pose angle to a frontal pose using a plane fitting method by Singular Value Decomposition(SVD). First, we reconstruct 3D face data with stereo vision method. Second, nose peak point is estimated by depth information and then the angle of pose is estimated by a facial plane fitting algorithm using four facial features. Next, using the estimated pose angle, the 3D face is translated and rotated to a frontal pose. To demonstrate the effectiveness of the proposed method, we designed 2D and 3D face recognition experiments. The experimental results show that the performance of the normalized 3D face recognition method is superior to that of an un-normalized 3D face recognition method for overcoming the problems of pose variation.

Keywords

Acknowledgement

Supported by : NRF

References

  1. R. Chellappa, C.L.Wilson and S. Sirohey, "Human and Machine Recognition of Faces: A Survey," Proc. IEEE, Vol.83, No.5, pp.705-740, 1995. https://doi.org/10.1109/5.381842
  2. W. Zhao, R. Chellappa, P.J. Phillips and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Surveys, Vol.35, No.4, pp.399-458, 2003. https://doi.org/10.1145/954339.954342
  3. H.S. Yang, K.L. Boyer and A.C. Kak, "Range data extraction and interpretation by structured light," Proc. IEEE Conference on Artificial Intelligence Applications, pp.199-205, 1984.
  4. K.L. Boyer and AC. Kak, "Color-encoded structured light for rapid active ranging," IEEE Trans Pattern Analysis and Machine Intelligence, pp.14-28, 1987.
  5. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vi-sion, Prentice Hall, 1998.
  6. R. Hartley and A. Zisserman, Multiple view Geometry in computer vision, Cambridge University Press, 2000.
  7. D. Scharstein and R. Szeliski, "Stereo Matching with Nonlinear Diffusion," International Journal of Computer Vision, Vol.28, No.2, pp.155-174, 1998. https://doi.org/10.1023/A:1008015117424
  8. J. Salvi, J. Pags and J. Batlle, "Pattern Codification Strategies in Structured Light Systems," Pattern Recognition, Vol.37, No.4, pp.827-849, Apr. 2004. https://doi.org/10.1016/j.patcog.2003.10.002
  9. S. Malassiotis and M.G. Strintzis, "Pose and illumination compensation for 3D face recognition," Proc. ICIP, pp.91-94, 2004.
  10. S. Malassiotis and M.G. Strintzis, "Robust Face Recognition Using 2D and 3D Data: Pose and Illumination Compensation," Pattern Recognition, Vol.38, No.12, pp.2536-2548, Dec. 2005.
  11. K.I. Chang, K.W. Bowyer and P.J. Flynn, "Multi-Modal 2D and 3D Biometrics for Face Recognition," Proc. IEEE International Workshop on Analysis and Modeling of Faces and Gestures, pp.187-194, 2003.
  12. C. Xu, Y. Wang, T. Tan and L. Quan, "A New Attempt to Face Recognition Using Eigenfaces," Proc. ACCV, pp.884-889, 2004.
  13. H. Song, S. Lee, J. Kim and K. Sohn, "3D sensor based face recognition," Applied Optics, Vol.44, No.5, pp.677-687, Feb. 2005. https://doi.org/10.1364/AO.44.000677
  14. H. Song, "3D Head Pose Estimation and Face Recognition Using Range Image," Ph.D Thesis, Yonsei University, South Korea, 2005.
  15. T. F. Cootes, G. Edwards and C. Taylor, "Active Appearance Models," IEEE Trans. On Pattern Analysis and Machine Intelligence, Vol.23, No.6, pp.681-685, 2001. https://doi.org/10.1109/34.927467
  16. R. Hartley, "In Defence of the 8-points Algorithm," Proc. Fifth International Conference on Computer Vision, Jun. 1995.
  17. D. Shin and J. Kim, "Point to Point Calibration Method of Structured Light for Facial Data Reconstruction," Proc. ICBA 2004, pp.200-206, Jul. 2004.
  18. C.H. Hsieh, C.J. Tsai, Y.P. Hung and SC. Hsu, "Use of chromatic information in region-based stereo," Proc. IPPR Conference on Computer Vision, Graphics, and Image Processing, pp.236-243, 1993.
  19. R.C. Gonzales and R.E. Woods, Digital Image Processing, Addison-Wesley, 1992.
  20. C. Chen, Y. Hung, C. Chiang and J. Wu, "Range data acquisition using color structured lighting and stereo vision," Image and Vision Computing, pp.445-456, 1997.
  21. B. Kim, S. Yu, S. Lee, J. Kim, "Rapid 3D Face Data Acquisition Using a Color-Coded Pattern and a Stereo Camera System," Proc. ICB 2006, pp.26-32, Jan. 2006.
  22. S. Yu, K. Choi and S. Lee, "Automatic Pose-Normalized 3D Face Modeling and Recognition Systems," Proc. IEEE Pacific-Rim Symposium on Image and Video Technology, pp.652-661, Dec. 2006.
  23. H. Kim, D. Kim and S. Bang, "A PCA mixture model with an efficient model selection method," Proc. International Joint Conference on Neural Networks, 2001 Vol.1, pp.430-435, July 2001.
  24. S. Kim, H. Lee, S. Yu and S. Lee, "Robust Face Recognition by Fusion of Visual and Infrared 10 Cues," Proc. IEEE Conference on Industrial Electronics and Applications, pp.804-808, 2006.
  25. X. Chai, S. Shan and W. Gao, "Pose normalization for robust face recognition based on statistical affine transformation," Proc. Joint Coference on International Conference on Information, Communications and Signal Processing and Pacific Rim Conference on Multimedia, Vol.3, pp.1413-1417, Dec. 2003.
  26. P. Viola and M. Jones, "Robust real-time face detection," International Journal of Computer Vision, Vol.57, No.2, pp.137-154, 2004.
  27. S. Yu, J. Kim and S. Lee, "Iterative three dimensional head pose estimation using a face normal vector," Opt. Eng., Vol.48, 037204 (2009). https://doi.org/10.1117/1.3102989
  28. M. Turk And A. Pentland, Eigenfaces for recognition," J. Cogn. Neurosci., Vol.3, pp.72-86, 1991.