Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Automatic Denoising of 2D Color Face Images Using Recursive PCA Reconstruction

2차원 칼라 얼굴 영상에서 반복적인 PCA 재구성을 이용한 자동적인 잡음 제거

  • Park Hyun (Dept. of Computer Science and Engineering, Hanyang University) ;
  • Moon Young-Shik (Dept. of Computer Science and Engineering, Hanyang University)
  • 박현 (한양대학교 컴퓨터공학과) ;
  • 문영식 (한양대학교 컴퓨터공학과)
  • Published : 2006.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

Denoising and reconstruction of color images are extensively studied in the field of computer vision and image processing. Especially, denoising and reconstruction of color face images are more difficult than those of natural images because of the structural characteristics of human faces as well as the subtleties of color interactions. In this paper, we propose a denoising method based on PCA reconstruction for removing complex color noise on human faces, which is not easy to remove by using vectorial color filters. The proposed method is composed of the following five steps: training of canonical eigenface space using PCA, automatic extraction of facial features using active appearance model, relishing of reconstructed color image using bilateral filter, extraction of noise regions using the variance of training data, and reconstruction using partial information of input images (except the noise regions) and blending of the reconstructed image with the original image. Experimental results show that the proposed denoising method maintains the structural characteristics of input faces, while efficiently removing complex color noise.

칼라 영상의 잡음 제거 및 복원은 컴퓨터 비젼 및 영상 처리 분야에서 점점 더 많은 연구가 되어지고 있는 분야이다. 칼라얼굴 영상에서의 잡음 제거 및 복원은 색상들 간의 미묘한 상호작용뿐만 아니라 얼굴의 구조학적 특징 때문에 일반적인 영상의 처리보다 더욱 어렵다. 본 논문은 벡터기반의 영상 필터들을 이용하여 제거하기 어려운 칼라 얼굴 영상의 복합 잡음을 제거 하기 위해 PCA 재구성 기반의 잡음 제거 방법을 제안한다. 제안된 방법은 PCA를 이용한 정준 고유얼굴 공간의 학습단계, 동적 외양 모델을 이용한 자동적인 얼굴 특징 추출 단계, Bilateral 필터를 이용한 복원된 칼라 영상의 재조명(Relighting) 단계, 학습 데이터들의 분산 값들을 이용한 잡음 영역 추출 단계, 입력 영상의 부분 정보를 이용한 재구성과 이를 원본 영상과 합성하여 잡음이 제거된 영상을 생성하는 단계 등 총 5 단계로 구성된다. 실험결과는 제안된 방법이 입력 얼굴 영상들의 구조적 특징들은 잘 유지하면서 복합적인 칼라 잡음 등을 효과적으로 제거하는 것을 보인다.

Keywords

References

  1. O. Ben-Shahar and S. W. Zucker, 'The Perceptual Organization of Texture Flow: A Contextual Inference Approach', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No. 4, 2003 https://doi.org/10.1109/TPAMI.2003.1190568
  2. O. Ben-Shahar and S. W. Zucker, 'Hue fields and Color Curvatures: A Perceptual Organization Approach to Color Image Denosing', IEEE CPVR 2003
  3. E. Eisemann and F. Durand, 'Flash Photography Enhancement via Intrinsic Relighting', ACM SIGGRAPH 2004 https://doi.org/10.1145/1186562.1015778
  4. G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen and K. Toyama, 'Digital Photography with Flash and No-Flash Image Pairs', ACM SIGGRAPH 2004 https://doi.org/10.1145/1015706.1015777
  5. F.· Durand and J. Dorsey, 'Fast Bilateral Filtering for the Display of High-Dynamic -Range Images', ACM SIGGRAPH 2002 https://doi.org/10.1145/566570.566574
  6. G. R. Arce, 'Nonlinear Signal Processing : A Statistical Approach', WILEY, 2005
  7. A. Bovik, 'Handbook of Image & Video Processing', Elsevier Academic Press, pp. 109-127, 2005
  8. F. D. L. Torre and M. J. Black, 'Robust Principal Component Analysis for Computer Vision', In 8th International Conference on Computer Vision, Vol. 1, pp. 362-349, 2001 https://doi.org/10.1109/ICCV.2001.937541
  9. F. D. L. Torre and M. J. Black, 'A Framework for Robust Subspace Learning', International Journal of Computer Vision, Vol. 54, pp. 117-142, 2003 https://doi.org/10.1023/A:1023709501986
  10. A. Hyv？rinen, P. Hoyer and E. Oja, 'Image Denoising by Sparse Code Shrinkage', IEEE Intelligent Signal Processing, 2001 https://doi.org/10.1109/IJCNN.1998.685880
  11. T. Takahashi and T. Kurita, 'Rebust De-noising by Kernel PCA', ICANN 2002, LNCS 2415, pp. 739-744, 2002
  12. J.-S. Park, Y.-H. Oh, S.-C. Ahn and S.-W. Lee, 'Glasses Removal from Face Image Using Recursive Error Compensation', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, No. 5, pp. 805-811, 2005 https://doi.org/10.1109/TPAMI.2005.103
  13. B.-W. Hwang and S.-W. Lee, 'Reconstruction of Partially Damaged Faces Based on a Morphable Face Model', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 25, No.3, pp. 365-372, 2003 https://doi.org/10.1109/TPAMI.2003.1182099
  14. F. Sakaue and T. Shakunaga, 'Robust Projection onto Normalized Eigenspace Using Relative Residual Analysis and Optimal Partial Projection', IEICE Trans. on Information and Systems, Vol E00-A, No. 1, 2004
  15. S. Mukaida and H. Ando, 'Extraction and Manipulation of Wrinkles and Spots for Facial Image Synthesis', Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (FGR'04), 2004 https://doi.org/10.1109/AFGR.2004.1301624
  16. V. Blanz, A. Mehl, T. Vetter and H. P. Seidel, 'A Statistical Method for Robust 3D Surface Reconstruction from Sparse Data', IEEE 3DPVT'04 https://doi.org/10.1109/TDPVT.2004.1335212
  17. X. Li, Z, Ning, and L. Xiang 'Robust 3D Reconstruction with Outliers Using RANSAC Based Singluar Value Decomposition', IEICE Trans. on Information and Systems, Vol. E88-D, No. 8, 2005 https://doi.org/10.1093/ietisy/e88-d.8.2001
  18. M. B. Stegmann, B. K. Ersboll and R. Larsen, 'FAME-A Flexible Apperance Modelling Environment', IEEE Trans. on Medical Imaging, Vol. 22, pp. 1319-1331, 2003 https://doi.org/10.1109/TMI.2003.817780
  19. T. F. Cootes and C. J. Taylor, 'Statistical Models of Appearance for Computer Vision', Tech. Report, University of Manchester, http://www.isbe.man.ac.uk/-bim/, Feb, 2000