The Journal of the Korea Contents Association (한국콘텐츠학회논문지)

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Face Detection Algorithm using Kinect-based Skin Color and Depth Information for Multiple Faces Detection

Kinect 디바이스에서 피부색과 깊이 정보를 융합한 여러 명의 얼굴 검출 알고리즘

  • Received : 2016.09.21
  • Accepted : 2016.11.01
  • Published : 2017.01.28
Download PDF
⟨ Previous Next ⟩

Abstract

Face detection is still a challenging task under severe face pose variations in complex background. This paper proposes an effective algorithm which can detect single or multiple faces based on skin color detection and depth information. We introduce Gaussian mixture model(GMM) for skin color detection in a color image. The depth information is from three dimensional depth sensor of Kinect V2 device, and is useful in segmenting a human body from the background. Then, a labeling process successfully removes non-face region using several features. Experimental results show that the proposed face detection algorithm can provide robust detection performance even under variable conditions and complex background.

얼굴 검출은 복잡한 배경 내에서 다양한 얼굴의 자세로 인해 여전히 어려운 문제에 직면하고 있다. 본 논문은 피부색과 깊이 정보를 기반으로 한 한명 또는 여러 명의 얼굴을 검출하는 효과적인 알고리즘을 제안한다. 먼저 우리는 컬러 영상에서 가우시안 혼합 모델을 이용한 피부색 검출 방법에 대해 소개한다. 그리고 Kinect V2의 깊이 센서를 이용하여 획득한 3차원의 깊이 정보는 배경으로부터 사람의 몸을 분할할 때 유용하다. 그리고 레이블링 과정에서 여러 개의 특징을 이용하여 얼굴이 아닌 영역은 성공적으로 제거된다. 실험 결과를 통해 제안한 얼굴 검출 알고리즘은 다양한 조건과 복잡한 배경에서 얼굴이 효과적으로 검출되는 것을 확인할 수 있다.

Keywords

References

  1. K. V. Arya and A. Adarsh, "An Efficient Face Detection and Recognition Method for Surveillance," In Proceedings of the International Conference on Computational Intelligence and Communication Networks, 2015.
  2. F. Comaschi, S. Stuijk, T. Basten, and H. Corporaal, "Robust online face tracking-by-detection," In Proceedings of the IEEE International Conference on Multimedia and Expo, 2016.
  3. F. Dornaika and F. Davoine, "Simultaneous Facial Action Tracking and Expression Recognition in the Presence of Head Motion," J. of Computer Vision, Vol.76, No.3, pp.257-281, 2008. https://doi.org/10.1007/s11263-007-0059-7
  4. P. Viola and B. J. Jones, "Robust Real-Time Face Detection," J. of Computer Vision, Vol.57, No.2, pp.137-154, 2004. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  5. K. Sandeep and A. Rajagopalan, "Human Face Detection in Cluttered Color Images using Skin Color and Edge Information," In Proceedings of the India Conference on Computer Vision, Graphic, and Image Processing, 2002.
  6. R. Mohanty and M. V. Raghunadh, "Skin Color Segmentation based Face Detection using Multi-Color Space," J. of Advanced Research in Computer and Communcation Enginerring, Vol.5, Issue.5, pp.470-475, 2016.
  7. D. Xu, Y. L. Chen, X. Wu, Y. Ou, and Y. Xu, Integrated Approach of Skin-color Detection and Depth Information for Hand and Face Localization," In Proceedings of the IEEE International Conference on Robotics and Biomimetics, 2011.
  8. J. Paduano, M. Romero, and R. M. Valdovinos, "Face Detection in 3D Images with More Than One Person," In Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition, 2016.
  9. https://msdn.microsoft.com/en-us/library/microsoft.kinect.face.aspx.
  10. A. Cheddad, J. Condell, K. Curran, and P. M. Kevitt, "A Skin Tone Detection Algorithm for An Adaptive Approach To Steganography," J. of Signal Processing, Vol.89, No.1, pp.2465-2478, 2009. https://doi.org/10.1016/j.sigpro.2009.04.022
  11. C. Poynton, Digital Video and HDTV : Algorithms and Interface, Morgan Kaufmann, 2003.
  12. R. C. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, John Wiley & Sons, 2001.
  13. V. D. My, A. Masselli, and Z. Zell, "Real Time Face Detection using Geometric Constraints, Navigation and Depth-based Skin Segmentation on Mobile Robots," In Proceedings of the IEEE International Symposium on Robotic and Sensors Environments, 2012.
  14. http://docs.opencv.org/trunk/d7/d8b/tutorial_py _face_detection.html