Information and Communications Magazine (정보와 통신)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지

와일드 환경에서의 얼굴인식 기술 동향

  • Published : 2014.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

최근 스마트 TV 보급과 더불어 멀티미디어 소비 환경에서 개인 맞춤형 미디어 서비스가 각광을 받고 있다. 이러한 개인 맞춤형 미디어 서비스는 맞춤형 홈 스크린, 타겟 광고 등을 포함하는데, 이러한 서비스를 위해 스마트 TV 환경에서의 얼굴인식 기술은 중요한 이슈로 부각되고 있다. 얼굴인식 기술은 물체인식 분야에서 폭넓게 연구되어 상당히 성숙한 기술이라고 알려져 있음에도 불구하고 심한 환경(저해상도, 조명변화, 포즈변화 등)을 포함하는 제약되지 않은 환경에 적용되었을 때 얼굴인식 시스템의 성능이 크게 저하된다 라고 알려져 있다. 이러한 제약되지 않은 환경을 와일드 환경이라고 정의하고 이 환경에서 얼굴인식 기술이 부딪칠 수 있는 도전요소에 대해 분석하고 이것을 극복하기 위한 최근 얼굴인식 기술 동향에 살펴보도록 한다.

Keywords

References

  1. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, H. Mobahi, and Y. Ma, "Toward a practical face recognition system: robust alignment and illumination by sparse representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 2, pp. 372-386, 2012. https://doi.org/10.1109/TPAMI.2011.112
  2. G. Hua, M.-H. Yang, E. Learned-Miller, Y. Ma, M. Turk, D. J. Kriegman, and T. S. Huang, "Introduction to the special section on real-world face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1921-1924, 2011. https://doi.org/10.1109/TPAMI.2011.182
  3. C. H. Chan, M. A. Tahir, J. Kittler, and M. Pietikainen, "Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 5, pp. 1164-1177, 2013. https://doi.org/10.1109/TPAMI.2012.199
  4. M. Turk and A. Pentland, "Eigenfaces for Recognition," Journal of Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991. https://doi.org/10.1162/jocn.1991.3.1.71
  5. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, 1997. https://doi.org/10.1109/34.598228
  6. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: application to face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, 2006. https://doi.org/10.1109/TPAMI.2006.244
  7. S. Baker and T. Kanade, "Hallucinating faces," in Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000, pp. 83-88.
  8. F. Lin, C. Fookes, V. Chandran, and S. Sridharan, "Super-resolved faces for improved face recognition from surveillance video," Advances in Biometrics (Lecture Notes in Computer Science), vol. 4642, New York: Springer-Verlag, pp. 1-10, 2007.
  9. H. Huang and H. He, "Super-resolution method for face recognition using nonlinear mappings on coherent features," IEEE Trans. Neural Networks, vol. 22, no. 1, pp. 121-130, 2011. https://doi.org/10.1109/TNN.2010.2089470
  10. W. W. W. Zou and P. C. Yuen, "Very low resolution face recognition problem," IEEE Trans. Image Processing, vol. 21, no. 1, pp. 327-340, 2012. https://doi.org/10.1109/TIP.2011.2162423
  11. H. Huang, H. He, X. Fan, and J. Zhang, "Superresolution of human face image using canonical correlation analysis," Pattern Recognition, vol. 43, no. 7, pp. 2532-2543, 2010. https://doi.org/10.1016/j.patcog.2010.02.007
  12. B. Li, H. Chang, S. Shan, and X. Chen, "Lowresolution face recognition via coupled locality preserving mappings," IEEE Signal Processing Letters, vol. 17, no. 1, pp. 20-23, 2010. https://doi.org/10.1109/LSP.2009.2031705
  13. J. Y. Choi, Y. M. Ro, and K. N. Plataniotis, "Color face recognition for degraded face images," IEEE Trans. System, Man, and Cybernetics-Part B: Cybernetics, vol. 39, no. 5, pp. 1217-1230, 2009. https://doi.org/10.1109/TSMCB.2009.2014245
  14. P. H. Hennings-Yeomans, B. V. K. Vijaya Kumar, and S. Baker, "Robust low-resolution face identification and verification using high-resolution features," in Proc. IEEE Int'l Conf. Image Processing, 2009, pp. 33-36.
  15. M. Nishiyama, A. Hadid, H. Takeshima, J. Shotton, T. Kozayaka, and O. Yamaguchi, "Facial deblur inference using subspace analysis for recognition of blurred faces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 838-845, 2011. https://doi.org/10.1109/TPAMI.2010.203
  16. R. Gopalan, S. Taheri, P. Turaga, and R. Chellappa, "A blur-robust descriptor with applications to face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 6, pp. 1220-1226, 2012. https://doi.org/10.1109/TPAMI.2012.15
  17. E. Rahtu, J. Heikkila, V. Ojansivu, and T. Ahonen, "Local phase quantization for blur-insensitive image analysis," Image and Vision Computing, vol. 30, no.8, pp. 501-512, 2012. https://doi.org/10.1016/j.imavis.2012.04.001
  18. Z. Lei, T. Ahonen, M. Pietikainen, and S. Z. Li, "Local frequency descriptor for low-resolution face recognition," IEEE Int'l Conf. Automatic Face & Gesture Recognition and Workshops, 2011, pp. 161- 166.
  19. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," IEEE Trans. Image Processing, vol. 19, no. 6, pp. 1635-1650, 2010. https://doi.org/10.1109/TIP.2010.2042645
  20. B. Wang, W. Li, W. Yang, and Q. Liao, "Illumination normalization based on Weber's law with application to face recognition," IEEE Signal Processing Letters, vol. 18, no. 8, pp. 462-465, 2011. https://doi.org/10.1109/LSP.2011.2158998
  21. R. Basri and D. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, 2003. https://doi.org/10.1109/TPAMI.2003.1177153
  22. K. Lee, J. Ho, and D. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 684-698, 2005. https://doi.org/10.1109/TPAMI.2005.92
  23. L. Zhang and D. Samaras, "Face recognition under variable lighting using harmonic image exemplars," in Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2009, pp. 1299-1313.
  24. D. Jobson, Z. Rahman, and G. Woodell, "A multiscale retinex for bridging the gap between color images and the human observation of scenes," IEEE Trans. Image Processing, vol. 6, no. 7, pp. 965-976, 1997. https://doi.org/10.1109/83.597272
  25. H. Wang, S. Z. Li, Y. Wang, and J. Zhang, Face recognition under varying lighting conditions using self quotient image," in Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2004, pp. 819-924.
  26. T. Chen, X. S. Zhou, D. Comaniciu, and T. S. Huang, "Total variation models for variable lighting face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1519-1524, 2006. https://doi.org/10.1109/TPAMI.2006.195
  27. R. Gross and V. Brajovic, "An image preprocessing algorith mforillumination in variant face recognition," Audio-and Video-Based Biometric Person Authentication, Springer Berlin Heidelberg, 2003, pp. 10-18.
  28. W.-C. Kao, M.-C. Hsu, and Y.-Y. Yang, "Local contrast enhancement and adaptive feature extraction for illumination-invariant face recognition," Pattern Recognition, vol. 43, no. 5, pp. 1736-1747, 2010. https://doi.org/10.1016/j.patcog.2009.11.016
  29. Vladmir N. Vapnik (1998), Statistical Learning Theory, Wiley.
  30. H. Han, S. Shan, L. Qing, X. Chen, and W. Gao, "Lighting aware preprocessing for face recognition across varying illumination," European Conf. Computer Vision, 2010, pp. 308-321.
  31. S. Du and R. K. Ward, "Adaptive region-based image enhancement method for robust face recognition under variable illumination conditions," IEEE Trans. Circuits and Systems for Video Technology, vol. 20, no. 9, pp. 1165-1175, 2010. https://doi.org/10.1109/TCSVT.2010.2045817
  32. T. Jabid, Md. H. Kabir, and O. Chae, "Local directional pattern (LDP) for face recognition," in Proc. IEEE Int'l Conf. Consumer Electronics (ICCE), 2010, pp. 329-330.
  33. S. H. Lee, J. Y. Choi, Y. M. Ro, and K. N. Plataniotis, "Local color vector binary patterns from multichannel face images for face recognition," IEEE Trans. Image Processing, vol. 21, no. 4, pp. 2347- 2353, 2012. https://doi.org/10.1109/TIP.2011.2181526
  34. E. Murphy-Chutorian and M. Manubhai, "Head pose estimation in computer vision: A survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp. 607-626, 2009. https://doi.org/10.1109/TPAMI.2008.106
  35. X. Zhang and Y. Gao, "Face recognition across pose: A review," Pattern Recognition, vol. 42, no. 11, pp. 2876-2896, 2009. https://doi.org/10.1016/j.patcog.2009.04.017
  36. F. Nicolo, S. Parupati, V. Kulathumani, and N. A. Schmid, "Near real-time face detection and recognition using a wireless camera network," in Proc. SPIE Defense, Security, and Sensing, Int'l Society for Optics and Photonics, 2012, pp. 83921I 1-10.
  37. J. Y. Choi, K. N. Plataniotis, and Y. M. Ro, "Face feature weighted fusion based fuzzy membership degree for video face recognition," IEEE Trans. Systems, Man and Cybernetics-Part B: Cybernetics, vol. 42, no. 4, pp. 1270-1282, 2012. https://doi.org/10.1109/TSMCB.2012.2185693
  38. G. Passalis, P. Perakis, T. Theoharis, and I. A. Kakadiaris, "Using facial symmetry to handle pose variations in real-world 3D face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1938-1951, 2011. https://doi.org/10.1109/TPAMI.2011.49
  39. J. Heo, "Generic elastic models for 2D pose synthesis and face recognition," Ph.D. Dissertation, Carnegie Mellon University, 2009.
  40. U. Prabhu, J. Heo, and M. Savvides, "Unconstrained pose-invariant face recognition using 3D generic elastic models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1952-1961, 2011. https://doi.org/10.1109/TPAMI.2011.123
  41. A. Asthana, T. K. Marks, M. J. Jones, K. H. Tieu, and R. MV, "ully automatic pose-invariant face recognition via 3D pose normalization,"in Proc. IEEE Int'l Conf. Computer Vision, 2011, pp. 937-944.
  42. X. Li, G. Mori, and H. Zhang, "xpression-invariant face recognition with expression classification,"IEEE 3rd Canadian Conf. Computer and Robot Vision, 2006.
  43. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "obust face recognition via sparse representation,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, 2009. https://doi.org/10.1109/TPAMI.2008.79
  44. R. Singh, M. Vatsa, and A. Noore, "Face recognition with disguise and single gallery images," Image and Vision Computing, vol. 27, no. 3, pp. 245-257, 2009. https://doi.org/10.1016/j.imavis.2007.06.010
  45. Z. Zhou, A. Wagner, H. Mobahi, J. Wright, and Y. Ma, "Face recognition with contiguous occlusion using Markov random fields,"in Proc. IEEE Int'l Conf. Computer Vision, 2009, pp. 1050-1057.
  46. W. Deng, J. Hu, and J. Guo, Extended SRC: Undersampled face recognition via intraclass variant dictionary," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 9, pp. 1864-1870, 2012. https://doi.org/10.1109/TPAMI.2012.30
  47. J. Wang, K. N. Plataniotis, J. Lu, and A. N. Venetsanopoulos, "On solving the face recognition problem with one training sample per subject," Pattern Recognition, vol. 39, no. 9, pp. 1746-1762, 2006. https://doi.org/10.1016/j.patcog.2006.03.010
  48. X. Tan, S. Chen, Z.-H. Zhou, and F. Zhang, "Face recognition from a single image per person: A survey," Pattern Recognition, vol. 39, no. 9, pp. 1725-1745, 2006. https://doi.org/10.1016/j.patcog.2006.03.013
  49. Y. Gao and Y. Qi, "Robust visual similarity retrieval in single model face databases," Pattern Recognition, vol. 38, no. pp. 1009-1020, 2005. https://doi.org/10.1016/j.patcog.2004.12.006
  50. L. Wiskott, J. M. Fellous, N. Kruger, and C. von der Malsburg, "Face recognition by elastic bunch graph matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, 1997. https://doi.org/10.1109/34.598235
  51. T. F. Cootes, G. V. Wheeler, K. N. Walker, and C. J. Taylor, "View-based active appearance models," Image and Vision Computing, vol. 20, no. 9-10, pp. 657-664, 2002. https://doi.org/10.1016/S0262-8856(02)00055-0
  52. I. A. Kakadiaris, G. Passalis, G. Toderici, M. N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, "Three-dimensional face recognition in the presence of facial expression: an annotated deformable model approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, 2007. https://doi.org/10.1109/TPAMI.2007.1017
  53. R. Gross, I. Matthews, and S. Baker, "Appearancebased face recognition and light fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 4, pp. 449-465, 2004. https://doi.org/10.1109/TPAMI.2004.1265861
  54. X. Zhang, Y. Gao, and M. K. H. Leung, "Automatic texture synthesis for face recognition from single views," in Proc. IEEE Int'l Conf. Pattern Recognition, 2006, pp. 1151-1154.
  55. C. D. Castillo and D. W. Jacobs, "Using stereo matching for 2-D face recognition across pose," in Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2007, pp. 1-8.
  56. M. Buhmann, "Radial basis functions," Acta Numeric, vol. 9, pp. 1-38, 2001.