JSTS:Journal of Semiconductor Technology and Science

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

An FPGA-based Parallel Hardware Architecture for Real-time Eye Detection

  • Received : 2011.08.23
  • Published : 2012.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Eye detection is widely used in applications, such as face recognition, driver behavior analysis, and human-computer interaction. However, it is difficult to achieve real-time performance with software-based eye detection in an embedded environment. In this paper, we propose a parallel hardware architecture for real-time eye detection. We use the AdaBoost algorithm with modified census transform(MCT) to detect eyes on a face image. We parallelize part of the algorithm to speed up processing. Several downscaled pyramid images of the eye candidate region are generated in parallel using the input face image. We can detect the left and the right eye simultaneously using these downscaled images. The sequential data processing bottleneck caused by repetitive operation is removed by employing a pipelined parallel architecture. The proposed architecture is designed using Verilog HDL and implemented on a Virtex-5 FPGA for prototyping and evaluation. The proposed system can detect eyes within 0.15 ms in a VGA image.

Keywords

References

  1. R. Chellappa, C. L. Wilson, and S. Sirohey, "Human and Machine Recognition of Faces: A Survey", Proceedings of the IEEE, Vol.83, No.5, May, 1995.
  2. G. C. Feng, and P. C. Yuen, "Variance projection function and its application to eye detection for human face recognition", Pattern Recognition Letters, Vol.19, No.9, pp.899-906, Jul., 1998. https://doi.org/10.1016/S0167-8655(98)00065-8
  3. Q. Ji, and X. Yang, "Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance", Real-Time Imaging, Vol.8, No.5, pp.357-377, Oct., 2002.
  4. Robert J. K. Jacob, "The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is What You Get," ACM Transactions on Information Systems (TOIS), Vol.9, No.2, Apr., 1991.
  5. Z. Zhu, Q. Ji, "Robust real-time eye detection and tracking under variable lighting conditions and various face orientations," Computer Vision and Image Understanding, Vol.98, No.1, pp.124-154, Apr., 2005. https://doi.org/10.1016/j.cviu.2004.07.012
  6. A. L. Yuille, P W. Hallinan, and D. S. Cohen, "Feature Extraction from Faces Using Deformable Templates," International Journal of Computer Vision, Vol.8, No.2, pp.99-111, 1992. https://doi.org/10.1007/BF00127169
  7. X. Xie, R. Sudhakar, and H. Zhuang, "On improving eye feature extraction using deformable templates," Pattern Recognition, Vol.27, No.6, pp.791-799, Jun., 1994. https://doi.org/10.1016/0031-3203(94)90164-3
  8. K. Lam, and H. Yan, "Locating and extracting the eye in human face images," Pattern Recognition, Vol.29, No.5, pp.771-779, May, 1996. https://doi.org/10.1016/0031-3203(95)00119-0
  9. A. Pentland, B. Moghaddam, and T. Starner, "View-Based and Modular Eigenspaces for Face Recognition," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94), pp.84-91, 1994.
  10. W. Huang, and R. Mariani, "Face Detection and Precise Eyes Location," in Proceedings of International Conference on Pattern Recognition (ICPR'00), Vol.4, pp.722-727, 2000.
  11. J. Huang, H. Wechsler, "Eye Detection Using optimal Wavelet Packets and Radial Basis Functions (RBFs)," International Journal of Pattern Recognition and Artificial Intelligence, Vol.13, No.7, pp.1009-1025, 1999. https://doi.org/10.1142/S0218001499000562
  12. S. A. Sirohey, A. Rosenfeld, "Eye detection in a face image using linear and nonlinear filters," Pattern Recognition, Vol.34, No.7, pp.1367-1391, 2001. https://doi.org/10.1016/S0031-3203(00)00082-0
  13. T. D'Orazio, M. Leo, G.Cicirelli, and A. Distante, "An Algorithm for real time eye detection in face images", in Proceedings of the 17th International Conference on Pattern Recognition (ICPR'04), Vol.3, 2004.
  14. K. Lin, J. Huang, J. Chen, and C. Zhou, "Real-time Eye Detection in Video Streams," Fourth International Conference on Natural Computation (ICNC'08), pp.193-197, Oct., 2008.
  15. A. Amir, L. Zimet, A. Sangiovanni-Vincentelli, and S. Kao, "An embedded system for an eye-detection sensor", Computer Vision and Image Understanding, Vol.98, No.1, pp.104-123. Apr., 2005. https://doi.org/10.1016/j.cviu.2004.07.009
  16. B. Jun, and D. Kim, "Robust Real-Time Face Detection Using Face Certainty Map", Lecture Notes in Computer Science, Vol.4642, pp.29-38, 2007.
  17. I. Choi, and D. Kim, "Eye Correction Using Correlation Information," Lecture Notes in Computer Science, Vol.4843, pp.698-707, 2007.
  18. B. Froba, and A. Ernst, "Face Detection with the Modified Census Transform," in Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition (FGR'04), pp.91-96, May 2004.
  19. Y. Freund, and R. E. Schapire, "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," Journal of Computer and Systems Sciences, Vol.55, pp.119-139, Aug., 1997. https://doi.org/10.1006/jcss.1997.1504
  20. Y. Freund, and R. E. Schapire, "A Short Introduction to Boosting," Journal of Japanese Society for Artificial Intelligence, Vol.14, No.5, pp.771-780, 1999.
  21. P. Viola and M. Jones, "Fast and Robust Classification using Asymmetric AdaBoost and a Detector Cascade," Advances in Neural Information Processing Systems, Vol.2, pp.1311-1318, 2002.
  22. S. Jin, D. Kim, T. T. Nguyen, D. Kim, M. Kim and J. W. Jeon, "Design and Implementation of a Pipelined Datapath for High-Speed Face Detection Using FPGA," IEEE Transaction on Industrial Informatics, Vol.8, No.1, pp.158-167, Feb., 2012. https://doi.org/10.1109/TII.2011.2173943
  23. V. Jain and E. L. Miller, "FDDB: A Benchmark for Face Detection in Unconstrained Setting," Technical Report UM-CS-2010-009, Dept. of Computer Science, University of Massachusetts, Amherst, 2010. http://vis-www.cs.umass.edu/fddb
  24. K. Peng, L. Chen, S. Ruan, and G. Kukharev, "A Robust Algorithm for Eye Detection on Gray Intensity Face without Spectacles," Journal of Computer Science and Technology, Vol.5, No.3, pp.127-132, 2005.
  25. P. Wang and Qiang Ji, "Learning Discriminant Features for Multi-View Face and Eye Detection," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2005.
  26. Q. Wang and J. Yang, "Eye Detection in Facial Images with Unconstrained Background," Journal of Pattern Recognition Research, Vol.1, pp.55-62, 2006. https://doi.org/10.13176/11.15
  27. T. Akashi, Y. Wakasa, K. Tanaka, S. Karungaru, and M. Fukumi, "Using Genetic Algorithm for Eye Detection and Tracking in Video Sequence," Journal of Systemics, Cybernetics, and Informatics, Vol.5, No.2, pp.72-78, 2007.
  28. H.-J. Kim and W.-Y. Kim, "Eye Detection in Facial Images using Zernike Moments with SVM," ETRI Journal, Vol.30, No.2, 2008.
  29. M. Shafi and P. W. H. Chung, "A Hybrid Method for Eyes Detection in Facial Images," International Journal of Electrical, Computer, and Systems Engineering, Vol.42, pp.231-236, 2009.
  30. H. Liu and Q. Liu, "Robust Real-Time Eye Detection and Tracking for Rotated Facial Images under Complex Conditions," in Proceedings of International Conference on Natural Computation, 2010.