Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Driver Drowsiness Detection Algorithm based on Facial Features

얼굴 특징점 기반의 졸음운전 감지 알고리즘

  • Oh, Meeyeon (Dept. of Electronic Eng., Graduate School, Kyungpook National University) ;
  • Jeong, Yoosoo (Dept. of Electronic Eng., Graduate School, Kyungpook National University) ;
  • Park, Kil-Houm (Dept. of Electronic Eng., Graduate School, Kyungpook National University)
  • Received : 2016.09.07
  • Accepted : 2016.11.11
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Drowsy driving is a significant factor in traffic accidents, so driver drowsiness detection system based on computer vision for convenience and safety has been actively studied. However, it is difficult to accurately detect the driver drowsiness in complex background and environmental change. In this paper, it proposed the driver drowsiness detection algorithm to determine whether the driver is drowsy through the measurement standard of a yawn, eyes drowsy status, and nod based on facial features. The proposed algorithm detect the driver drowsiness in the complex background, and it is robust to changes in the environment. The algorithm can be applied in real time because of the processing speed faster. Throughout the experiment, we confirmed that the algorithm reliably detected driver drowsiness. The processing speed of the proposed algorithm is about 0.084ms. Also, the proposed algorithm can achieve an average detection rate of 98.48% and 97.37% for a yawn, drowsy eyes, and nod in the daytime and nighttime.

Keywords

References

  1. The Statistics on the Traffic Accident, http://www.ex.co.kr/ (accessed May., 12, 2016).
  2. The Analysis of Cause on Traffic Accident, http://www.ts2020.kr/ (accessed Apr., 4, 2014).
  3. J.W. Kim and S.H. Lee, "Neuro-Driving: Automatic Perception Technique for Upcoming Emergency Situations," Korea Multimedia Society, Vol. 19, No. 4, pp. 36-40, 2015.
  4. G. Li, B.L. Lee, and W.Y. Chung, "Smartwatch-Based Wearable EEG System for Driver Drowsiness Detection," Journal of IEEE Sensors, Vol. 15, No. 12, pp. 7169-7180, 2015. https://doi.org/10.1109/JSEN.2015.2473679
  5. Y.J. Kim, Y.M. Kim, and M.S. Hahn, "Detecting Driver Fatigue Based on the Driver's Response Pattern and the Font View Environment of an Automobile," Universal Communication, pp. 237-240, 2008.
  6. M. Omidyeganeh, A. Javadtalab, and S. Shirmohammadi, "Intelligent Driver Dowsiness Detection through Fusion of Yawning and Eye Closure," Proceeding of IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, pp. 1-6, 2011.
  7. M.S. Devi, M.V. Choudhari, and P. Bajaj, "Driver Drowsiness Detection Using Skin Color Algorithm and Circular Hough Transform," Proceeding of Fourth International Conference on Emerging Trends in Engineering and Technology, pp. 129-134, 2011.
  8. S. Abtahi, B. Hariri, and S.Shirmohammadi, "Driver Drowsiness Monitoring Based on Yawning Detection," Proceeding of IEEE International Instrumentation and Measurement Technology Conference, pp. 1-4, 2013.
  9. T. Hong, H. Qin, and Q. Sun, "An Improved Real Time Eye State Identification System in Driver Drowsiness Detection," Proceeding of International Conference on Control and Automation, pp. 1449-1453, 2007.
  10. W.W. Choi, S.B. Pan and J.H. Shin, "System for Detecting Driver's Drowsiness Robust Variations of External Illumination," Journal of Korea Multimedia Society, Vol. 19, No. 6, pp. 1024-1033, 2016. https://doi.org/10.9717/kmms.2016.19.6.1024
  11. S. Abtahi, S. Shirmohammadi, B. Hariri, D. Laroche, and L. Martel, "A Yawning Measurement Method Using Embedded Smart Cameras," Proceeding of IEEE International Instrumentation and Measurement Technology Conference, pp. 1605-1608, 2013.
  12. A. Rahman, M. Sirshar, and A. Khan, "Real Time Drowsiness Detection using Eye Blink Monitoring," Proceeding of IEEE National Software Engineering Conference, pp. 1-7, 2015.
  13. V. Kazemi and J. Sullivan, "One Millisecond Face Alignment with an Ensemble of Regression Trees," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867-1874, 2014.
  14. M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Communications of the ACM, Vol. 24, No. 6, pp. 381-395, 1981. https://doi.org/10.1145/358669.358692

Cited by

  1. Drowsiness Detection Method during Driving by using Infrared and Depth Pictures vol.5, pp.3, 2016, https://doi.org/10.9717/jmis.2018.5.3.189
  2. An Automobile Environment Detection System Based on Deep Neural Network and its Implementation Using IoT-Enabled In-Vehicle Air Quality Sensors vol.12, pp.6, 2016, https://doi.org/10.3390/su12062475