KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Feature Based Techniques for a Driver's Distraction Detection using Supervised Learning Algorithms based on Fixed Monocular Video Camera

  • Received : 2017.08.10
  • Accepted : 2018.02.22
  • Published : 2018.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Most of the accidents occur due to drowsiness while driving, avoiding road signs and due to driver's distraction. Driver's distraction depends on various factors which include talking with passengers while driving, mood disorder, nervousness, anger, over-excitement, anxiety, loud music, illness, fatigue and different driver's head rotations due to change in yaw, pitch and roll angle. The contribution of this paper is two-fold. Firstly, a data set is generated for conducting different experiments on driver's distraction. Secondly, novel approaches are presented that use features based on facial points; especially the features computed using motion vectors and interpolation to detect a special type of driver's distraction, i.e., driver's head rotation due to change in yaw angle. These facial points are detected by Active Shape Model (ASM) and Boosted Regression with Markov Networks (BoRMaN). Various types of classifiers are trained and tested on different frames to decide about a driver's distraction. These approaches are also scale invariant. The results show that the approach that uses the novel ideas of motion vectors and interpolation outperforms other approaches in detection of driver's head rotation. We are able to achieve a percentage accuracy of 98.45 using Neural Network.

Keywords

References

  1. The Dangers of Texting while Driving. (2014, 12 8). Retrieved from Federal Communications Commission:
  2. Oviedo-Trespalacios, Oscar, Md Mazharul Haque, Mark King, and Simon Washington, "Understanding the impacts of mobile phone distraction on driving performance: A systematic review," Transp. Research Emerg. Tech, vol.72, pp. 360-380, November, 2016. https://doi.org/10.1016/j.trc.2016.10.006
  3. Rohl, Austin, Sven Eriksson, and David Metcalf, "Evaluating the effectiveness of a front windshield sticker reminder in reducing texting while driving in young adults," Cureus, vol. 8, no.7, July, 2016.
  4. L.E.Levine, B.M. Waite and L.L.Bowman, "Mobile media use, multitasking and distractibility," Intern. J. Cyber Behav., Psych, vol. 2, no. 3, pp. 15-29, July, 2012. https://doi.org/10.4018/ijcbpl.2012070102
  5. Vicente, Francisco, Zehua Huang, XuehanXiong, Fernando De la Torre, Wende Zhang and Dan Levi, "D.Levi, Driver gaze tracking and eyes off the road detection system," IEEE Trans. Intell. Transp. Sys, vol.16, no.4, pp. 2004-2027, August, 2015.
  6. Mittal, Ajay, Kanika Kumar, Sarina Dhamija, and Manvjeet Kaur, "Head movement-based driver drowsiness detection: A review of state-of-art techniques," in Proc. of the IEEE International Cone on Engineering and Technology, pp. 903-908, March, 2016.
  7. Yin, Bao-Cai, Xiao Fan, and Yan-Feng Sun, "Multiscale dynamic features based driver fatigue detection," J. Pattern RecogArtif. Intell vol. 23, no.3 pp.575-589, May, 2009. https://doi.org/10.1142/S021800140900720X
  8. Liang, Yulan and J.D.Lee, "A hybrid Bayesian Network approach to detect driver cognitive distraction," Trans. Research Emer. Tech. vol. 38, pp.146-155, January, 2014. https://doi.org/10.1016/j.trc.2013.10.004
  9. Murphy-Chutorian, Erik, AnupDoshi, and Mohan Manubhai Trivedi, "Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation," in Proc of 10th IEEE Conf on Intelligent Transportation Systems, pp. 709-714, September, 2007.
  10. D'Orazio, Tiziana, Marco Leo, Cataldo Guaragnella, and Arcangelo Distante, "A visual approach for drive inattention detection," Pattern Recog. Vol. 40, no. 8, pp. 2341-2355, September, 2007. https://doi.org/10.1016/j.patcog.2007.01.018
  11. Hansen, Dan Witzner, and Qiang Ji, "In the eye of the beholder: A survey of models for eyes and gaze," IEEE Trans. Pattern Anal. Mach. Intel. Vol. 32, no. 3, pp. 478-500, March, 2010. https://doi.org/10.1109/TPAMI.2009.30
  12. Valenti, Roberto, Nicu Sebe, and Theo Gevers, "Combining head pose and eye location information for gaze estimation," IEEE Trans. Img. Proc, vol. 21, no.2, pp. 802-815, Feb, 2012. https://doi.org/10.1109/TIP.2011.2162740
  13. Tawari, Ashish, Sayanan Sivaraman, Mohan Manubhai Trivedi, Trevor Shannon, and Mario Tippelhofer, "Looking-in and looking-out vision for urban intelligent assistance: Estimation of driver attentive state and dynamic surround for safe merging and braking," in Proc of the IEEE International Conf on Intelligent Vehicles Symposium Proc, pp. 115-120, June, 2014.
  14. Sigari, Mohamad-Hoseyn, Muhammad-Reza Pourshahabi, Mohsen Soryani, and Mahmood Fathy, "A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection," Int. J. Adv.Sci.Tech, vol. 64, pp.73-100, 2014. https://doi.org/10.14257/ijast.2014.64.07
  15. Murphy-Chutorian, Erik, and Mohan Manubhai Trivedi, "Head pose estimation in computer vision," A survey, IEEE Trans. Pattern Anal. Mach. Intel., vol. 31, no.4, pp. 607-626, April, 2009. https://doi.org/10.1109/TPAMI.2008.106
  16. Lee, Dongwook, Seungwon Oh, Seongkook Heo, and Minsoo Hahn, "Drowsy driving detection based on the driver's head movement using infrared sensors," in Proc. of Symposium of the International Conference on Universal Communication, pp. 231-236, December, 2008.
  17. Sathyanarayana, Amardeep, Sandhya Nageswaren, Hassan Ghasemzadeh, Roozbeh Jafari, and John HL Hansen, "R.Jafari, John HL Hansen Body sensor networks for driver distraction identification," in Proc. of the of IEEE International Conf on Vehicular Electronics and Safety, pp. 120-125, September 2008.
  18. Zeng, Jinhua, Y.Sun and L. Jiang, "Driver distraction detection and identity recognition in real-time," in Proc., of the IEEE International Second WRI Global Congress on Intelligent Systems, pp. 43-46, December, 2010.
  19. Hirayama, Takatsugu, Kenji Mase, and Kazuya Takeda, "Detection of driver distraction based on temporal relationship between eye-gaze and peripheral vehicle behavior," in Proc. of the IEEE International Conf on Intelligent Transportation Systems,, pp. 870-875, September 2012.
  20. Choi, In-.Ho and Yong-Guk Kim, "Head pose and gaze direction tracking for detecting a drowsy driver," in Proc. of the IEEE International conf on Big Data and Smart Computing, pp. 241-244, January 2014.
  21. Dongare, Harshada and Sanjeevani Shah, "Eye Gaze Tracking and Eyes off the Road Detection for Traffic Safety on Raspberry Pi," Intern. J. Innov. Research Elect. Instr. Contr. Engr, vol.6, no.4, pp.2321-2004, June, 2006.
  22. Liu, Tianchi, Y.Yang, G.B.Huang, Y.K.Yeo and Z.Lin, "Driver distraction detection using semi-supervised machine learning," IEEE Trans. Intell. Transp. Sys. vol.17, no.4, pp.1108-1120, 2016. https://doi.org/10.1109/TITS.2015.2496157
  23. Azman, Afizan, Qinggang Meng, Eran A. Edirisinghe, and Hartini Azman. "Non-intrusive physiological measurement for driver cognitive distraction detection: Eye and mouth movements," International Journal of Advanced Computer Science, vol. 1, no. 3, pp. 92-99, 2011.
  24. Bergasa, Luis Miguel, Jesús Nuevo, Miguel A. Sotelo, Rafael Barea, and María Elena Lopez, "Real-time system for monitoring driver vigilance," IEEE Transactions on Intelligent Transportation Systems, vol. 7, no. 1, pp. 63-77, 2006. https://doi.org/10.1109/TITS.2006.869598
  25. Rongben, Wang, Guo Lie, Tong Bingliang, and Jin Lisheng, "Monitoring mouth movement for driver fatigue or distraction with one camera," in Proc. of the 7th International Conference on Intelligent Transportation Systems. Proceedings. IEEE, pp. 314-319, 2004.
  26. Tang, Fangqi, and Benzai Deng, "Facial expression recognition using AAM and local facial features," in Proc. of 3rd Conference on Natural Computation, ICNC. IEEE, vol. 2, pp. 632-635, 2007.
  27. Diaz-Chito, Katerine, Aura Hernandez-Sabate, and Antonio M. Lopez, "A reduced feature set for driver head pose estimation," Applied Soft Computing, vol. 45, pp. 98-107, 2016. https://doi.org/10.1016/j.asoc.2016.04.027
  28. Ma, Bingpeng, Rui Huang, and Lei Qin, "VoD: a novel image representation for head yaw estimation," Neurocomputing, vol. 148, pp. 455-466, 2015. https://doi.org/10.1016/j.neucom.2014.07.019
  29. Dongare, Harshada, and Sanjeevani Shah. "Eye Gaze Tracking and Eyes off the Road Detection for Traffic Safety on Raspberry Pi," Eye 4, no. 6, 2016.
  30. Billah, Tashrif, and SM Mahbubur Rahman. "Tracking-based detection of driving distraction from vehicular interior video," in Proc. of 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 423-428. IEEE, 2016.
  31. Cootes, Tim, E. R. Baldock, and J. Graham, Image Processing and Analysis, Oxford University Press, 2000.
  32. Valstar, Michel, Brais Martinez, Xavier Binefa, and Maja Pantic, "Facial point detection using boosted regression and graph models," in Proc. of IEEE Conf of Computer Vision and Pattern Recognition, pp. 2729-2736, June, 2010.
  33. Sun, Yi, Xiaogang Wang, and Xiaoou Tang, "Deep learning face representation from predicting 10,000 classes," in Proc. of the IEEE International Conf on Computer Vision and Pattern Recognition, pp. 1891-1898, 2014.
  34. Taigman, Yaniv, Ming Yang, Marc'AurelioRanzato, and Lior Wolf, "Deepface Closing the gap to human-level performance in face verification," in Proc. of the IEEE International Conf on Computer Vision and Pattern Recognition, pp. 1701-1708, 2014.
  35. Li, Haoxiang, Zhe Lin, Xiaohui Shen, Jonathan Brandt, and Gang Hua, "A convolutional neural network cascade for face detection," in Proc. of the IEEE International Conf on Computer Vision and Pattern Recognition, pp. 5325-5334, 2015.
  36. Curran, K., X. Li, N. and Mc Caughley, "Neural network face detection," J. Img. Sci, vol.53, no.2, pp.105-115, June, 2005.
  37. Sun, Yi, Ding Liang, Xiaogang Wang, and Xiaoou Tang, "Deepid3: Face recognition with very deep neural networks," in Proc. of the International conf arXiv preprint arXiv, vol. 53, no.2, pp.1502-00873, June, 2015.
  38. Kim, Gyujin, Taeki An, and Moonhyun Kim, "Estimation of Crowd Density in Public Areas Based on Neural Network," KSII Transactions on Internet & Information Systems, vol. 6, no. 9, 2012.
  39. Liang, Xiaolin, Hao Zhang, and T. Aaron Gulliver, "Energy Detector based Time of Arrival Estimation using a Neural Network with Millimeter Wave Signals," KSII Transactions on Internet & Information Systems, vol. 10, no. 7, 2016.
  40. Kerhet Aliaksei, MircoRaffetto, Andrea Boni, and Andrea Massa, "A SVM-based approach to microwave breast cancer detection," Engineering Applications of Artificial Intelligence, vol. 19, no. 7, pp. 807-818, October, 2006. https://doi.org/10.1016/j.engappai.2006.05.010
  41. Wang, Xiang-Yang, Hong-Ying Yang, Yong-Wei Li, Wei-Yi Li, and Jing-Wei Chen, "A new SVM-based active feedback scheme for image retrieval," Engineering Applications of Artificial Intelligence, vol.37 pp. 43-53, January 2015. https://doi.org/10.1016/j.engappai.2014.08.012
  42. Parvin, Hamid, Miresmaeil Mirnabi Baboli, and Hamid Alinejad-Rokny, "Proposing a classifier ensemble framework based on classifier selection and decision tree," Engineering Applications of Artificial Intelligence, vol. 37, pp.34-42, January, 2015. https://doi.org/10.1016/j.engappai.2014.08.005
  43. Sarker, Mostafa Kamal, Sook Yoon, and Dong Sun Park, "A Fast and Robust License Plate Detection Algorithm Based on Two-stage Cascade AdaBoost," KSII Transactions on Internet & Information Systems, vol. 8, no. 10, 2014.
  44. Jia Yangqing, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell, "S.Guadarrama, T.Darrell, Caffe: Convolutional architecture for fast feature embedding," in Proc. of the 22nd ACM international conf on Multimedia, pp. 675-678, November, 2014.
  45. Smith and Steven, Digital signal processing: a practical guide for engineers and scientists, Newnes Press, 2013.
  46. Celiktutan, Oya, Sezer Ulukaya, and Bülent Sankur, "A comparative study of face landmarking techniques," EURASIP Journal on Image and Video Processing, vol. 13, no. 1, 2013.
  47. Caruana, R. and Niculescu-Mizil, A., "An empirical comparison of supervised learning algorithms," in Proc. of the 23rd Int. conf. on Machine learning ACM, pp. 161-168, June, 2006.