한국전자통신학회논문지 (The Journal of the Korea institute of electronic communication sciences)

한국전자통신학회 (Korea Institute of Electronic Communication Science)
권호 표지
DOI QR코드

DOI QR Code

눈 영상비를 이용한 운전자 상태 경고 시스템

A Driver's Condition Warning System using Eye Aspect Ratio

  • 신문창 (서울과학기술대학교 전자IT미디어공학과) ;
  • 이원영 (서울과학기술대학교 전자IT미디어공학과)
  • 투고 : 2020.02.14
  • 심사 : 2020.04.15
  • 발행 : 2020.04.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문은 교통사고 방지를 위한 운전자의 눈 영상비를 이용한 상태 경고시스템의 설계에 대해 소개하고 있다. 제안하는 운전자 상태 경고 시스템은 눈 인식을 위한 카메라, 카메라를 통해 들어오는 정보를 처리하는 라즈베리파이, 그리고 그 정보를 통해 운전자에게 경고를 줄 때 필요한 부저와 진동기로 구성되어 있다. 운전자의 눈을 인식하기 위해서 기울기 방향성 히스토그램 기술과 딥러닝 기반의 얼굴 표지점 추정 기법을 사용하였다. 동작을 시작하면, 시스템은 눈 주변의 6개의 좌표를 통해 눈 영상비를 계산한다. 그리고 눈을 뜬 상태와 감은 상태의 눈 영상비를 각각 계산한 후 이 두 값으로부터 눈의 상태를 판단하는데 사용하는 문턱 값을 설정한다. 문턱 값이 운전자의 눈 크기에 적응하면서 설정되기 때문에 시스템은 최적의 문턱 값을 사용하여 운전자의 상태를 판단할 수 있다. 또한 낮은 조도에서도 눈을 인식할 수 있도록 회색조 변환 이미지와 LAB모델 이미지를 합성하여 사용하였다.

This paper introduces the implementation of a driver's condition warning system using eye aspect ratio to prevent a car accident. The proposed driver's condition warning system using eye aspect ratio consists of a camera, that is required to detect eyes, the Raspberrypie that processes information on eyes from the camera, buzzer and vibrator, that are required to warn the driver. In order to detect and recognize driver's eyes, the histogram of oriented gradients and face landmark estimation based on deep-learning are used. Initially the system calculates the eye aspect ratio of the driver from 6 coordinates around the eye and then gets each eye aspect ratio values when the eyes are opened and closed. These two different eye aspect ratio values are used to calculate the threshold value that is necessary to determine the eye state. Because the threshold value is adaptively determined according to the driver's eye aspect ratio, the system can use the optimal threshold value to determine the driver's condition. In addition, the system synthesizes an input image from the gray-scaled and LAB model images to operate in low lighting conditions.

키워드

참고문헌

  1. B. Kim and B. Lee, "Biosignal-based Driver's Emotional Response Monitoring System: Part 1. System Implementation," J. of the Korea Institute of Electronic Communication Science, vol. 13, no. 3, 2018, pp. 677-684. https://doi.org/10.13067/JKIECS.2018.13.3.677
  2. J. Kwon, D. Kim, T. Hwang, and H. Park, "A Development of Effective Object Detection System Using Multi-Device LiDAR Sensor in Vehicle Driving Environment," J. of the Korea Institute of Electronic Communication Science, vol. 13, no. 2, 2018, pp. 313-320. https://doi.org/10.13067/JKIECS.2018.13.2.313
  3. Y. Ahn and S. Kwak, "Long Distance Vehicle Recognition and Tracking using Shadow," J. of the Korea Institute of Electronic Communication Science, vol. 14, no. 1, 2019, pp. 251-256. https://doi.org/10.13067/JKIECS.2019.14.1.251
  4. K. Jang and S. Kwak, "Fast Center Lane Detection Method for Vehicle Applications," J. of the Korea Institute of Electronic Communication Science, vol. 9, no. 6, 2014, pp. 649-656. https://doi.org/10.13067/JKIECS.2014.9.6.649
  5. J. Jin, B. Yoo, W. Lee, and G. Kim, "Development of technology in estimating of high-risk driver's behavior," J. of the Korea Institute of Electronic Communication Science, vol. 11, no. 5, 2016, pp. 531-538. https://doi.org/10.13067/JKIECS.2016.11.5.531
  6. T. Soukupova and J. Cech, "Eye-Blink Detection Using Facial Landmarks," 21st Computer Vision Winter Workshop, Rimske Toplice, Slovenia, Feb. 2016.
  7. J. Wong and P. Lau, "Real-Time Driver Alert System Using Raspberry Pi," ECTI Trans. on Electrical Eng., Electronics, and Communication, vol. 17, no. 2, 2019, pp. 193-203. https://doi.org/10.37936/ecti-eec.2019172.215488
  8. W. Chang, L. Chen, and Y. Chiou, "Design and Implementation of a Drowsiness-Fatigue-Detection System Based on Wearable Smart Glasses to Increase Road Safety," IEEE Trans. on Consumer Electronics, vol. 64, no. 4, 2018, pp. 461-469. https://doi.org/10.1109/TCE.2018.2872162
  9. W. Chee, P. Lau, and S. Park, "Real-time Lane Keeping Assistant System on Raspberry Pi," IEIE Trans. on Smart Processing & Computing, vol. 6, no. 6, 2017, pp. 379-386. https://doi.org/10.5573/IEIESPC.2017.6.6.379
  10. Y. Kim, S. Park, and D. Kim, "Research on Robust Face Recognition against Lighting Variation using CNN," J. of the Korea Institute of Electronic Communication Science, vol. 12, no. 2, 2017, pp. 325-330. https://doi.org/10.13067/JKIECS.2017.12.2.325
  11. H. Shin, S. Lee, J. Park, and J. Song, "Performance Improvement of Optical Character Recognition for Parts Book Using Pre-processing of Modified VGG Model," J. of the Korea Institute of Electronic Communication Science, vol. 14, no. 2, 2019, pp. 433-438. https://doi.org/10.13067/JKIECS.2019.14.2.433
  12. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, USA, June 2005.