방송공학회논문지 (Journal of Broadcast Engineering)

  • 제25권5호
  • /
  • Pages.776-788
  • /
  • 2020
  • /
  • 1226-7953(pISSN)
  • /
  • 2287-9137(eISSN)
한국방송∙미디어공학회 (The Korean Institute of Broadcast and Media Engineers)
권호 표지
DOI QR코드

DOI QR Code

가상 데이터를 활용한 번호판 문자 인식 및 차종 인식 시스템 제안

Proposal for License Plate Recognition Using Synthetic Data and Vehicle Type Recognition System

  • 이승주 (서울과학기술대학교 일반대학원 미디어IT공학과) ;
  • 박구만 (서울과학기술대학교 전자IT미디어공학과)
  • Lee, Seungju (Dept. of Media IT Engineering, The Graduate Schol, Seoul National University of Science and Technology) ;
  • Park, Gooman (Dept. of Electronic IT Media Engineering, Seoul National University of Science and Technology)
  • 투고 : 2020.07.16
  • 심사 : 2020.08.31
  • 발행 : 2020.09.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 딥러닝을 이용한 차종 인식과 자동차 번호판 문자 인식 시스템을 제안한다. 기존 시스템에서는 영상처리를 통한 번호판 영역 추출과 DNN을 이용한 문자 인식 방법을 사용하였다. 이러한 시스템은 환경이 변화되면 인식률이 하락되는 문제가 있다. 따라서, 제안하는 시스템은 실시간 검출과 환경 변화에 따른 정확도 하락에 초점을 맞춰 1-stage 객체 검출 방법인 YOLO v3를 사용하였으며, RGB 카메라 한 대로 실시간 차종 및 번호판 문자 인식이 가능하다. 학습데이터는 차종 인식과 자동차 번호판 영역 검출의 경우 실제 데이터를 사용하며, 자동차 번호판 문자 인식의 경우 가상 데이터만을 사용하였다. 각 모듈별 정확도는 차종 검출은 96.39%, 번호판 검출은 99.94%, 번호판 검출은 79.06%를 기록하였다. 이외에도 YOLO v3의 경량화 네트워크인 YOLO v3 tiny를 이용하여 정확도를 측정하였다.

In this paper, a vehicle type recognition system using deep learning and a license plate recognition system are proposed. In the existing system, the number plate area extraction through image processing and the character recognition method using DNN were used. These systems have the problem of declining recognition rates as the environment changes. Therefore, the proposed system used the one-stage object detection method YOLO v3, focusing on real-time detection and decreasing accuracy due to environmental changes, enabling real-time vehicle type and license plate character recognition with one RGB camera. Training data consists of actual data for vehicle type recognition and license plate area detection, and synthetic data for license plate character recognition. The accuracy of each module was 96.39% for detection of car model, 99.94% for detection of license plates, and 79.06% for recognition of license plates. In addition, accuracy was measured using YOLO v3 tiny, a lightweight network of YOLO v3.

키워드

참고문헌

  1. Jung-Hwan Kim, Joonhong Lim, "License Plate Detection and Recognition Algorithm using Deep Learning," Journal of IKEEE, 2019, 23.2: 642-651, http://dx.doi.org/10.7471/ikeee.2019.23.2.642
  2. Xuan-Truong Dang, Eung-Tae Kim, "Robust Motorbike License Plate Detection and Recognition using Image Warping based on YOLOv2," JOURNAL OF BROADCAST ENGINEERING, 2019, 24.5: 713-725, https://doi.org/10.5909/JBE.2019.24.5.713
  3. REDMON, Joseph; FARHADI, Ali, "Yolov3: An incremental im- provement," arXiv preprint arXiv:1804.02767, 2018.
  4. GIRSHICK, Ross, et al, "Rich feature hierarchies for accurate object detection and semantic segmentation," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580-587, 2014.
  5. GIRSHICK, Ross, "Fast r-cnn," Proceedings of the IEEE international conference on computer vision, pp. 1440-1448, 2015.
  6. REN, Shaoqing, et al, "Faster r-cnn: Towards real-time object detection with region proposal networks," Advances in neural information processing systems, pp. 91-99, 2015.
  7. HE, Kaiming, et al, "Mask r-cnn," Proceedings of the IEEE international conference on computer vision, pp. 2961-2969, 2017.
  8. REDMON, Joseph, et al, "You only look once: Unified, real-time object detection," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788, 2016.
  9. REDMON, Joseph; FARHADI, Ali, "YOLO9000: better, faster, stronger," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263-7271, 2017.
  10. LIU, Wei, et al, "Ssd: Single shot multibox detector," European conference on computer vision, Springer, Cham, pp. 21-37, 2016, https://doi.org/10.1007/978-3-319-46448-0_2.
  11. NEUMANN, Lukas; MATAS, Jiri, "Real-time scene text localization and recognition," 2012 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 3538-3545, 2012, doi:10.1109/CVPR.2012.6248097.
  12. JADERBERG, Max, et al, "Reading text in the wild with convolutional neural networks," International journal of computer vision, 116.1: 1-20, 2016, doi:10.1007/s11263-015-0823-z.
  13. GUPTA, Ankush; VEDALDI, Andrea; ZISSERMAN, Andrew, "Synthetic data for text localisation in natural images," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2315-2324, 2016.
  14. LOWE, David G, "Distinctive image features from scale-invariant keypoints," International journal of computer vision, 60.2: 91-110, 2004, https://doi.org/10.1023/B:VISI.0000029664.99615.94.
  15. RUBLEE, Ethan, et al, "ORB: An efficient alternative to SIFT or SURF," 2011 International conference on computer vision, Ieee, pp. 2564-2571, 2011, doi:10.1109/ICCV.2011.6126544.
  16. MUJA, Marius; LOWE, David G, "Scalable nearest neighbor algorithms for high dimensional data," IEEE transactions on pattern analysis and machine intelligence, 36.11: 2227-2240, 2014, doi:10.1109/CRV.2012.60.
  17. Seungju Lee, Gooman Park, "Proposal for Deep Learning based Character Recognition System by Virtual Data Generation," JOURNAL OF BROADCAST ENGINEERING, 25.2: 275-278. 2020, https://doi.org/10.5909/JBE.2020.25.2.275.