DOI QR코드

DOI QR Code

A Vehicular License Plate Recognition Framework For Skewed Images

  • Arafat, M.Y. (Department of Electrical Engineering, Faculty of Engineering, University of Malaya) ;
  • Khairuddin, A.S.M. (Department of Electrical Engineering, Faculty of Engineering, University of Malaya) ;
  • Paramesran, R. (Department of Electrical Engineering, Faculty of Engineering, University of Malaya)
  • Received : 2017.12.13
  • Accepted : 2018.06.21
  • Published : 2018.11.30

Abstract

Vehicular license plate (LP) recognition system has risen as a significant field of research recently because various explorations are currently being conducted by the researchers to cope with the challenges of LPs which include different illumination and angular situations. This research focused on restricted conditions such as using image of only one vehicle, stationary background, no angular adjustment of the skewed images. A real time vehicular LP recognition scheme is proposed for the skewed images for detection, segmentation and recognition of LP. In this research, a polar co-ordinate transformation procedure is implemented to adjust the skewed vehicular images. Besides that, window scanning procedure is utilized for the candidate localization that is based on the texture characteristics of the image. Then, connected component analysis (CCA) is implemented to the binary image for character segmentation where the pixels get connected in an eight-point neighbourhood process. Finally, optical character recognition is implemented for the recognition of the characters. For measuring the performance of this experiment, 300 skewed images of different illumination conditions with various tilt angles have been tested. The results show that proposed method able to achieve accuracy of 96.3% in localizing, 95.4% in segmenting and 94.2% in recognizing the LPs with an average localization time of 0.52s.

Keywords

References

  1. M. R. Asif, Q. Chun, S. Hussain, and M. S. Fareed, "Multiple licence plate detection for Chinese vehicles in dense traffic scenarios," IET Intelligent Transport Systems, vol. 10, pp. 535-544, 2016. https://doi.org/10.1049/iet-its.2016.0008
  2. I. Turkyilmaz and K. Kacan, "License Plate Recognition System Using Artificial Neural Networks," ETRI Journal, vol. 39, pp. 163-172, 2017. https://doi.org/10.4218/etrij.17.0115.0766
  3. B. Hongliang and L. Changping, "A hybrid license plate extraction method based on edge statistics and morphology," in Proc. of Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, pp. 831-834, 2004.
  4. V. Abolghasemi and A. Ahmadyfard, "An edge-based color-aided method for license plate detection," Image and Vision Computing, vol. 27, pp. 1134-1142, 2009. https://doi.org/10.1016/j.imavis.2008.10.012
  5. H. Rajput, T. Som, and S. Kar, "Using Radon Transform to Recognize Skewed Images of Vehicular License Plates," Computer, vol. 49, pp. 59-65, 2016. https://doi.org/10.1109/MC.2016.14
  6. M.-R. Choi and S.-S. Lee, "An image enhancement Method for extracting multi-license plate region," KSII Transactions on Internet & Information Systems, vol. 11, 2017.
  7. H. Rajput, T. Som, and S. Kar, "An Automated Vehicle License Plate Recognition System," Computer, vol. 8, pp. 56-61, 2015.
  8. P. Tarabek, "Fast license plate detection based on edge density and integral edge image," in Proc. of Applied Machine Intelligence and Informatics (SAMI), 2012 IEEE 10th International Symposium on, pp. 37-40, 2012.
  9. R. Chen and Y. Luo, "An improved license plate location method based on edge detection," Physics Procedia, vol. 24, pp. 1350-1356, 2012. https://doi.org/10.1016/j.phpro.2012.02.201
  10. H. Caner, H. S. Gecim, and A. Z. Alkar, "Efficient embedded neural-network-based license plate recognition system," IEEE Transactions on Vehicular Technology, vol. 57, pp. 2675-2683, 2008. https://doi.org/10.1109/TVT.2008.915524
  11. F. Yang and Z. Ma, "Vehicle license plate location based on histogramming and mathematical morphology," in Proc. of Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05), pp. 89-94, 2005.
  12. V. Laxmi, D. Mohanta, and B. Karan, "Comparison of different wavelets for automatic identification of vehicle license plate," IET intelligent transport systems, vol. 5, pp. 231-240, 2011. https://doi.org/10.1049/iet-its.2010.0149
  13. J.-M. Guo and Y.-F. Liu, "License plate localization and character segmentation with feedback self-learning and hybrid binarization techniques," IEEE Transactions on Vehicular Technology, vol. 57, pp. 1417-1424, 2008. https://doi.org/10.1109/TVT.2007.909284
  14. S. Azam and M. M. Islam, "Automatic license plate detection in hazardous condition," Journal of Visual Communication and Image Representation, vol. 36, pp. 172-186, 2016. https://doi.org/10.1016/j.jvcir.2016.01.015
  15. E. R. Lee, P. K. Kim, and H. J. Kim, "Automatic recognition of a car license plate using color image processing," in Proc. of Image Processing, 1994. Proceedings. ICIP-94., IEEE International Conference, pp. 301-305, 1994.
  16. L. Zheng, X. He, B. Samali, and L. T. Yang, "Accuracy enhancement for license plate recognition," in Proc. of Computer and Information Technology (CIT), 2010 IEEE 10th International Conference on, pp. 511-516, 2010.
  17. S.-L. Chang, L.-S. Chen, Y.-C. Chung, and S.-W. Chen, "Automatic license plate recognition," IEEE transactions on intelligent transportation systems, vol. 5, pp. 42-53, 2004. https://doi.org/10.1109/TITS.2004.825086
  18. R. Panahi and I. Gholampour, "Accurate detection and recognition of dirty vehicle plate numbers for high-speed applications," IEEE Transactions on Intelligent Transportation Systems, vol. 18, pp. 767-779, 2017. https://doi.org/10.1109/TITS.2016.2586520
  19. A. Capar and M. Gokmen, "Concurrent segmentation and recognition with shape-driven fast marching methods," in Proc. of Pattern Recognition, 2006. ICPR 2006. 18th International Conference on, pp. 155-158, 2006.
  20. S. Nomura, K. Yamanaka, O. Katai, H. Kawakami, and T. Shiose, "A novel adaptive morphological approach for degraded character image segmentation," Pattern Recognition, vol. 38, pp. 1961-1975, 2005. https://doi.org/10.1016/j.patcog.2005.01.026
  21. Q. Gao, X. Wang, and G. Xie, "License plate recognition based on prior knowledge," in Proc. of Automation and Logistics, 2007 IEEE International Conference on, pp. 2964-2968, 2007.
  22. F. Aghdasi and H. Ndungo, "Automatic licence plate recognition system," in Proc. of AFRICON, 2004. 7th AFRICON Conference in Africa, pp. 45-50, 2004.
  23. D. Llorens, A. Marzal, V. Palazon, and J. M. Vilar, "Car license plates extraction and recognition based on connected components analysis and HMM decoding," in Proc. of Iberian Conference on Pattern Recognition and Image Analysis, pp. 571-578, 2005.
  24. H. Samma, C. P. Lim, J. M. Saleh, and S. A. Suandi, "A memetic-based fuzzy support vector machine model and its application to license plate recognition," Memetic computing, vol. 8, pp. 235-251, 2016. https://doi.org/10.1007/s12293-016-0187-0
  25. M. K. Sarker, S. Yoon, and D. S. Park, "A Fast and Robust License Plate Detection Algorithm Based on Two-stage Cascade AdaBoost," KSII Transactions on Internet & Information Systems, vol. 8, 2014.
  26. R. M. Haralick, S. R. Sternberg, and X. Zhuang, "Image analysis using mathematical morphology," IEEE transactions on pattern analysis and machine intelligence, pp. 532-550, 1987.
  27. W. Zhai, T. Gao, Y. Hu, and Y. Tian, "Research and Implementation of License Plate Character Segmentation Based on Tilt Correction," Information and Automation, pp. 92-97, 2011.
  28. W. Zhai, T. Gao, Y. Hu, and Y. Tian, "Research and Implementation of License Plate Character Segmentation Based on Tilt Correction," Information and Automation, pp. 92-97, 2011.
  29. H. E. Kocer and K. K. Cevik, "Artificial neural networks based vehicle license plate recognition," Procedia Computer Science, vol. 3, pp. 1033-1037, 2011. https://doi.org/10.1016/j.procs.2010.12.169
  30. K. Deb, H.-U. Chae, and K.-H. Jo, "Vehicle License Plate Detection Method Based on Sliding Concentric Windows and Histogram," JCP, vol. 4, pp. 771-777, 2009.
  31. D.-J. Kang, "Dynamic programming-based method for extraction of license plate numbers of speeding vehicles on the highway," International Journal of Automotive Technology, vol. 10, pp. 205-210, 2009. https://doi.org/10.1007/s12239-009-0024-2
  32. M.-L. Wang, Y.-H. Liu, B.-Y. Liao, Y.-S. Lin, and M.-F. Horng, "A vehicle license plate recognition system based on spatial/frequency domain filtering and neural networks," in Proc. of International Conference on Computational Collective Intelligence, pp. 63-70, 2010.
  33. R. Al-Hmouz and K. Aboura, "License plate localization using a statistical analysis of Discrete Fourier Transform signal," Computers & Electrical Engineering, vol. 40, pp. 982-992, 2014. https://doi.org/10.1016/j.compeleceng.2014.01.001

Cited by

  1. A Vision-Based Machine Learning Method for Barrier Access Control Using Vehicle License Plate Authentication vol.20, pp.12, 2018, https://doi.org/10.3390/s20123578