Journal of Korea Society of Digital Industry and Information Management (디지털산업정보학회논문지)

Korea Society of Digital Industry and Information Management (디지털산업정보학회)
권호 표지
DOI QR코드

DOI QR Code

Recognition of Passport MRZ Information Using Combined Neural Networks

결합 신경망을 이용한 여권 MRZ 정보 인식

  • 김진호 (경일대학교 전자공학과)
  • Received : 2019.11.26
  • Accepted : 2019.12.23
  • Published : 2019.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

In case of reading passport using a smart phone in contrast with a dedicated passport reading system, MRZ(Machine Readable Zone) character recognition can be hard when the character strokes were broken, touched or blurred according to the lighting condition, and the position and size of MRZ character lines were varied due to the camera distance and angle. In this paper, the effective recognition algorithm of the passport MRZ information using a combined neural network recognizer of CNN(Convolutional Neural Network) and ANN( Artificial Neural Network), is proposed under the various sized and skewed passport images. The MRZ line detection using connected component analysis algorithm and the skew correction using perspective transform algorithm are also designed in order to achieve effective character segmentation results. Each of the MRZ field recognition results is verified by using five check digits for deciding whether retrying the recognition process of passport MRZ information or not. After we implement the proposed recognition algorithm of passport MRZ information, the excellent recognition performance of the passport MRZ information was obtained in the experimental results for PC off-line mode and smart phone on-line mode.

Keywords

References

  1. K.B. Kim, S. Kim, "A passport recognition and face verification using enhanced fuzzy ART based RBF network and PCA algorithm," Neurocomputing, Vol.71, 2008, pp.3202-3210. https://doi.org/10.1016/j.neucom.2008.04.045
  2. Y.B. Kwon and J.H. Kim, "Recognition based verification for the machine readable travel documents," in Int'l Workshop on Graphics Recognition, Curitiba, Brazil. Citeseer, 2007.
  3. H.J. Lee and N.J. Kwak, "Character Recognition for the Machine Readable Zone of Electronic Identity Cards," Int'l Conf. on Image Processing, 2015, pp.387-391.
  4. Y. Amirgaliyev and R. Yunussov, "Pattern recognition systems in the problems of automatic person identification using the passport data," Computer Modelling & New Technologies, Vol. 19, 2015, pp.27-30.
  5. ICAO, Machine Readable Travel Documents, 2015.
  6. A. Hartl, C. Arth and D. Schmalstieg. "Real-time detection and recognition of machine-readable zones with mobile devices," Proc. of the Int'l Conf. on Computer Vision Theory and Applications, 2016.
  7. O. Petrova and K. Bulatov, "Methods of machine-readable zone recognition results post-processing," Int'l Conf. on Machine Vision, Germany, 2018.
  8. G. Sarker and S. Ghosh, "A Convolutional Neural Network for Optical Character Recognition and Subsequent Machine Translation," Int'l J. of Computer Application, Vol. 182, No. 30, 2018, pp.23-27.
  9. T. Liu, S. Fang, Y. Y. Zhao, and J. Zhang, "Implementation of training convolutional neural networks," arXiv:1506.01195, 2015.
  10. 임상헌, 이명숙, "딥 러닝 기반의 악성흑색종 분류를 위한 컴퓨터 보조진단 알고리즘," (사)디지털산업정보학회 논문지, 제14권, 제4호, 2018, pp.69-77.
  11. 최병관, "인공지능 객체인식에 관한 파라미터 측정 연구," (사)디지털산업정보학회 논문지, 제15권, 제3호, 2019, pp.15-28.
  12. B. Gato, I. Pratikakis and S. Perantonis, "Adaptive Degraded Document Image Binarization," Pattern Recognition, Vol. 39, 2006, pp.317-327. https://doi.org/10.1016/j.patcog.2005.09.010
  13. J. Wen, S. Li and J. Sun, "A New Binarization Method for Non-uniform Illuminated Document Images," Pattern Recognition, Vol. 46, 2013, pp.1670-1690. https://doi.org/10.1016/j.patcog.2012.11.027