Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

Credit Card Number Recognition for People with Visual Impairment

시력 취약 계층을 위한 신용 카드 번호 인식 연구

  • Park, Dahoon (Dept. of Computer Engineering, Hongik University) ;
  • Kwon, Kon-Woo (Dept. of Computer Engineering, Hongik University)
  • Received : 2020.10.28
  • Accepted : 2021.03.03
  • Published : 2021.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

The conventional credit card number recognition system generally needs a card to be placed in a designated location before its processing, which is not an ideal user experience especially for people with visual impairment. To improve the user experience, this paper proposes a novel algorithm that can automatically detect the location of a credit card number based on the fact that a group of sixteen digits has a fixed aspect ratio. The proposed algorithm first performs morphological operations to obtain multiple candidates of the credit card number with >4:1 aspect ratio, then recognizes the card number by testing each candidate via OCR and BIN matching techniques. Implemented with OpenCV and Firebase ML, the proposed scheme achieves 77.75% accuracy in the credit card number recognition task.

일반적인 신용카드 번호 인식 시스템은 정해진 위치에 카드를 배치했을 때에만 올바르게 동작하도록 설계되어 있다. 본 논문은, 저시력 장애인을 포함한 시력 취약 계층에게 보다 쉬운 사용자 경험을 제공하기 위해, 신용카드 내 16자리 숫자의 종횡비 특징을 이용한 자동 번호 인식 알고리즘을 제안한다. 제안하는 알고리즘은 형태학 연산을 통해 종횡비가 4:1 이상인 이미지 후보군을 찾고, 각각의 후보에 OCR과 BIN 번호 매칭 기술을 적용하여 신용카드 번호를 획득한다. OpenCV 및 Firebase ML에 기반한 실험 결과, 카드를 정해진 위치에 두지 않아도 77.75% 정확도로 카드 번호를 인식하였다.

Keywords

References

  1. W. Li and Z. Song, "Bank Card Number Identification Based on Template Matching Method," in International Symposium on Cyberspace Safety and Security, pp.572-578, 2019. DOI: 10.1007/978-3-030-37352-8_51
  2. W. Satyawan, M. O. Pratama, R. Jannati, and G. Muhammad, "Citizen Id Card Detection using Image Processing and Optical Character Recognition," Journal of Physics: Conference Series, vol.1235. no.1, 2019. DOI: 10.1088/1742-6596/1235/1/012049
  3. K. Datta, "Credit Card Processing Using Cell Phone Images," pp.1-7, 2011.
  4. S. Cai et al., "Bank Card and ID Card Number Recognition in Android Financial APP," in International Conference on Smart Computing and Communication, pp.205-213, 2016. DOI: 10.1007/978-3-319-52015-5_21
  5. M. Shen and H. Lei, "Improving OCR performance with background image elimination," in 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp.1566-1570, 2015. DOI: 10.1109/FSKD.2015.7382178
  6. T. Sproull, D. Shook, and Bill Siever, "Machine Learning on the Move: Teaching ML Kit for Firebase in a Mobile Apps Course," in Proceedings of the 51st ACM Technical Symposium on Computer Science Education, pp.1389-1389, 2020. DOI: 10.1145/3328778.3367022
  7. R. Smith, "An overview of the Tesseract OCR engine," in Ninth international conference on document analysis and recognition (ICDAR 2007), vol.2, pp.629-633, 2007. DOI: 10.1109/ICDAR.2007.4376991
  8. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning-Adaptive Computation and Machine Learning, MIT Press, 2016.
  9. J. Zhu et al., "ID card number detection algorithm based on convolutional neural network," in AIP Conference Proceedings. vol.1955, no.1, 2018. DOI: 10.1063/1.5033788
  10. J. Park and J. Park, "eEyes-an Integrated Aid System for the Blind and People with Low Vision," in The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry. 2019. DOI: 10.1145/3359997.3365755
  11. L. Liu et al., "Deep learning for genericobject detection: A survey," in International journal of computer vision, no.2, pp.261-318, 2020. DOI: 10.1007/s11263-019-01247-4
  12. S. Long, X. He, and C. Yao, "Scene textdetection and recognition: The deep learning era," International Journal of Computer Vision, pp.1-24, 2020. DOI: 10.1007/s11263-020-01369-0
  13. NAVER App. [Online]. Available: https://play.google.com/store/apps/details?id=com.nhn.android.search&hl=ko