The Character Recognition System of Mobile Camera Based Image

모바일 이미지 기반의 문자인식 시스템

  • Park, Young-Hyun (Information and Telecommunication, Korea Aerospace University) ;
  • Lee, Hyung-Jin (Information and Telecommunication, Korea Aerospace University) ;
  • Baek, Joong-Hwan (Information and Telecommunication, Korea Aerospace University)
  • 박영현 (한국항공대학교 정보통신공학과) ;
  • 이형진 (한국항공대학교 정보통신공학과) ;
  • 백중환 (한국항공대학교 정보통신공학과)
  • Received : 2010.04.23
  • Accepted : 2010.05.13
  • Published : 2010.05.31


Recently, due to the development of mobile phone and supply of smart phone, many contents have been developed. Especially, since the small-sized cameras are equiped in mobile devices, people are interested in the image based contents development, and it also becomes important part in their practical use. Among them, the character recognition system can be widely used in the applications such as blind people guidance systems, automatic robot navigation systems, automatic video retrieval and indexing systems, automatic text translation systems. Therefore, this paper proposes a system that is able to extract text area from the natural images captured by smart phone camera. The individual characters are recognized and result is output in voice. Text areas are extracted using Adaboost algorithm and individual characters are recognized using error back propagated neural network.


  1. B.Widrow and M.A.Lehr, "30 Years of Adaptive Neural Network : Perceptron, Msdaline, and Backpropagation", Proceeding of the IEEE, Vol. 78, pp. 1415-1441, September, 1990.
  2. Yoh-Han Pao, "Adaptive Pattern Recognition and Neural Network", Addison Wesley Publishing Company Inc., 1989.
  3. Anil K. Jain, Bin Yu, "Automatic Text Location in Images and Video Frames," Pattern Recognition, Vol. 31, No. 12, pp. 2055-2076, 1998.
  4. Yu Zhong, Kalle Karu, Anil K. Jain, "Locating Text in Complex Images," Pattern Recognition, Vol. 28, No. 10, pp. 1523-1535, 1995.
  5. H. K. Kim, "Efficient Automatic Text Location Method and Content-based Indexing and Structuring of Video Database," Journal of Visual Communications and Image Representation, Vol. 7, pp. 336-344, 1996.
  6. Pyeoung-Kee Kim, "Automatic Text Location in Complex Color Images using Local Color Quantization," TENCON 99. Proceedings of the IEEE Region 10 Technical Conference, Vol. 1, pp. 629-632, 1999.
  7. J. Ohya, A. Shio, S. Akamatsu, "Recognizing Characters in Scene images," IEEE Transactions Pattern Analysis and Machine Intelligence, PAMI-16(2), pp. 67-82, 1995.
  8. Lixu Gu, Toyahisa Kaneko, "Robust Extraction of Characters from Color Scene Image Using Mathematical Morphology," Proceeding of 7th International Conference on Pattern Recognition, Vol. 2, pp. 1002-1004, 1998.
  9. Jung Sung Uk, "Efficient Rectangle Feature Extraction for Real-time Facial Expression Recognition based on AdaBoost" : Korea Advanced Institute of Science and Technology, 2005.
  10. Yoav Freund, Robert E. Schapire, "A Short Introduction to Boosting" : Journal of Japanese Society for Artificial Intelligence, 14(5):771-780, September, 1999.
  11. Paul Viola, Michael J. Jones, "Robust Real-Time Face Detection" : International Journal of Computer Vision 57(2), 137-54, 2004.
  12. Bong-Wha Hong, Jie-Young Lee, "On the Enhancement of the Recognition Performance for Back Propagation Neural Networks", 한국 OA학회학회지 제4권 4호, 1999.