Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Overlay Text Graphic Region Extraction for Video Quality Enhancement Application

비디오 품질 향상 응용을 위한 오버레이 텍스트 그래픽 영역 검출

  • Lee, Sanghee (Department of Electrical Engineering, University of Ulsan) ;
  • Park, Hansung (Department of Electrical Engineering, University of Ulsan) ;
  • Ahn, Jungil (Ulsan Broadcasting Corporation) ;
  • On, Youngsang (Ulsan Broadcasting Corporation) ;
  • Jo, Kanghyun (Department of Electrical Engineering, University of Ulsan)
  • Received : 2013.05.13
  • Accepted : 2013.07.19
  • Published : 2013.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper has presented a few problems when the 2D video superimposed the overlay text was converted to the 3D stereoscopic video. To resolve the problems, it proposes the scenario which the original video is divided into two parts, one is the video only with overlay text graphic region and the other is the video with holes, and then processed respectively. And this paper focuses on research only to detect and extract the overlay text graphic region, which is a first step among the processes in the proposed scenario. To decide whether the overlay text is included or not within a frame, it is used the corner density map based on the Harris corner detector. Following that, the overlay text region is extracted using the hybrid method of color and motion information of the overlay text region. The experiment shows the results of the overlay text region detection and extraction process in a few genre video sequence.

2차원 비디오를 3차원 스테레오 비디오로 변환할 때 기존 비디오에 삽입되어 있는 오버레이 텍스트(overlay text) 그래픽 영역으로 인해 발생하는 문제점을 이 논문에서 제시한다. 이를 해결하기 위한 방법으로 2차원 비디오를 오버레이 텍스트 그래픽 영역만 있는 영상과 오버레이 그래픽 영역이 추출되어 홀(hole)이 있는 영상으로 분리하여 처리하는 시나리오를 제안한다. 그리고 이 시나리오의 첫 번째 단계로 오버레이 텍스트 영역을 검색하고 추출하는 방법에 대해서만 이 논문에서 논한다. 비디오 시퀀스(sequence)가 입력되면 불필요한 연산 과정을 줄이기 위해 해리스 코너(Harris corner)로 얻어진 코너 밀도 맵을 이용하여 프레임 내 오버레이 텍스트의 존재 유무를 먼저 판단한다. 오버레이 텍스트가 있다면, 색(color) 정보와 움직임(motion) 정보를 결합하여 오버레이 텍스트 그래픽 영역을 검색하고 추출한다. 실험에서는 여러 가지 장르의 방송용 비디오에 대한 처리 결과를 보여주고 분석했다.

Keywords

References

  1. Wonjun Kim and Changick Kim, "A new approach for overlay text detection and extraction from complex video scene", IEEE Transactions on Image Processing, VOL. 18, NO. 2, February 2009
  2. Haojin Yang, Bernhard and Harald Sack, "A framework for improved vide text detection and recognition", Multimed Tools Appl, October 2012, DOI 10.1007/s11042-012-1250-6
  3. Juhyun Oh and Kwanghoon Sohn, "Depth-aware character generator for 3DTV", IEEE Transactions on Broadcasting, VOL. 58, NO. 4, December 2012
  4. Zhujun Wang, Lei Yang, Xiaoyu Wu and Ying Zhang, "A survey on video caption extraction technology", Fourth International Conference on Multimedia Information Networking and Security, 2012
  5. Haw-Kwang Kim, "Efficient automatic text location method and content- based indexing and structuring of video database", Journal of Visual Communication and Image Representation, Vol. 7, No. 4, December, pp. 336-344, 1996, Article NO. 0029 https://doi.org/10.1006/jvci.1996.0029
  6. Ullas Gargi, Sameer Antani, and Rangachar Kasturi, "Indexing text events in digital video databases"
  7. Zhong Ji, Jian Wang, Yu-Ting Su, "Text detection in video frames using hybrid features", Proceedings of the Eighth International Conference on Machine Learning and Cybernetics, July 2009
  8. Michael A. Smith and Takeo Kanade, "Video skimming for quick browsing based on audion and image characterization", School of computer science Carnegie Mellon University, PA 15213, July 30 1995
  9. Y. Liu, H. Lu, X. Xue, and YP. Tan, "Effective video text detection using line features", Proceedings of the 8th International Conference on Control, Automation, Robotics and Vision, pp. 1528-1532, 2004
  10. P. Shivakumara, U. Pal, M. Blumenstein, Lim Tan Chew,"A new method for arbitrarily-oriented text detection in video", DAS, 2012,3:74-78
  11. B. Cai, DR. Zhou, HB. Hu, "Research and implement on detection and extraction of text in digital video", Journal of Computer-Aided Design & Computer Graphics, vol.15, 2003, pp.898-903
  12. D. Chen, J.M. Odobez and H. Bourlard, "Text detection and recognition in images and video frames", Pattern Recognition, pp. 595-608, 2004
  13. Kwang In Kim, Keechul Jung, and Jin Hyung Kim." Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm", Pattern Analysis and Machine Intelligence.2003,25(12):1631-1639 https://doi.org/10.1109/TPAMI.2003.1251157
  14. Z. Ji, J. Wang, and Yu-Ting Su, " Text detection in video frames using hybrid features", ICMLC, pp.318-322, 2009
  15. M. Anthimopoulos, B. Gatos, I. Pratikakis, "A hybrid system for text detection in video frames", Document Analysis Systems, DAS, pp.286-292, 2008
  16. Q. Wang, LQ. Chen, X. Liang, "Text extraction in video", Computer Engineering and Applications, vol.48, pp.177-178, 2012
  17. P. Shivakumara, S. Bhowmick, B. Su, C. L. Tan, U. Pal, "A New gradient based character segmentation method for video text recognition", ICDAR, pp.126-130, 2011
  18. L. N. Sun, L. Y. Fan, "Video text detection , location and extraction", Electronic Technology, vol.22, pp.75-79, 2009
  19. SY. Liu, ZL. Cao, "Single frame characters extraction in complex chromatic image", JOURNAL OF TIANJIN UNIVERSITY OF TECHNOLOGY. vol.23, pp.58-61, 2007
  20. Ahmet Ekin and Radu Jasinschi, "Temporal detection and processing of transparent overlays for video indexing and enhancement", EUSIPCO 2005
  21. 김원준(Wonjun Kim), "해리스코너검출기를이용한비디오자막영역 추출(Text region extraction from videos using the Harris corner detector)", 정보과학회소프트웨어및응용-시각정보처리(Visual Information Processing), Vol, 34, No. 7, July 2007
  22. Hang-Chia Shih and Chung-Lin Huang, "Content extraction and interpretation of superimposed captions for broadcasted sports video", IEEE Transactions on Broadcasting, VOL. 54, NO. 3, September 2008
  23. http://www.sam sung.com /sec/consum er/tv-video/tv/led-tv/UN40F6100AF-features
  24. http://www.lge.co.kr/lgekr/product/detail/Lgekr ProductDetailCmd.laf?prdid=EPRD.246678

Cited by

  1. Comparison of Text Beginning Frame Detection Methods in News Video Sequences vol.21, pp.3, 2016, https://doi.org/10.5909/JBE.2016.21.3.307