Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Signboard Replacement in Video clip

비디오 클립에서의 간판영역 교체 기법

  • Kim, Joohyeon (Department of Computer and Software, Hanyang University) ;
  • Park, Jong-Il (Department of Computer and Software, Hanyang University)
  • 김주현 (한양대학교 컴퓨터소프트웨어학과) ;
  • 박종일 (한양대학교 컴퓨터소프트웨어학과)
  • Received : 2017.03.14
  • Accepted : 2017.05.02
  • Published : 2017.05.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a technique for smoothly replacing a signboard image in a video clip with another signboard image and an application for performing it. In order to replace the signboard area in the image, it must be tracked and the shape of the signboard changed. Also, when an obstruction occurs due to a front object, the obscured area is extracted so that only the signboard area can be replaced, and color correction is performed for natural synthesis. The proposed application receives the information required by the algorithm from the user and explains the required functions, thereby disclosing the entire process in which the algorithm is actually implemented and tested. This can be used for a variety of media, and can be used as a means to remove the indirect advertisement that is often seen, and it can also be used as a new advertisement model in which another advertisement image is inserted into the image to be advertised.

본 논문에서는 비디오 클립에 있는 간판 영상을 다른 간판 영상으로 자연스럽게 교체하는 기법과 이를 수행하기 위한 어플리케이션을 제안한다. 영상에 있는 간판영역을 교체하기 위해서는 이를 추적하고, 간판의 형태변화를 알아내야 한다. 또한 전방 물체에 의하여 가려짐이 발생 했을 때에는 간판 영역만 교체될 수 있도록 가려진 영역을 추출하고, 자연스러운 합성을 위해서 색 보정을 수행하였다. 제안하는 어플리케이션은 알고리즘에 필요한 정보를 사용자로부터 입력받고, 필요한 기능을 설명함으로써 알고리즘이 실질적으로 구현되고 테스트해 볼 수 있는 전체 프로세스를 공개한다. 이는 다양한 미디어 매체에 활용될 수 있는데, 흔히 볼 수 있는 간접 광고를 제거할 수 있는 수단으로도 사용될 수 있고, 광고하고 싶은 영상에 다른 광고 영상을 삽입하여 홍보하는 새로운 광고모델로도 활용될 수 있다.

Keywords

Acknowledgement

Grant : ICT 장비용 SW 플랫폼 구축

Supported by : 정보통신기술진흥센터

References

  1. X.Yan, J.Shen, Y.He, X.Mao "Re-Texturing By Intrinsic Video." Digital Image Computing:Techniques and Applications (DICTA), 2010 International Conference on IEEE 2010. 486-491. Dec. 2010
  2. Y.Guo. H.Sun, Q.Peng, Z.Jiang "Mesh-Guided Optimized Retexturing for Image and Video." IEEE Transactions on Visualization and Computer Graphics, vol 14 no 2 426-439. Mar. 2008 https://doi.org/10.1109/TVCG.2007.70438
  3. J.Kim, J.Park "Signboard Replacement in Video Clip" Proceeding of International Workshop on Advanced Image Technology 2017, Penang, Malaysia, Jan. 2017
  4. DG.LOWE. "Distinctive image features from scale-invariant keypoints." International journal of computer vision, vol 60 no 2 91-110. Jan, 2004 https://doi.org/10.1023/B:VISI.0000029664.99615.94
  5. Altman, N. S. "An introduction to kernel and nearest-neighbor nonparametric regression". The American Statistician. 46 (3): 175-185. Feb, 1990
  6. Martin A. Fischler & Robert C. Bolles. "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography". Comm. of the ACM. 24 (6): 381-395. June, 1981 https://doi.org/10.1145/358669.358692
  7. CHEN, Baoquan; DACHILLE, Frank; KAUFMAN, Arie. "Forward image mapping." Visualization'99. Proceedings. IEEE, p. 89-514. Oct, 1999
  8. C.Weng, H.Chen, C.Fuh "A novel automatic white balance method for digital still cameras." 2005 IEEE International Symposium on Circuits and Systems. IEEE, pp. 3801-3804.May, 2005