DOI QR코드

DOI QR Code

ENHANCED EXEMPLAR BASED INPAINTING USING PATCH RATIO

  • KIM, SANGYEON (INTERDISCIPLINARY PROGRAM IN COMPUTATIONAL SCIENCE AND TECHNOLOGY, SEOUL NATIONAL UNIVERSITY) ;
  • MOON, NAMSIK (DEAPRTMENT OF MATHEMATICS, AJOU UNIVERSITY) ;
  • KANG, MYUNGJOO (DEAPRTMENT OF MATHEMATICAL SCIENCES, SEOUL NATIONAL UNIVERSITY)
  • Received : 2018.04.10
  • Accepted : 2018.04.27
  • Published : 2018.06.25

Abstract

In this paper, we propose a new method for template matching, patch ratio, to inpaint unknown pixels. Before this paper, many inpainting methods used sum of squared differences(SSD) or sum of absolute differences(SAD) to calculate distance between patches and it was very useful for closest patches for the template that we want to fill in. However, those methods don't consider about geometric similarity and that causes unnatural inpainting results for human visuality. Patch ratio can cover the geometric problem and moreover computational cost is less than using SSD or SAD. It is guaranteed about finding the most similar patches by Cauchy-Schwarz inequality. For ignoring unnecessary process, we compare only selected candidates by priority calculations. Exeperimental results show that the proposed algorithm is more efficent than Criminisi's one.

Acknowledgement

Supported by : NRF, IITP

References

  1. A. Criminisi, P. Perez, and K. Toyama "Region filling and object removal by exemplar-based image inpainting", IEEE Trans. Image Processing, vol. 13, no.9, pp.1200-1212, Sept. 2004 https://doi.org/10.1109/TIP.2004.833105
  2. Alexei A. Efros and Thomas K. Leung. "Texture Synthesis by Non-parametric Sampling", IEEE International Conference on Computer Vision, Corfu, Greece, Sept. 1999
  3. Wen-Huang Cheng, Chun-Wei Hsieh, Sheng-Kai Lin, Chia-Wei Wang, and Ja-Ling Wu. "Robust Algorithm for Exemplar-Based Image Inpainting", The International Conference on Computer Graphics, Imaging and Vision (CGIV 2005), Beijing, China, 64-69, 2005
  4. Aurelie Bugeau, Marcelo Bertalmio, Vicent Caselles, Member, IEEE, and Guillermo Sapiro "A Comprehensive Framework for Image Inpainting", IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL.19, NO.10, 2634-2645, OCT. 2010 https://doi.org/10.1109/TIP.2010.2049240
  5. Rudin, L. I. , Osher, S. and Fatemi, E. "Nonlinear total variation based noise removal algorithms". Physica D, 1992
  6. F. Bornemann and T. Marz. "Fast image inpainting based on coherence transport". Journal of Mathematical Imaging and Vision, 2007