• Journal of KIISE:Software and Applications
• /
• v.37 no.8
• /
• pp.629-640
• /
• 2010

The exemplar-based inpainting model is widely used to remove objects from natural images and to restore a damaged region. This paper presents a method which improves the performance of the conventional exemplar-based inpainting model by modifying three major parts in the model: data term, confidence term and patch selection. While the conventional data term is calculated using the local gradient, the proposed method uses 16 compass masks to get the global gradient to make the method robust to noise. To overcome the problem that the confidence term gets negligible in the inside of the eliminated region, a method is proposed which makes the confidence term decrease slowly in the eliminated region. The patch selection procedure is modified so that the closer patch has higher weight. Experiments showed that the proposed method produced more natural images and lower reconstruction error than the conventional exemplar-based inpainting.

• The KIPS Transactions:PartB
• /
• v.17B no.1
• /
• pp.47-54
• /
• 2010

Old archived film shows two major defects: line scratch and blobs. In this paper, we present a design and implementation of an automatic video restoration system for line scratches observed in archived film. We use autoregressive (AR) image model because we can make stochastic and specifically autoregressive image generation process with our PAST-PRESENT model and Sampling Pattern. We designed locality maximizing scanning pattern, which can generate nearly stationary time-like series of pixels, which is a strong requirement for a stochastic series to be autoregressive. The sampled pixel series undergoes filtering and model fitting using Durbin-Levinson algorithm before interpolation process. We designed three-stage film restoration system, which includes (1) film acquisition from VHS tapes, (2) simple line scratch detection and restoration, and (3) manual blob identification and sophisticated inpainting scheme. We implemented film acquisition and simple inpainting scheme on Texas Instruments DSP board TMS320DM642 EVM, and implemented our AR inpainting scheme on PC for sophisticated restoration. We experimented our scheme with two old Korean films: "Viva Freedom" and "Robot Tae-Kwon-V", and the experimental results show that our scheme improves Bertalmio's scheme for subjective quality (MOS), objective quality (PSNR), and especially restoration ratio (RR), which reflects how much similar to the manual inpainting results.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2011.05a
• /
• pp.375-377
• /
• 2011

The augmented reality is a technology which expresses the information hardly obtained in the real world by synthesizing virtual objects in the real world. This study uses IR LED marker to obtain the coordination of real world for registration of virtual objects. Since the IR LED marker is inserted in target object thus it has properties of invisible markers. To realize the augmented reality, the existence of marker can be observed in camera input image. Therefore, this paper provides a method to give the properties of perfect invisible marker by using inpainting technology when realizing IR LED marker.

• Journal of KIISE
• /
• v.44 no.2
• /
• pp.186-194
• /
• 2017

Depth-image-based rendering is a technique that can be applied in a variety of 3D-display systems. It generates the images that have been captured from virtual viewpoints by using a depth map. However, disoccluded hole-filling problems remain a challenging issue, as a newly exposed area appears in the virtual view. Image inpainting is a popular approach for the filling of the hole region. This paper presents a robust hole-filling method that reduces the error and generates a high quality-virtual view. First, the adaptive-patch size is decided using the color and depth information. Also, a partial filling method for which the patch similarity is used is proposed. These efforts reduce the error occurrence and the propagation. The experiment results show that the proposed method synthesizes the virtual view with a higher visual comfort compared with the existing methods.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.8
• /
• pp.3842-3855
• /
• 2018

A novel image completion method is proposed that uses the advantage of planar structural information to fill corrupted portions of an image. First, in estimating parameters of the projection plane, the image is divided into several planes, and their planar structural information is analyzed. Second, in calculating the a priori probability of patch and patch offset regularity, this information is converted into a constraint condition to guide the process of filling the hole. Experimental results show that the proposed algorithm is fast and effective, and ensures the structure continuity of the damaged region and smoothness of the texture.

• Journal of Korea Multimedia Society
• /
• v.15 no.12
• /
• pp.1442-1448
• /
• 2012

The problem of Metal Area Segmentation (MAS) in X-ray CT images is a very hard task because of metal artifacts. This research features a practical yet effective method for MAS in X-ray CT images that exploits both projection image and reconstructed image spaces. We employ the Relevant Neighbor Area (RNA) idea [1] originally developed for projection image inpainting in order to create a novel feature in the projection image space that distinctively represents metal and near-metal pixels with opposite signs. In the reconstructed result of the feature image, application of a simple thresholding technique provides accurate segmentation of metal areas due to nice separation of near-metal areas from metal areas in its histogram.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.10
• /
• pp.35-42
• /
• 2020

In this study, we propose a crack detection method using limited data with a U-Net based image inpainting technique that is a modified unsupervised anomaly detection method. Concrete cracking occurs due to a variety of causes and is a factor that can cause serious damage to the structure in the long term. In general, crack investigation uses an inspector's visual inspection on the concrete surfaces, which is less objective in judgment and has a high possibility of human error. Therefore, a method with objective and accurate image analysis processing is required. In recent years, the methods using deep learning have been studied to detect cracks quickly and accurately. However, when the amount of crack data on the building or infrastructure to be inspected is small, existing crack detection models using it often show a limited performance. Therefore, in this study, an unsupervised anomaly detection method was used to augment the data on the object to be inspected, and as a result of learning using the data, we confirmed the performance of 98.78% of accuracy and 82.67% of harmonic average (F1_Score).

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.2
• /
• pp.524-543
• /
• 2022

Correct facade image parsing is essential to the semantic understanding of outdoor scenes. Unfortunately, there are often various occlusions in front of buildings, which fails many existing methods. In this paper, we propose an end-to-end deep network for facade parsing with occlusions. The network learns to decompose an input image into visible and invisible parts by occlusion reasoning. Then, a context aggregation module is proposed to collect nonlocal cues for semantic segmentation of the visible part. In addition, considering the regularity of man-made buildings, a repetitive pattern completion branch is designed to infer the contents in the invisible regions by referring to the visible part. Finally, the parsing map of the input facade image is generated by fusing the results of the visible and invisible results. Experiments on both synthetic and real datasets demonstrate that the proposed method outperforms state-of-the-art methods in parsing facades with occlusions. Moreover, we applied our method in applications of image inpainting and 3D semantic modeling.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2015.07a
• /
• pp.122-124
• /
• 2015

This paper provides the design and implementation of Free Viewpoint TV System with multiple Microsoft Kinects. It generates a virtual view between two views by manipulating texture and depth image captured by Kinects in real-time. In order to avoid this, we propose the hole-filling scheme using Nearest neighbor and inpainting. As a result, holes generated by interference are filled with new depth values calculated by their neighbors. However, the depth values are not accurate, but are similar with their neighbors. And depending on the frequency of running a Nearest Neighbor method, we can see that edge's border would be shifted inner or outer of the object.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.302-307
• /
• 2007

본 논문은 이미지에서 불필요한 영역을 삭제하고, 그 영역을 배경과 어울리게 채워넣는 이미지 인페인팅 방법을 제안한다. 제안하는 인페인팅 방법은 크게 인페인팅 영역을 채우는 밴드 인페인팅(band in-painting)과 seamless cloning으로 나눌 수 있다. 밴드 인페인팅(band in-painting)은 인페인팅 영역의 경계를 따라서 일정한 두께를 가지는 타겟 밴드(target band)를 정의하고, 인페인팅 영역 밖의 모든 픽셀을 중심으로 하는, 타겟 밴드와 같은 모양과 크기를 가지는 소스 밴드(source band)와 타겟 밴드 차이를 계산하여, 그 값의 차이가 가장 작은 소스밴드 영역의 값을 인페인팅 영역에 복사하는 것이다. Seamless cloning은 인페인팅 영역과 입력 이미지의 경계를 없애는 것이다.