• Title/Summary/Keyword: Image patch

Search Result 219, Processing Time 0.027 seconds

Patch size adaptive image inpainting

  • Liu, Huaming;Lu, Guanming;Bi, Xuehui;Wang, Weilan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.10
    • /
    • pp.3642-3667
    • /
    • 2021
  • Texture synthesis technology has the advantages of repairing texture and structure at the same time. However, during the filling process, the size of the patch is fixed, and the content of the filling is not fully considered. In order to be able to adaptively change the patch size, we used the exemplar-based inpainting technique as the test algorithm, considering the image structure and texture, calculated the image structure patch size and texture patch size, and comprehensively determined the image patch size. This can adaptively change the patch size according to the filling content. In addition, we use multi-layer images to calculate the priority, so that the order of image repair was more stable. The proposed repair algorithm is compared with other image repair algorithms. The experimental results showed that the proposed adaptive image repair algorithm can better repair the texture and structure of the image, which proved the effectiveness of the proposed algorithm.

Interpretation of Real Information-missing Patch of Remote Sensing Image with Kriging Interpolation of Spatial Statistics

  • Yiming, Feng;Xiangdong, Lei;Yuanchang, Lu
    • Proceedings of the KSRS Conference
    • /
    • 2003.11a
    • /
    • pp.1479-1481
    • /
    • 2003
  • The aim of this paper was mainly to interpret the real information-missing patch of image by using the kriging interpolation technology of spatial statistics. The TM Image of the Jingouling Forest Farm of Wangqing Forestry Bureau of Northeast China on 1 July 1997 was used as the tested material in this paper. Based on the classification for the TM image, the information pixel-missing patch of image was interpolated by the kriging interpolation technology of spatial statistics theory under the image treatment software-ERDAS and the geographic information system software-Arc/Info. The interpolation results were already passed precise examination. This paper would provide a method and means for interpreting the information-missing patch of image.

  • PDF

A Study of Band Characteristic of Color Aerial Photos for Image Matching (영상 정합을 위한 컬러 항공사진의 밴드 특성에 관한 연구)

  • Kim, Jin-Kwang;Lee, Ho-Nam;Hwang, Chul-Sue
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2007.04a
    • /
    • pp.187-190
    • /
    • 2007
  • This study is for analyzing best band in image matching using correlation coefficient of left and right images of stereo image pair, lot red, green, blue band images separated from color aerial photo and gray image converted from the same color aerial photo image. The image matching is applied to construct Digital Elevation Model(DEM) or terrain data. The correlation coefficients and variation by change of pixel patch size are computed from pixel patches of which sizes are $11{\times}11{\sim}101{\times}101$. Consequently, the correlation coefficient in red band image is highest. The lowest is in blue band. Therefore, to construct terrain data using image matching, the red band image is preferable. As the size of pixel patch is growing, the correlation coefficient is increasing. But increasing rate declines from $51{\times}51$ image patch size and above. It is proved that the smaller pixel patch size than $51{\times}51$ is applied to construct terrain data using image matching.

  • PDF

A New Operator Extracting Image Patch Based on EPLL

  • Zhang, Jianwei;Jiang, Tao;Zheng, Yuhui;Wang, Jin;Xie, Jiacen
    • Journal of Information Processing Systems
    • /
    • v.14 no.3
    • /
    • pp.590-599
    • /
    • 2018
  • Multivariate finite mixture model is becoming more and more popular in image processing. Performing image denoising from image patches to the whole image has been widely studied and applied. However, there remains a problem that the structure information is always ignored when transforming the patch into the vector form. In this paper, we study the operator which extracts patches from image and then transforms them to the vector form. Then, we find that some pixels which should be continuous in the image patches are discontinuous in the vector. Due to the poor anti-noise and the loss of structure information, we propose a new operator which may keep more information when extracting image patches. We compare the new operator with the old one by performing image denoising in Expected Patch Log Likelihood (EPLL) method, and we obtain better results in both visual effect and the value of PSNR.

Effective Exemplar-Based Image Inpainting Using Patch Extrapolation (패치 외삽을 이용한 효과적인 예제기반 영상 인페인팅)

  • Kim, Jin-Ju;Lee, Si-Woong
    • The Journal of the Korea Contents Association
    • /
    • v.14 no.2
    • /
    • pp.1-9
    • /
    • 2014
  • Image inpainting is the widely used technique to restore a damaged region or to fill a hole in an image. The exemplar-based technique effectively generates new texture by copying colour values of the most correlated patch in the source into the empty region of the current patch. In traditional exemplar-based synthesis, the patch correlation is computed using only the already filled pixels of the current patch. Thus, by ignoring the correlation between the hole regions of the two patches, an undesirable patch which is highly correlated with the current patch in the already filled area but considerably dissimilar in the area to be filled can be selected, which results in bad texture propagation. To avoid such problems, a new exemplar-based inpainting method using patch extrapolation is proposed. The empty part of the current patch is extrapolated beforehand, and then the complete patch is used for finding its exemplar. Experimental results show that the proposed method provides more natural synthesis results than the conventional ones.

Iterative Low Rank Approximation for Image Denoising (영상 잡음 제거를 위한 반복적 저 계수 근사)

  • Kim, Seehyun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.10
    • /
    • pp.1317-1322
    • /
    • 2021
  • Nonlocal similarity of natural images leads to the fact that a patch matrix whose columns are similar patches of the reference patch has a low rank. Images corrupted by additive white Gaussian noises (AWGN) make their patch matrices to have a higher rank. The noise in the image can be reduced by obtaining low rank approximation of the patch matrices. In this paper, an image denoising algorithm is proposed, which first constructs the patch matrices by combining the similar patches of each reference patch, which is a part of the noisy image. For each patch matrix, the proposed algorithm calculates its low rank approximate, and then recovers the original image by aggregating the low rank estimates. The simulation results using widely accepted test images show that the proposed denoising algorithm outperforms four recent methods.

A Sobel Operator Combined with Patch Statistics Algorithm for Fabric Defect Detection

  • Jiang, Jiein;Jin, Zilong;Wang, Boheng;Ma, Li;Cui, Yan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.2
    • /
    • pp.687-701
    • /
    • 2020
  • In the production of industrial fabric, it needs automatic real-time system to detect defects on the fabric for assuring the defect-free products flow to the market. At present, many visual-based methods are designed for detecting the fabric defects, but they usually lead to high false alarm. Base on this reason, we propose a Sobel operator combined with patch statistics (SOPS) algorithm for defects detection. First, we describe the defect detection model. mean filter is applied to preprocess the acquired image. Then, Sobel operator (SO) is applied to deal with the defect image, and we can get a coarse binary image. Finally, the binary image can be divided into many patches. For a given patch, a threshold is used to decide whether the patch is defect-free or not. Finally, a new image will be reconstructed, and we did a loop for the reconstructed image to suppress defects noise. Experiments show that the proposed SOPS algorithm is effective.

Fast Patch-based De-blurring with Directional-oriented Kernel Estimation

  • Min, Kyeongyuk;Chong, Jongwha
    • Journal of IKEEE
    • /
    • v.21 no.1
    • /
    • pp.46-65
    • /
    • 2017
  • This paper proposes a fast patch-based de-blurring algorithm including kernel estimation based on the angle between the edge and the blur direction. For de-blurring, image patches from the most informative edges in the blurry image are used to estimate a kernel with low computational cost. Moreover, the kernels of each patch are estimated based on the correlation between the edge direction and the blur direction. This makes the final kernel more reliable and creates an accurate latent image from the blurry image. The combination of directionally oriented kernel estimation and patch-based de-blurring is faster and more accurate than existing state-of-the art methods. Experimental results using various test images show that the proposed method achieves its objectives: speed and accuracy.

Ensemble Learning Based on Tumor Internal and External Imaging Patch to Predict the Recurrence of Non-small Cell Lung Cancer Patients in Chest CT Image (흉부 CT 영상에서 비소세포폐암 환자의 재발 예측을 위한 종양 내외부 영상 패치 기반 앙상블 학습)

  • Lee, Ye-Sel;Cho, A-Hyun;Hong, Helen
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.3
    • /
    • pp.373-381
    • /
    • 2021
  • In this paper, we propose a classification model based on convolutional neural network(CNN) for predicting 2-year recurrence in non-small cell lung cancer(NSCLC) patients using preoperative chest CT images. Based on the region of interest(ROI) defined as the tumor internal and external area, the input images consist of an intratumoral patch, a peritumoral patch and a peritumoral texture patch focusing on the texture information of the peritumoral patch. Each patch is trained through AlexNet pretrained on ImageNet to explore the usefulness and performance of various patches. Additionally, ensemble learning of network trained with each patch analyzes the performance of different patch combination. Compared with all results, the ensemble model with intratumoral and peritumoral patches achieved the best performance (ACC=98.28%, Sensitivity=100%, NPV=100%).

The Effect of Training Patch Size and ConvNeXt application on the Accuracy of CycleGAN-based Satellite Image Simulation (학습패치 크기와 ConvNeXt 적용이 CycleGAN 기반 위성영상 모의 정확도에 미치는 영향)

  • Won, Taeyeon;Jo, Su Min;Eo, Yang Dam
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.40 no.3
    • /
    • pp.177-185
    • /
    • 2022
  • A method of restoring the occluded area was proposed by referring to images taken with the same types of sensors on high-resolution optical satellite images through deep learning. For the natural continuity of the simulated image with the occlusion region and the surrounding image while maintaining the pixel distribution of the original image as much as possible in the patch segmentation image, CycleGAN (Cycle Generative Adversarial Network) method with ConvNeXt block applied was used to analyze three experimental regions. In addition, We compared the experimental results of a training patch size of 512*512 pixels and a 1024*1024 pixel size that was doubled. As a result of experimenting with three regions with different characteristics,the ConvNeXt CycleGAN methodology showed an improved R2 value compared to the existing CycleGAN-applied image and histogram matching image. For the experiment by patch size used for training, an R2 value of about 0.98 was generated for a patch of 1024*1024 pixels. Furthermore, As a result of comparing the pixel distribution for each image band, the simulation result trained with a large patch size showed a more similar histogram distribution to the original image. Therefore, by using ConvNeXt CycleGAN, which is more advanced than the image applied with the existing CycleGAN method and the histogram-matching image, it is possible to derive simulation results similar to the original image and perform a successful simulation.