• Title/Summary/Keyword: Image super-resolution

Search Result 243, Processing Time 0.026 seconds

MRI Image Super Resolution through Filter Learning Based on Surrounding Gradient Information in 3D Space (3D 공간상에서의 주변 기울기 정보를 기반에 둔 필터 학습을 통한 MRI 영상 초해상화)

  • Park, Seongsu;Kim, Yunsoo;Gahm, Jin Kyu
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.2
    • /
    • pp.178-185
    • /
    • 2021
  • Three-dimensional high-resolution magnetic resonance imaging (MRI) provides fine-level anatomical information for disease diagnosis. However, there is a limitation in obtaining high resolution due to the long scan time for wide spatial coverage. Therefore, in order to obtain a clear high-resolution(HR) image in a wide spatial coverage, a super-resolution technology that converts a low-resolution(LR) MRI image into a high-resolution is required. In this paper, we propose a super-resolution technique through filter learning based on information on the surrounding gradient information in 3D space from 3D MRI images. In the learning step, the gradient features of each voxel are computed through eigen-decomposition from 3D patch. Based on these features, we get the learned filters that minimize the difference of intensity between pairs of LR and HR images for similar features. In test step, the gradient feature of the patch is obtained for each voxel, and the filter is applied by selecting a filter corresponding to the feature closest to it. As a result of learning 100 T1 brain MRI images of HCP which is publicly opened, we showed that the performance improved by up to about 11% compared to the traditional interpolation method.

A Study on High Resolution Reconstruction Algorithms for improving Resolution (해상도 향상을 위한 고해상도 복원 알고리즘 연구)

  • Baek, Young-Hyun;Moon, Sung-Ryong
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.17 no.1
    • /
    • pp.72-79
    • /
    • 2007
  • In this paper, It propose a new restoration algorithm of high resolution, which is reconstructed to high resolution image using low resolution image informations. The proposed algorithm is constructed based on super resolution theory, it is consisted of progressive steps of the integration and construction. It reduced a lot of data-processing capacity and noise with integration through sub-pixel movement and wavelet basis through a higher resolution. As a result, it is shown that the main information is maintained and the error rate is improved. Using expansion fuzzy wavelet B-spline interpolation in stage of construction, it is confirmed that we can achieve smoothing image and good resolution without blur and block.

SDCN: Synchronized Depthwise Separable Convolutional Neural Network for Single Image Super-Resolution

  • Muhammad, Wazir;Hussain, Ayaz;Shah, Syed Ali Raza;Shah, Jalal;Bhutto, Zuhaibuddin;Thaheem, Imdadullah;Ali, Shamshad;Masrour, Salman
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.11
    • /
    • pp.17-22
    • /
    • 2021
  • Recently, image super-resolution techniques used in convolutional neural networks (CNN) have led to remarkable performance in the research area of digital image processing applications and computer vision tasks. Convolutional layers stacked on top of each other can design a more complex network architecture, but they also use more memory in terms of the number of parameters and introduce the vanishing gradient problem during training. Furthermore, earlier approaches of single image super-resolution used interpolation technique as a pre-processing stage to upscale the low-resolution image into HR image. The design of these approaches is simple, but not effective and insert the newer unwanted pixels (noises) in the reconstructed HR image. In this paper, authors are propose a novel single image super-resolution architecture based on synchronized depthwise separable convolution with Dense Skip Connection Block (DSCB). In addition, unlike existing SR methods that only rely on single path, but our proposed method used the synchronizes path for generating the SISR image. Extensive quantitative and qualitative experiments show that our method (SDCN) achieves promising improvements than other state-of-the-art methods.

Stage-GAN with Semantic Maps for Large-scale Image Super-resolution

  • Wei, Zhensong;Bai, Huihui;Zhao, Yao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.8
    • /
    • pp.3942-3961
    • /
    • 2019
  • Recently, the models of deep super-resolution networks can successfully learn the non-linear mapping from the low-resolution inputs to high-resolution outputs. However, for large scaling factors, this approach has difficulties in learning the relation of low-resolution to high-resolution images, which lead to the poor restoration. In this paper, we propose Stage Generative Adversarial Networks (Stage-GAN) with semantic maps for image super-resolution (SR) in large scaling factors. We decompose the task of image super-resolution into a novel semantic map based reconstruction and refinement process. In the initial stage, the semantic maps based on the given low-resolution images can be generated by Stage-0 GAN. In the next stage, the generated semantic maps from Stage-0 and corresponding low-resolution images can be used to yield high-resolution images by Stage-1 GAN. In order to remove the reconstruction artifacts and blurs for high-resolution images, Stage-2 GAN based post-processing module is proposed in the last stage, which can reconstruct high-resolution images with photo-realistic details. Extensive experiments and comparisons with other SR methods demonstrate that our proposed method can restore photo-realistic images with visual improvements. For scale factor ${\times}8$, our method performs favorably against other methods in terms of gradients similarity.

Image Resolution Enhancement by Improved S&A Method using POCS (POCS 이론을 이용한 개선된 S&A 방법에 의한 영상의 화질 향상)

  • Yoon, Soo-Ah;Lee, Tae-Gyoun;Lee, Sang-Heon;Son, Myoung-Kyu;Kim, Duk-Gyoo;Won, Chul-Ho
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.11
    • /
    • pp.1392-1400
    • /
    • 2011
  • In most digital imaging applications, high-resolution images or videos are usually desired for later image processing and analysis. The image signal obtained from general imaging system occurs image degradation during the process of image acquirement caused by the optics, physical constraints and the atmosphere effects. Super-resolution reconstruction, one of the solution to address this problem, is image reconstruction technique that produces a high-resolution image from several low-resolution frames in video sequences. In this paper, we propose an improved super-resolution method using Projection onto Convex Sets (POCS) method based on Shift & Add (S&A). The image using conventional algorithms is sensitive to noise. To solve this problem, we propose a fusion algorithm of S&A and POCS. Also we solve the problem using BLPF (Butterworth Low-pass Filter) in frequency domain as optical blur. Our method is robust to noise and has sharpness enhancement ability. Experimental results show that the proposed super-resolution method has better resolution enhancement performance than other super-resolution methods.

Single Image Super Resolution using sub-Edge Extraction based on Hierarchical Structure (계층적 보조 경계 추출을 이용한 단일 영상의 초해상도 기법)

  • Hyun Ho, Han
    • Journal of Digital Policy
    • /
    • v.1 no.2
    • /
    • pp.53-59
    • /
    • 2022
  • In this paper, we proposed a method using sub-edge information extracted through a hierarchical structure in the process of generating super resolution based on a single image. In order to improve the quality of super resolution, it is necessary to clearly distinguish the shape of each area while clearly expressing the boundary area in the image. The proposed method assists edge information of the image in deep learning based super resolution method to create an improved super resolution result while maintaining the structural shape of the boundary region, which is an important factor determining the quality in the super resolution process. In addition to the group convolution structure for performing deep learning based super resolution, a separate hierarchical edge accumulation extraction process based on high-frequency band information for sub-edge extraction is proposed, and a method of using it as an auxiliary feature is proposed. Experimental results showed about 1% performance improvement in PSNR and SSIM compared to the existing super resolution.

Patch Information based Linear Interpolation for Generating Super-Resolution Images in a Single Image (단일이미지에서의 초해상도 영상 생성을 위한 패치 정보 기반의 선형 보간 연구)

  • Han, Hyun-Ho;Lee, Jong-Yong;Jung, Kye-Dong;Lee, Sang-Hun
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.6
    • /
    • pp.45-52
    • /
    • 2018
  • In this paper, we propose a linear interpolation method based on patch information generated from a low - resolution image for generating a super resolution image in a single image. Using the regression model of the global space, which is a conventional super resolution generation method, results in poor quality in general because of lack of information to be referred to a specific region. In order to compensate for these results, we propose a method to extract meaningful information by dividing the region into patches in the process of super resolution image generation, analyze the constituents of the image matrix region extended for super resolution image generation, We propose a method of linear interpolation based on optimal patch information that is searched by correlating patch information based on the information gathered before the interpolation process. For the experiment, the original image was compared with the reconstructed image with PSNR and SSIM.

Feasibility Study of CNN-based Super-Resolution Algorithm Applied to Low-Resolution CT Images

  • Doo Bin KIM;Mi Jo LEE;Joo Wan HONG
    • Korean Journal of Artificial Intelligence
    • /
    • v.12 no.1
    • /
    • pp.1-6
    • /
    • 2024
  • Recently, various techniques are being applied through the development of medical AI, and research has been conducted on the application of super-resolution AI models. In this study, evaluate the results of the application of the super-resolution AI model to brain CT as the basic data for future research. Acquiring CT images of the brain, algorithm for brain and bone windowing setting, and the resolution was downscaled to 5 types resolution image based on the original resolution image, and then upscaled to resolution to create an LR image and used for network input with the original imaging. The SRCNN model was applied to each of these images and analyzed using PSNR, SSIM, Loss. As a result of quantitative index analysis, the results were the best at 256×256, the brain and bone window setting PSNR were the same at 33.72, 35.2, and SSIM at 0.98 respectively, and the loss was 0.0004 and 0.0003, respectively, showing relatively excellent performance in the bone window setting CT image. The possibility of future studies aimed image quality and exposure dose is confirmed, and additional studies that need to be verified are also presented, which can be used as basic data for the above studies.

Study of Efficient Network Structure for Real-time Image Super-Resolution (실시간 영상 초해상도 복원을 위한 효율적인 신경망 구조 연구)

  • Jeong, Woojin;Han, Bok Gyu;Lee, Dong Seok;Choi, Byung In;Moon, Young Shik
    • Journal of Internet Computing and Services
    • /
    • v.19 no.4
    • /
    • pp.45-52
    • /
    • 2018
  • A single-image super-resolution is a process of restoring a high-resolution image from a low-resolution image. Recently, the super-resolution using the deep neural network has shown good results. In this paper, we propose a neural network structure that improves speed and performance over conventional neural network based super-resolution methods. To do this, we analyze the conventional neural network based super-resolution methods and propose solutions. The proposed method reduce the 5 stages of the conventional method to 3 stages. Then we have studied the optimal width and depth by experimenting on the width and depth of the network. Experimental results have shown that the proposed method improves the disadvantages of the conventional methods. The proposed neural network structure showed superior performance and speed than the conventional method.

An Image Processing Speed Enhancement in a Multi-Frame Super Resolution Algorithm by a CUDA Method (CUDA를 이용한 초해상도 기법의 영상처리 속도개선 방법)

  • Kim, Mi-Jeong
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.14 no.4
    • /
    • pp.663-668
    • /
    • 2011
  • Although multi-frame super resolution algorithm has many merits but it demands too much calculation time. Researches have shown that image processing time can be reduced using a CUDA(Compute unified device architecture) which is one of GPGPU(General purpose computing on graphics processing unit) models. In this paper, we show that the processing time of multi-frame super resolution algorithm can be reduced by employing the CUDA. It was applied not to the whole parts but to the largest time consuming parts of the program. The simulation result shows that using a CUDA can reduce an operation time dramatically. Therefore it can be possible that multi-frame super resolution algorithm is implemented in real time by using libraries of image processing algorithms which are made by a CUDA.