• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.935-943
• /
• 2020

In this paper, we propose a method using deep learning for high-resolution display of phase holograms. If a general interpolation method is used, the brightness of the reconstruction result is lowered, and noise and afterimages occur. To solve this problem, a hologram was trained with a neural network structure that showed good performance in the single-image super resolution (SISR). As a result, it was possible to improve the problem that occurred in the reconstruction result and increase the resolution. In addition, by adjusting the number of channels to increase performance, the result increased by more than 0.3dB in same training.

• Journal of Digital Contents Society
• /
• v.15 no.6
• /
• pp.737-743
• /
• 2014

For single image super resolution (SR), interpolation based and example based algorithms are extensively used. The interpolation algorithms have the strength of theoretical simplicity. However, those algorithms are tending to produce high resolution images with jagged edges, because they are not able to use more priori information. Example based algorithms have been studied in the past few years. For example based SR, the nearest neighbor based algorithms are extensively considered. Among them, neighbor embedding (NE) has been inspired by manifold learning method, particularly locally linear embedding. However, the sizes of local training sets are always too small. So, NE algorithm is weak in the performance of the visuality and quantitative measure by the poor generalization of nearest neighbor estimation. An improved NE algorithm with Support Vector Regression (SVR) was proposed to solve this problem. Given a low resolution image, the pixel values in its high resolution version are estimated by the improved NE. Comparing with bicubic and NE, the improvements of 1.25 dB and 2.33 dB are achieved in PSNR. Experimental results show that proposed method is quantitatively and visually more effective than prior works using bicubic interpolation and NE.

• The Journal of the Acoustical Society of Korea
• /
• v.37 no.1
• /
• pp.12-20
• /
• 2018

Efforts have been made to reconstruct low-resolution underwater images to high-resolution ones by using the image SR (Super-Resolution) method, all to improve efficiency when acquiring side-scan sonar images. As side-scan sonar images are similar with the optical images with respect to exploiting 2-dimensional signals, conventional image restoration methods for optical images can be considered as a solution. One of the most typical super-resolution methods for optical image is a sparse coding and there are studies for verifying applicability of sparse coding method for underwater images by analyzing sparsity of underwater images. Sparse coding is a method that obtains recovered signal from input signal by linear combination of dictionary and sparse coefficients. However, it requires huge computational load to accurately estimate sparse coefficients. In this study, a sparse coding based underwater image super-resolution method is applied while a selective reconstruction method for object region is suggested to reduce the processing time. For this method, this paper proposes an edge detection and object and non object region classification method for underwater images and combine it with sparse coding based image super-resolution method. Effectiveness of the proposed method is verified by reducing the processing time for image reconstruction over 32 % while preserving same level of PSNR (Peak Signal-to-Noise Ratio) compared with conventional method.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.233-237
• /
• 2009

This paper represents a new approach which addresses quality degradation of a synthesized view, when a virtual camera moves forward. Generally, interpolation technique using only two neighboring views is used when a virtual view is synthesized. Because a size of the object increases when the virtual camera moves forward, most methods solved this by interpolation in order to synthesize a virtual view. However, as it generates a degraded view such as blurred images, we prevent a synthesized view from being blurred by using more cameras in multiview camera configuration. That is, we solve this by applying super-resolution concept which reconstructs a high resolution image from several low resolution images. Therefore, data fusion is executed by geometric warping using a disparity of the multiple images followed by deblur operation. Experimental results show that the image quality can further be improved by reducing blur in comparison with interpolation method.

• Journal of International Society for Simulation Surgery
• /
• v.1 no.2
• /
• pp.57-61
• /
• 2014

We present a robust 3D facial reconstruction method using a single image generated by face-specific super resolution technique. Based on the several consecutive frames with low resolution, we generate a single high resolution image and a three dimensional facial model based on it. To do this, we apply PME method to compute patch similarities for SR after two-phase warping according to facial attributes. Based on the SRI, we extract facial features automatically and reconstruct 3D facial model with basis which selected adaptively according to facial statistical data less than a few seconds. Thereby, we can provide the facial image of various points of view which cannot be given by a single point of view of a camera.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.661-662
• /
• 2021

본 논문에서는 인공신경망 기반의 슈퍼 해상도(Super-resolution, SR) 기법을 이용하여 저해상도(Low-resolution, LR) 헤어 시뮬레이션을 고해상도(High-resolution, HR)로 노이즈 없이 표현할 수 있는 기법을 제안한다. LR과 HR 머리카락 간의 쌍은 헤어 시뮬레이션을 통해 얻을 수 있으며, 이렇게 얻어진 데이터를 이용하여 HR-LR 데이터 쌍을 설정한다. 학습할 때 사용되는 데이터는 머리카락의 위치를 지오메트리 이미지로 변환하여 사용한다. 우리가 제안하는 헤어 네트워크는 LR 이미지를 HR 이미지로 업스케일링 시키는 이미지 합성기를 위해 사용된다. 테스트 결과로 얻어진 HR 이미지가 HR 머리카락으로 다시 변환되면, 하나의 매핑 함수로 표현하기 어려운 머리카락의 찰랑거리는(Elastic) 움직임을 잘 표현할 수 있다. 합성 결과에 대한 성능으로는 전통적인 물리 기반 시뮬레이션보다 빠른 성능을 보였으며, 복잡한 수치해석을 몰라도 쉽게 실행이 가능하다.

• Journal of the Korean Society of Radiology
• /
• v.17 no.5
• /
• pp.693-699
• /
• 2023

Ultrasound is widely used in the medical field for non-destructive and non-invasive disease diagnosis. In order to improve the disease diagnosis accuracy of diagnostic medical images, improving spatial resolution is a very important factor. In this study, we aim to model the super resolution convolutional neural network (SRCNN) algorithm in ultrasound images and analyze its applicability in the medical diagnostic field. The study was conducted as an experimental study using Field II simulation and open source clinical liver hemangioma ultrasound imaging. The proposed SRCNN algorithm was modeled so that end-to-end learning can be applied from low resolution (LR) to high resolution. As a result of the simulation, we confirmed that the full width at half maximum in the phantom image using a Field II program was improved by 41.01% compared to LR when SRCNN was used. In addition, the peak to signal to noise ratio (PSNR) and structural similarity index (SSIM) evaluation results showed that SRCNN had the excellent value in both simulated and real liver hemangioma ultrasound images. In conclusion, the applicability of SRCNN to ultrasound images has been proven, and we expected that proposed algorithm can be used in various diagnostic medical fields.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.10
• /
• pp.84-91
• /
• 2016

Most recently, the technology of around view monitoring(AVM) system or the security systems could provide users with images by using a fisheye lens. The filmed images through fisheye lens have an advantage of providing a wider range of scenes. On the other hand, filming through fisheye lens also has disadvantages of distorting images. Especially, it causes the sharpness of images to degrade because the edge of images is out of focus. The influence of a blur still remains at the end of the range when the super-resolution techniques is applied in order to enhance the sharpness. It degrades the clarity of high resolution images and occurs artifacts, which leads to deterioration in the performance of super-resolution algorithm. Therefore, in this paper we propose self-similarity-based pre-processing method to improve the sharpness at the edge. Additionally, we implement the acceleration in the GPU environment of entire algorithm and verify the acceleration.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.10 no.10
• /
• pp.5129-5152
• /
• 2016

Multi-view super-resolution (MVSR) aims to estimate a high-resolution (HR) image from a set of low-resolution (LR) images that are captured from different viewpoints (typically by different cameras). MVSR is usually applied in camera array imaging. Given that MVSR is an ill-posed problem and is typically computationally costly, we super-resolve multi-view LR images of the original scene via image fusion (IF) and blind deblurring (BD). First, we reformulate the MVSR problem into two easier problems: an IF problem and a BD problem. We further solve the IF problem on the premise of calculating the depth map of the desired image ahead, and then solve the BD problem, in which the optimization problems with respect to the desired image and with respect to the unknown blur are efficiently addressed by the alternating direction method of multipliers (ADMM). Our approach bridges the gap between MVSR and BD, taking advantages of existing BD methods to address MVSR. Thus, this approach is appropriate for camera array imaging because the blur kernel is typically unknown in practice. Corresponding experimental results using real and synthetic images demonstrate the effectiveness of the proposed method.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.5
• /
• pp.2366-2395
• /
• 2018

Multi-view super-resolution (MVSR) refers to the process of reconstructing a high-resolution (HR) image from a set of low-resolution (LR) images captured from different viewpoints typically by different cameras. These multi-view images are usually obtained by a camera array. In our previous work [1], we super-resolved multi-view LR images via image fusion (IF) and blind deblurring (BD). In this paper, we present a new MVSR method that jointly realizes IF and BD based on an integrated energy function optimization. First, we reformulate the MVSR problem into a multi-channel blind deblurring (MCBD) problem which is easier to be solved than the former. Then the depth map of the desired HR image is calculated. Finally, we solve the MCBD problem, in which the optimization problems with respect to the desired HR image and with respect to the unknown blur are efficiently addressed by the alternating direction method of multipliers (ADMM). Experiments on the Multi-view Image Database of the University of Tsukuba and images captured by our own camera array system demonstrate the effectiveness of the proposed method.