• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.3
• /
• pp.105-111
• /
• 2014

Image resolution enhancement is a technique to generate high-resolution image through improving resolution of low-resolution obtained image. It is important to estimate correctly missing pixel value in low-resolution obtained image for image resolution enhancement. In this paper, multiple shortfall estimation method for image resolution enhancement is proposed. The proposed method estimate separate multiple shortfall by predictive degradation-restoration processing in sub-images of obtained image, and generate result image combining the estimated shortfall and interpolated obtained-image. Lastly, final reconstruction image is generated by deblurring of the result image. The experimental results demonstrate that the proposed method has the best results of all compared methods in objective image quality index: PSNR, SSIM, and FSIM. The quality of reconstructed image is superior to all compared methods, and the proposed method has better lower computational complexity than compared methods. The proposed method can be useful for image resolution enhancement.

• Journal of KIISE:Software and Applications
• /
• v.37 no.7
• /
• pp.573-577
• /
• 2010

Image resolution improvement is commonly technique for applications such as image reconstruction or enlargement. It is important to remove image quality degradation such as blocking effect or artificiality occurrence. In this paper, we propose image resolution improvement method using loss information of image. The proposed compute and estimate by low level interpolation of obtained low resolution image, it is applied by interpolated high resolution as 1-stage interpolation. We generate last interpolation image by iteration of error computation and application between obtained low resolution image and 1-stage interpolation image. By experiments using same test images, we confirmed improvement over 3.2dB of average PSNR and enhancement of subject image quality. Also, we can reduce more than 85% computation complexity. The proposed image resolution improvement method may be helpful for various applications of image processing.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2015.07a
• /
• pp.264-267
• /
• 2015

본 논문에서는 개선된 고속의 Back Projection 기법과 에지맵 보간을 이용한 단일영상 기반의 초해상도(super resolution) 영상을 생성하는 알고리즘을 제안한다. 본 논문에서 제안하는 알고리즘은 영상의 색채 왜곡을 방지하기 위해 RGB 컬러 도메인에서 HSV 컬러 도메인으로 변경하여 밝기정보인 V만 이용한다. 먼저 잡음제거와 속도 향상을 위해 개선된 고속 back projection을 이용해 영상을 확대 재구성한다. 이와 함께 LoG(laplacian of gaussian) 필터링을 이용하여 에지 맵을 추출한다. 에지의 정보와 back projection의 결과를 이용하여 고해상도 영상을 재구성한다. 제안하는 알고리즘을 이용하여 복원한 영상은 부자연스러운 인공물을 효과적으로 제거하고, blur현상을 줄여 에지 정보를 보정하고 강조해준다. 또한 실험을 통해 제안하는 알고리즘이 기존의 보간법과 전통적인 back projection 결과보다 주관적인 화질이 우수하고 객관적으로 우수한 성능을 나타내는 것을 입증한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.373-375
• /
• 2011

최근 들어, Time-of-Flight (TOF) 방식의 깊이 센서가 컴퓨터 비전이나 영상처리분야 등의 연구에서 다양하게 활용되고 있다. TOF 방식의 깊이 센서는 실시간으로 정확한 깊이 정보를 획득할 수 있는 장점이 있는 반면, 해상도가 낮고 센서의 광학적 특성으로 인해 노이즈가 발생한다는 단점이 있다. 본 논문에서는 이러한 깊이 센서의 단점을 극복하고 고품질의 다시점 영상 합성을 위해 기존 깊이 센서에 여러 대의 Charge-coupled Device (CCD) 카메라를 결합하여 시점 간 일관성 있는 고해상도의 깊이 영상을 획득하는 기술을 제안한다. 한정되어 있는 시점의 영상을 이용하여 다시점 영상을 합성할 때, 각 시점에 해당하는 깊이 영상의 정확도에 따라 합성되는 영상의 품질이 결정된다. 따라서 보유 시점에 해당하는 깊이 영상 간의 일관성이 유지되고 객체의 경계가 정확히 보존되어야만 생성되는 임의 시점 영상의 품질이 보장될 수 있다. 이에, 본 논문에서는 Joint Bilateral Upsampling (JBU)을 기반으로 시점 간 일관성을 고려한 깊이 영상의 해상도 개선 기술을 제안하고 이를 통해 다시점 영상 합성 결과의 품질을 향상시킨다.

• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2000.08a
• /
• pp.213-216
• /
• 2000

본 논문에서는 volume rendering 기법을 이용하여 2차원 MRI 영상들을 합성하여 3차원 영상 만들 때 보다 해상도를 높이기 위한 개선된 sampling방법을 소개한다 2차원 슬라이스 영상들이 3차원으로 재구성할 때 voxel 기반으로 렌더링을 하기 때문에 오브젝트의 내부 영역까지도 볼 수 있는 것이 volume rendering의 가장 큰 장점이다. 따라서 영상을 재구성하는 과정에서 보다 향상된 interpolation을 적용시켜서 공간 해상도를 향상시키면 보다 명확하게 오브젝트 내부 정보를 살펴 볼 수 있다. 본 논문에서는 nearest neighbor 이나 linear 같은 interpolation으로 sampling한 방법보다 cubic interpolation을 3차원 공간에서 적용 시켜서 보다 resampling이 잘 되도록 하여 해상도를 향상시켜 보았다. 이렇게 향상된 Interpolation 적용시켜서 렌더링할 때 얼마나 오브젝트 내부 영역이 잘 가시화가 되었는지 transfer function을 적용시켜서 오브젝트 내부 정보를 렌더링 해보았고, 임의의 축으로 오브젝트을 잘라서 2D 단면 영상으로 출력해 보았다. 보다 향상된 interpolation을 적용시켜서 resampling을 하면 영상 해상도가 개선되었음을 볼 수 있었다.

• Journal of Broadcast Engineering
• /
• v.19 no.1
• /
• pp.118-121
• /
• 2014

Image interpolation is a method of determining the value of new pixel coordinate in the process of image scaling. Recently, image contents are likely to be a large-capacity, interpolation algorithm is required to generate fast enhanced result image. In this paper, fast multiple mixed image interpolation for image resolution enhancement is proposed. The proposed method estimates expected 12 shortfalls from four sub-images of a input image, and generates the result image that is interpolated in the combination of the expected shortfalls with the input image. The experimental results demonstrate that PSNR increases maximum value of 1.9dB, SSIM increases maximum value of 0.052, and the subjective quality is superior to any other compared methods. Moreover, it is known by algorithm running time comparison that the proposed method has been at least three times faster than the compared conventional methods. The proposed method can be useful for application on image resolution enhancement.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.32 no.9C
• /
• pp.867-880
• /
• 2007

We derive a modified version of cubic convolution interpolation for the enlargement or reduction of digital images by arbitrary scaling factors. The proposed scaling scheme is used to resize various format pictures in the transcoding system, which transforms the bitstream compressed at a bit rate, such as the HD bitstream, into another bit rate stream. In many applications such as the transcoder, the resolution conversion is very important for changing the image size while the scaled image maintains high quality. We focus on the modification of the scaler kernel according to the relation between formats of the original and the resized image. In the modification, various formats defined in MPEG standards are considered. We show experimental results that demonstrate the effectiveness of the proposed interpolation method.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.12
• /
• pp.2271-2276
• /
• 2008

In this paper, we propose a computational integral imaging reconstruction (CIIR) method based on scale-cariant magnification technique for resolution-enhanced 3D images. First, we introduce an interference problem among elemental images in CIIR. Magnification by a large factor causes inference among elemental images when they are applied to the superposition process. Thus, the resolution of reconstructed images is limited. To overcome the interference problem, we propose a method to calculate a minimum magnification factor while CIIR is still valid. Magnification by a new factor enables the Proposed method to reconstruct resolution-enhanced images. In addition, the computational load of the proposed method is less than that of the previous method. To confirm the feasibility of the proposed method, some experiments are carried out and the results are presented.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.3
• /
• pp.154-161
• /
• 2015

A novel multiframe super-resolution (SR) algorithm is presented to overcome the limitation of existing single-image SR algorithms using motion information from adjacent frames in a video. The proposed SR algorithm consists of three steps: i) definition of a local region using interframe motion vectors, ii) multiscale patch generation and adaptive selection of multiple optimum patches, and iii) combination of optimum patches for super-resolution. The proposed algorithm increases the accuracy of patch selection using motion information and multiscale patches. Experimental results show that the proposed algorithm performs better than existing patch-based SR algorithms in the sense of both subjective and objective measures including the peak signal-to-noise ratio (PSNR) and structural similarity measure (SSIM).

• Journal of KIISE:Software and Applications
• /
• v.34 no.5
• /
• pp.476-486
• /
• 2007

This paper proposes a resolution enhancement method which can reconstruct high-resolution facial images from single-frame, low-resolution facial images. The proposed method is derived from example-based reconstruction methods and the morphable face model. In order to improve the performance of the example-based reconstruction, we propose the region-based reconstruction method which can maintain the characteristics of local facial regions. Also, in order to use the capability of the morphable face model to face resolution enhancement problems, we define the extended morphable face model in which an extended face is composed of a low-resolution face, its interpolated high-resolution face, and the high-resolution equivalent, and then an extended face is separated by an extended shape vector and an extended texture vector. The encouraging results show that the proposed methods can be used to improve the performance of face recognition systems, particularly to enhance the resolution of facial images captured from visual surveillance systems.