• Journal of Broadcast Engineering
• /
• v.17 no.6
• /
• pp.933-944
• /
• 2012

In this paper, we propose a new method to convert a low-resolution depth map into its high-resolution one called distance transform-based bilateral upsampling. Since the proposed method controls the spatial domain weighting function based on distance transform values of the depth map, it increases the input depth map resolution while preserving edge sharpness. The proposed method is composed of three main steps: distance transform, spatial weighting control, and image interpolation. Experimental results show that our method outperforms the conventional bilateral upsampling in terms of the quality of output depth maps.

• Journal of Korea Multimedia Society
• /
• v.17 no.12
• /
• pp.1393-1401
• /
• 2014

This paper presents an adaptive image interpolation method using a pixel-based neighbor embedding which is modified from the patch-based neighbor embedding of contemporary super resolution algorithms. Conventional interpolation methods for high resolution detect at least 16-directional edges in order to remove zig-zaging effects and selectively choose the interpolation strategy according to the direction and value of edge. Thus, they require much computation and high complexity. In order to develop a simple interpolation method preserving edge's directional shape, the proposed algorithm adopts the simplest Haar wavelet and suggests a new pixel-based embedding scheme. First, the low-quality image but high resolution, magnified into 1 octave above, is acquired using an adaptive 8-directional interpolation based on the high frequency coefficients of the wavelet transform. Thereafter, the pixel embedding process updates a high resolution pixel of the magnified image with the weighted sum of the best matched pixel value, which is searched at its low resolution image. As the results, the proposed scheme is simple and removes zig-zaging effects without any additional process.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.07a
• /
• pp.83-86
• /
• 2012

본 논문에서는 다양한 변이 추정 방식 중 영역기반(Area-based) 알고리듬과 특정기반(Feature-based) 알고리듬을 결합한 하이브리드(Hybrid) 변이추정 알고리듬을 제안한다. 제안하는 알고리듬은 Features from Accelerated Segment Test(FAST) 코너 점 추출기[2]를 이용하여 좌, 우 영상 각각의 특징 점을 추출한 후, 특징 점들의 정보를 이용한 스테레오 정함을 통해 신뢰도 높은 초기 변이지도(Disparity map)를 생생하게 된다. 그러나 생성된 초기 변이지도는 조밀하지 못하므로, 조밀한 변이 지도를 획득하기 위해 특징점이 추출된 영역에 대해서는 추정된 초기 변이 값을 이웃 픽셀과의 색 유사도를 고려하여 전파시키고 특징 점이 추출되지 않은 영역에 대해서는 이진 윈도우(Binary window)를 활용한 영역기반 변이추정 알고리듬[1]을 이용하여 변이 값을 추정한다. 이를 통해, 제안 알고리듬은 특징 기반 알고리듬에서 발생할 수 있는 보간법 문제를 해결함과 동시에 신뢰도가 높은 초기 변이지도를 사용함으로써, 영역 기반 알고리듬의 정합 오차를 줄여 신뢰도 높은 변이지도를 생생할 수 있다. 실험 결과 추정된 초기 변이지도는 ground truth와 비교 시 약 99%이상의 정확도를 보이며, 특징 점이 추출된 영역에서 기존의 영역기반 알고리듬보다 더 정확한 변이 값이 추정되었음을 확인하였다.

• Journal of the Korea Computer Graphics Society
• /
• v.9 no.1
• /
• pp.3-9
• /
• 2003

표면 라이트 필드는 각 시점에서 관찰된 서로 다른 물체 표면의 색 정보를 메쉬에 저장함으로써 물체 표면을 시점 변화에 따라 사실적으로 렌더링할 수 있다. 본 논문에서는 표면 라이트 필드에 대한 영상 기반 편집 기술로서 몰핑 기법을 제시한다. 표면 라이트 필드를 몰핑하기 위해서는 중간 물체의 표면 라이트 필드를 위한 기하 정보와 라이트 필드를 생성해야 한다. 중간 물체의 기하 정보는 메쉬 몰핑을 통해 얻을 수 있다. 중간 물체의 라이트 필드는 두 입력 라이트 필드에서 필요한 정보를 얻어 시점과 기하 정보의 변화에 따라 변형한 후 이를 보간하여 주어진 시점에서의 라이트 필드를 동적으로 얻어낸다. 메쉬 몰핑을 통해 얻어진 중간 물체의 메쉬는 입력 물체에 비해 매우 복잡한 연결 구조를 가지므로 렌터링 속도를 향상시키기 위한 방법을 제시한다. 먼저 메쉬 몰핑 과정에서 메타 메쉬를 만들 때 가까이에 있는 정점들을 병합하여 보다 단순한 메타 메쉬를 생성하고 중간 물체를 렌더링하기 위해 메타 메쉬를 사용하지 않고 메타 메쉬를 근사하도록 두 입력 메쉬를 변형한 후 이를 렌더링에 사용한다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.36 no.4C
• /
• pp.207-216
• /
• 2011

Motion compensated extrapolation (MCE) techniques show inferior performance compared to motion compensated interpolation techniques, since only past frames are used in MCE. MCE techniques are used for the reconstruction of corrupted frames, the up-conversion of frame rates and the generation of side information in the distributed video coding system. In this paper, the performance of various MCE techniques are evaluated and an efficient MCE technique using the forward and backward motion estimation is proposed. In the proposed technique, the present frame is extrapolated by averaging two frames which are generated by forward and backward motion estimation respectively. It is shown that the proposed method produces better PSNR results and less blocking phenomena than conventional methods.

• The Transactions of the Korea Information Processing Society
• /
• v.7 no.10
• /
• pp.3280-3289
• /
• 2000

In this paper,we propose a novel technoque of improving volume rendering quality and speed by integrating volume data and global shape information together. The selective volume rendering method is to generate distance transformed volume using a distance transform to determine the minimum distance to the neaest intercsting part and then render it. The shape information prevents from object occlusions come from similar intensity of each object. Thus it provides effective visual results that enable to get a clear understanding of complex structures. We show the results of selective volume rendering method for left ventricle and right ventricle ans well as the results of selective sampling methods depending on the interpolation from EBCT cardiac images. Our method offers an accelerated technique to accurately visuahze the surfaces of devined objects segmented from the volume.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.11a
• /
• pp.354-357
• /
• 2020

최근 스포츠 경기나 차량 블랙박스 등에서 비디오를 이용한 판정이 점차 확대되고 있지만, 일반 카메라로 촬영된 비디오에서 정확한 판정을 하기 어려울 때가 빈번히 발생한다. 초고속 카메라로 촬영한 슬로우 모션 비디오를 이용할 수 있다면 판정의 정확성을 향상시킬 수 있을 것이다. 본 논문에서는 일반 카메라로 촬영한 비디오로부터 마치 초고속 카메라로 촬영한 것과 같은 슬로우 모션 비디오를 생성하여 제공하는 서비스를 제안한다. 제안 방법은 NVIDIA에서 개발한 Super Slomo 기술을 기반으로, 초당 30장의 표준 비디오를 초당 60장에서 240장까지의 고품질 슬로우 모션 비디오로 변환한다. 이 기술은 시간적으로 이웃한 두 영상을 입력하여 딥 러닝 기반으로 중간 프레임을 보간함으로써 프레임율을 향상시킨다. 또한 본 논문에서는 Super Slomo 기술에 FP16을 적용하여 처리속도를 향상 시켰으며, 웹 서버를 이용하여 비디오를 업로드하고 슬로우 모션으로 변환된 비디오를 다운로드 할 수 있는 사이트를 구현했다.

• Journal of Korea Water Resources Association
• /
• v.55 no.12
• /
• pp.1125-1135
• /
• 2022

Damages by heavy snow does not occur very often, but when it does, it causes damage to a wide area. To mitigate snow damage, it is necessary to know, in advance, the depth of snow that causes damage in each region. However, snow depths are measured at observatory locations, and it is difficult to understand the spatial distribution of snow depth that causes damage in a region. To understand the spatial distribution of snow depth, the point measurements are interpolated. However, estimating spatial distribution of snow depth is not easy when the number of measured snow depth is small and topographical characteristics such as altitude are not similar. To overcome this limit, satellite images such as Synthetic Aperture Radar (SAR) can be analyzed using Differential Interferometric SAR (DInSAR) method. DInSAR uses two different SAR images measured at two different times, and is generally used to track minor changes in topography. In this study, the spatial distribution of snow depth was estimated by DInSAR analysis using dual polarimetric IW mode C-band SAR data of Sentinel-1B satellite operated by the European Space Agency (ESA). In addition, snow depth was estimated using geostationary satellite Chollian-2 (GK-2A) to compare with the snow depth from DInSAR method. As a result, the accuracy of snow cover estimation in terms with grids was about 0.92% for DInSAR and about 0.71% for GK-2A, indicating high applicability of DInSAR method. Although there were cases of overestimation of the snow depth, sufficient information was provided for estimating the spatial distribution of the snow depth. And this will be helpful in understanding regional damage-causing snow depth.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.38 no.8
• /
• pp.62-71
• /
• 2001

This paper presents a design of the real-time digital image enhancement preprocessor for CMOS image sensor. CMOS image sensor offers various advantages while it provides lower-quality images than CCD does. In order to compensate for the physical limitation of CMOS sensor, the spatially adaptive contrast enhancement algorithm was incorporated into the preprocessor with color interpolation, gamma correction, and automatic exposure control. The efficient hardware architecture for the preprocessor is proposed and was simulated in VHDL. It is composed of about 19K logic gates, which is suitable for low-cost one-chip PC camera. The test system was implemented on Altera Flex EPF10KGC503-3 FPGA chip in real-time mode, and performed successfully.

• The Journal of Information Technology
• /
• v.7 no.2
• /
• pp.93-104
• /
• 2004

Sports scene is characterized by large amount of global motion due to pan and zoom of camera motion, and includes many small objects moving independently. Some short period of sports games is thrilling to televiewers, and important to producers. At the same time that kinds of scenes exhibit exceptionally dynamic motions and it is very difficult to analyze the motions with conventional algorithms. In this thesis, several algorithms are proposed for global motion analysis on these dynamic scenes. It is shown that proposed algorithms worked well for motion compensation and panorama synthesis. When cascading the inter frame motions, accumulated errors are unavoidable. In order to minimize these errors, interpolation method of motion vectors is introduced. Affined transform or perspective projection transform is regarded as a square matrix, which can be factorized into small amount of motion vectors. To solve factorization problem, we preposed the adaptation of Newton Raphson method into vector and matrix form, which is also computationally efficient. Combining multi frame motion estimation and the corresponding interpolation in hierarchical manner enhancement algorithm of motion parameters is proposed, which is suitable for motion compensation and panorama synthesis. The proposed algorithms are suitable for special effect rendering for broadcast system, video indexing, tracking in complex scenes, and other fields requiring global motion estimation.