• Journal of Broadcast Engineering
• /
• v.8 no.3
• /
• pp.288-296
• /
• 2003

ATSC (Advanced Television System Committee) has specified 18 video formats for DTV (Digital Television), e.g., scan format, size format, and frame rate format conversion. Effective MPEG-2 video transcoders should support any conversion between the above-mentioned formats. Scan format conversion Is hard to Implement because it may often induce frame rate and size format conversion together. Especially. because of picture type conversion caused by scan format conversion, the computational burden of motion estimation (ME) in transcoding becomes serious. This paper proposes a fast ME algorithm for MPEG-2 video transcoding supporting scan format conversion. Firstly, we extract and compose a set of candidate motion vectors (MVs) from the input bit-stream to comply with the re-encoding format. Secondly, the best MV is chosen among several candidate MVs by using a weighted median selector. Simulation results show that the proposed ME algorithm provides outstanding PSNR performance close to full search ME, while reducing the transcoding complexity significantly.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.342-348
• /
• 2013

In this paper, a novel frame rate up conversion (FRUC) algorithm using adaptive extended bilateral motion estimation (AEBME) is proposed. Conventionally, extended bilateral motion estimation (EBME) conducts dual motion estimation (ME) processes on the same region, therefore involves high complexity. However, in this proposed scheme, a novel block type matching procedure is suggested to accelerate the ME procedure. We calculate the edge information using sobel mask, and the calculated edge information is used in block type matching procedure. Based on the block type matching, decision will be made whether to use EBME. Motion vector smoothing (MVS) is adopted to detect outliers and correct outliers in the motion vector field. Finally, overlapped block motion compensation (OBMC) and motion compensated frame interpolation (MCFI) are adopted to interpolate the intermediate frame in which OBMC is employed adaptively based on frame motion activity. Experimental results show that this proposed algorithm has outstanding performance and fast computation comparing with EBME.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.06a
• /
• pp.228-230
• /
• 2016

In this paper, we introduce new FRUC method for Multi-View Video based on DIBR (Depth Image based Rendering, DIBR). In the proposed method, we divide each block to sub-regions using depth map. Then, we reconstruct occlusion region information at each sub-regions by using other views. With reconstructed occlusion region information, we estimate and compensate each sub-regions' motion. The proposed method estimates more accurate motion compared to the conventional methods in occlusion region.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.8
• /
• pp.60-67
• /
• 1996

In this paper, we propose a new temporal interpolation method based on spatial filtering. Compared with the conventional method, the proposed one may use a few adjacent frames and apply temporal lowpass filtering. To develop this method, we follow the basic approach of sampling rate conversion. Additionally, we use some assumption of video sequence : moving object has constant velocity rigid translational motion. From them, spatial filtering for temporal sampling rate conversion is described. This method has a lot of noise immunity on a motion vector and doesn't make a great difference from the original frame. The interpolated frame shows moderate change even there is a great time difference. This method has exactly same description of motion adaptive spatial filter which has an efficient temporal band-limiting characteristics. It imposes the possibility to make video sequence with good pictural quality.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2015.07a
• /
• pp.268-271
• /
• 2015

본 논문에서는 고해상도 비디오를 위한 프레임 레이트 변환 방법을 제시한다. 서로 다른 방식이나 포맷을 가진 영상 신호를 변환할 때에는 시각적으로 거슬리는 움직임 지터(motion jitter)나 영상의 모서리에서의 블러링(blurring) 현상이 일어날 수 있다. 제시하는 방법에서는 이러한 문제점을 해결하기 위해 양방향 움직임 추정/보상을 이용하여 프레임 레이트를 증가 변환한다. 또한 보다 정확한 움직임 벡터를 찾기 위해 다중 프레임을 통한 양방향 탐색 방법을 제안한다. 먼저, 픽셀 값을 알고 있는 현재 프레임과 이전 프레임간의 움직임 벡터를 이용하여 양방향 움직임 벡터를 얻는다. 얻은 움직임 벡터는 벡터 스무딩 블록을 거친다. 그 후 OBMC(Overlapped Block Motion Compensation)를 이용하여 보간 프레임을 구성한다. 실험 결과는 기존 방법들보다 제안 방법이 주관적 화질 면에서 우수함을 나타낸다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2015.04a
• /
• pp.947-949
• /
• 2015

본 논문은 기존의 시간적으로 이웃한 프레임 사이의 움직임을 추정 보상하여 새로운 프레임을 생성하는 프레임률 향상 기법 (frame rate up conversion)을 제안한다. 움직임 추정(Motion Estimation)을 통하여 계산된 움직임 벡터를 이용하여 프레임을 생성하며, 생성된 프레임에서 발생되는 구명 (hole)과 중첩 (overlap) 영역을 처리하는 기법을 제안한다. 특히 k-NN 보간법(k-nearest neighbor interpolation)[3]과 중간값을 적응적으로 활용하여 향상된 화질의 영상을 생성한다. 실험 결과를 통하여 제안하는 기술의 우수성을 입증하였다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2015.10a
• /
• pp.1520-1522
• /
• 2015

본 논문은 기존의 시간적으로 이웃한 프레임 사이의 움직임을 추정 보상하여 새로운 프레임을 생성하는 프레임률 향상 기법 (frame rate up conversion)을 제안한다. 움직임 추정(Motion Estimation)을 통하여 계산된 움직임 벡터를 이용하여 프레임을 생성하며, 생성된 프레임에서 발생되는 구멍 (hole)과 중첩 (overlap) 영역을 처리하는 기법을 제안한다. 특히 k-NN 보간법(k-nearest neighbor interpolation)[3]과 중간값을 적응적으로 활용하여 향상된 화질의 영상을 생성한다. 실험 결과를 통하여 제안하는 기술의 우수성을 입증하였다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.46 no.3
• /
• pp.28-36
• /
• 2009

In this paper, we propose a frame-rate up-conversion method for temporal quality enhancement. The proposed method adaptively changes search range during hierarchical motion estimation and reconstructs hole regions using the proposed bi-direction prediction and linear interpolation. In order to alleviate errors due to inaccurate motion vector estimation, search range is adaptively changed based on reliability and for more accurate, motion estimation is performed in descending order of block variance. After segmentation of background and object regions, for filling hole regions, the pixel values of background regions are reconstructed using linear interpolation and those of object regions are compensated based on the proposed hi-directional prediction. The proposed algorithm is evaluated in terms of PSNR with original uncompressed sequences. Experimental results show that the proposed algorithm is better than conventional methods by around 2dB, and blocky artifacts and blur artifacts are significantly diminished.

• Journal of Broadcast Engineering
• /
• v.23 no.1
• /
• pp.138-145
• /
• 2018

In this paper, we propose a new motion estimation algorithm for frame rate up-conversion. The proposed algorithm uses the variance of errors in addition to SAD in motion estimation to find more accurate motion vectors. Then, it decides which motion vectors are wrong using the variance of neighbor motion vectors and the variance between current motion vector and neighbor's average motion vector. Next, incorrect motion vectors are corrected by weighted sum of eight neighbor motion vectors. Additionally, we propose adaptive search range algorithm, so we can find more accurate motion vectors and reduce computational complexity at the same time. As a result, proposed algorithm improves the average peak signal-to-noise ratio and structural similarity up to 1.44 dB and 0.129, respectively, compared with previous algorithms.

• KIISE Transactions on Computing Practices
• /
• v.22 no.10
• /
• pp.532-536
• /
• 2016

Frame Rate Up Conversion (FRUC) generate interpolated frames between existing frames using motion estimation and motion compensation interpolation considering temporal redundancy. Falsely-estimated FRUC, however, can generate poor quality frames because FRUC typically uses blending-based interpolation method. As skipping an interpolating process between frames generate mis-estimated motion vectors, could improve Quality of Services of FRUC. In this Paper we analyze luminance histogram and motion vector consistency in frames generating poor quality interpolated frames. We conclude these features could help to be a clue in classifying the frames, which often result in the poor quality of FRUC results through the analysis and experiment.