The Journal of Korean Institute of Communications and Information Sciences (한국통신학회논문지)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지

A Study on the Shape-Based Motion Estimation For MCFI

MCFI 구현을 위한 형태 기반 움직임 예측에 관한 연구

  • 박주현 (전남대학교 전자컴퓨터공학부) ;
  • 김영철 (전남대학교 전자컴퓨터공학부) ;
  • 홍성훈 (전남대학교 전자컴퓨터공학부)
  • Received : 2009.11.02
  • Accepted : 2010.03.08
  • Published : 2010.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Motion Compensated Frame Interpolation(MCFI) has been used to reduce motion jerkiness for dynamic scenes and motion blurriness for LCD-panel display as post processing for large screen and full HD(high definition) display. Conventionally, block matching algorithms (BMA) are widely used to do motion estimation for simplicity of implementation. However, there are still several drawbacks. So in this paper, we propose a novel shape-based ME algorithm to increase accuracy and reduce ME computational cost. To increase ME accuracy, we do motion estimation based on shape of moving objects. And only moving areas are included for motion estimation to reduce computational cost. The results show that the computational cost is 25 % lower than full search BMA, while the performance is similar or is better, especially in the fast moving region.

DTV의 Full HD급이 보편화되면서 LCD(Liquid Crystal Display)기반 대형화와 고화질 요구가 급속도로 증대되고 있다. 이에 LCD의 잔상효과 제거와 격동적인 화면에서의 고화질 구현을 위해 수신 단에서 후처리 과정으로 움직임 보상 기반 프레임 보간법(MCFI)이 사용되고 있다. 이때 움직임 예측 시 구현의 용이성 때문에 블록정합기법(BMA)이 가장 많이 사용되고 있지만 여러 가지 문제점을 보여주고 있다. 본 논문에서는 움직임 정보의 정확성을 높이고 움직임 예측의 계산량 감소를 위하여 움직임 형태 기반의 움직임 예측 기법을 제안 한다. 움직임 정보의 정확성 향상을 위하여 움직임 형태를 기반으로 움직임 예측을 수행한다. 그리고 계산양 감소를 위하여 움직임 영역에서만 예측을 수행하는데 제안한 방법은 전 영역 움직임 예측기의 평균 25% 계산양만으로 비슷한 성능의 결과를 보여주고 있으며 특히 빠른 움직임 영역에서는 다른 여러 가지 움직임 예측 기법들 보다 우월한 성능을 보여준다.

Keywords

References

  1. C.K. Wong and O.C. Au, "Fast motion compensated temporal interpolation for video", Proc. SPIE: Visual Communications and Image Processing '95, pp.1108- 1118, May 1995
  2. Ravi Krishnamurthy, J.W. Woods, "Frame Interpolation and Bidirectional Prediction of Video Using Compactly Encoded Optical-Flow Fields and Label Fields", in IEEE Transaction on Circuits and Systems for Video Technology, Vol.9, No.5, 1999
  3. B.T. Choi, S.H. Lee, "New Frame Rate Up-Conversion Using Bi-directional Motion Estimation", in IEEE Transaction on Consumer Electronics, Vol.46, No.3, 2000
  4. Taehyeun Ha and S.J. Lee, " Motion Compensated Frame Interpolation by new Block-based Motion Estimation Algorithm", in IEEE Transaction on Consumer Electronics, Vol.5, No.2, 2004
  5. A. Huang and T. Nguyen, "A novel motion compensated frame interpolation based on block merging and residual energy", in Proc. Multimedia Signal Processing Workshop, Sep. 2006, Vol.4, pp. 353-356
  6. Dane, G. T. Nguyen, "Optimal temporal interpolation filter for motion-compensated frame rate up conversion", in IEEE Transaction on Image processing, Vol.15. Issue 4, 2006
  7. Ya-Ting Yang, Ja-Ling Wu, " Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction", in IEEE Transaction on Circuits and Systems for Video Technology, Vol.17, No.12, 2007
  8. Bayeon-Doo Choi, Chang-Su Kim, Sung-Jae Ko, " Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation", in IEEE Transaction on Circuits and Systems for Video Technology, Vol.17, No.4, 2007
  9. Ai-Mei Huang, T. Nguyen, " A Multistage Motion Vector Processing Method for Motion Compensated Frame Interpolation", in IEEE Transaction on Image Processing, Vol.7, No.5, 2008
  10. Suk-Ju Kang, Dong-Gon Yoo, Sung-Kyu Lee, "Multiframe-based Bilateral Motion Estimation with Emphasis on Stationary Caption Processing for Frame Rate Up-Conversion", in IEEE Transaction on Consumer Electronics, Vol.54, No.4, 2008
  11. P. Csillag and L. Borocszky, "Enhancement of video data using MC postprocessing techniques," in Proc. ICASSP, Apr. 1997, Vol.4, pp.2897-2900.
  12. D. W. Kim, J. T. Kim, and I. H. Ra, "A new video interpolation technique based on motion-adaptive subsampling," IEEE Trans. Consum. Electron., Vol.45, No.3, pp. 782-786, Aug. 1999. https://doi.org/10.1109/30.793602
  13. Zhou Wang, Alan Conrad Bovik, "Image quality assessment: From error visibility to structural similarity," IEEE Transactions on Image Processing, Vol.13, No.4, pp.600-612, Apr. 2004. https://doi.org/10.1109/TIP.2003.819861