The Journal of Korean Institute of Communications and Information Sciences (한국통신학회논문지)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient Motion Compensated Extrapolation Technique Using Forward and Backward Motion Estimation

순방향과 역방향 움직임 추정을 이용한 효율적인 움직임 보상 외삽 기법

  • 권혜경 (가톨릭대학교 정보통신전자공학과) ;
  • 이창우 (가톨릭대학교 정보통신전자공학과)
  • Received : 2010.08.23
  • Accepted : 2011.02.28
  • Published : 2011.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Motion compensated extrapolation (MCE) techniques show inferior performance compared to motion compensated interpolation techniques, since only past frames are used in MCE. MCE techniques are used for the reconstruction of corrupted frames, the up-conversion of frame rates and the generation of side information in the distributed video coding system. In this paper, the performance of various MCE techniques are evaluated and an efficient MCE technique using the forward and backward motion estimation is proposed. In the proposed technique, the present frame is extrapolated by averaging two frames which are generated by forward and backward motion estimation respectively. It is shown that the proposed method produces better PSNR results and less blocking phenomena than conventional methods.

움직임 보상 외삽 기법은 움직임 보상 보간 기법에 비해서 과거의 프레임만 사용하기 때문에 성능은 다소 떨어지지만, 전송 중에 손상된 프레임의 복원 및 프레임율 증가 뿐 아니라 분산 동영상 부호화 시스템의 부가 정보 생성에도 활용될 수 있다. 본 논문에서는 다양한 움직임 보상 외삽 기법의 성능을 평가하고 순방향과 역방향 움직임 추정을 함께 이용한 효율적인 움직임 보상 외삽 기법을 제안한다. 제안하는 기법은 순방향과 역방향 움직임 추정을 통해 두 개의 프레임을 생성하여 두 프레임의 화소값의 평균을 현재 프레임으로 한다. 모의 실험 결과 제안하는 기법이 기존의 기법에 비해서 블록 현상이 감소하고 우수한 PSNR 성능을 보임을 확인하였다.

Keywords

References

  1. B. Girod, A.M. Aaron, S. Rane and D. Rebollo-Monedero, "Distributed video coding", Proc. IEEE, Vol.93, pp.71-83, Jan. 2005. https://doi.org/10.1109/JPROC.2004.839619
  2. B. Yan and H. Gharavi, "Efficient error concealment for the whole frame loss based on H.264/AVC", Proc. IEEE Int. Conf. on Image Process., pp.3064-3067, Oct., 2008.
  3. J. Zhai, K. Yu, J. Li and S. Li, "A low complexity motion compensated frame interpolation method," IEEE Int. Symposium on Circuits and Systems, pp.4927-4930, May 2005.
  4. B. Yan and H. Gharavi, "A Hybrid frame concealment algorithm for H.264/AVC," IEEE Trans. on Image Process., Vol.19, pp.98-107, Jan. 2010. https://doi.org/10.1109/TIP.2009.2032311
  5. Pang, L. Yu, M. Yi, W. Jiang, G. Liu and W. Jiang. "Relativity analysis-based error concealment algorithm for entire frame loss of stereo video," The 8th IEEE int. Conf. on Signal Process., Apr. 2007.
  6. C. Brites, J. Ascenso and F. Pereira, "Improving transform domain Wyner-Ziv video coding performance," IEEE Int. Conf. on Speech Signal Process., pp.525-528, May 2006.
  7. R. Martins, C. Brites, J. Ascenso and F. Pereira, "Refining side information for improved transform domain Wyner-Ziv video coding," IEEE Trans. on Circuits and Systems for Video Technology, Vol.19, pp.1327-1341, Sept., 2009. https://doi.org/10.1109/TCSVT.2009.2022783
  8. T. N. Dinh, G. S. Lee, J. Y. Chang, H. J. Cho, "Side information generation using extra information in distributed video coding," IEEE Int. Symposium on Signal Processing and Information Technology 2007, pp.138-143, Dec. 2007.
  9. B. D Choi, J. W Han, C. S Kim, and S. J Ko. "Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation," IEEE Trans. on Circuits and Systems for Video Technology, Vol.17, pp.407-416, Apr. 2007. https://doi.org/10.1109/TCSVT.2007.893835
  10. Deng Hui-Ping, Yu Li, Xiong Wei, He Qing-Di and Li Rong, "Adaptive interpolation/extrapolation and motion vector processing method for frame rate up conversion," ICIG '09 Fifth Int. Conf. on Image and Graphics, pp.18-22, Sept. 2009.
  11. L. Natrio, C. Brites, J. Ascenso and F. Pereira, "Extrapolating side information for low-delay pixel-domain distributed video coding," Int. Workshop on Very Low Bitrate Video Coding, Sept. 2005.
  12. Mei-Juan Chen, Yi-Yen Chiang, Hung-Ju Li and Ming-Chieh Chi, "Efficient multi-frame motion estimation algorithms for MPEG-4 AVC/JVT/H.264," Proc. Int. Symposium on Circuits and Systems, May. 2004.
  13. J. Ascenso, C. Brites and F. Pereira, "Content adaptive Wyner-ZIV video coding driven by motion activity," IEEE Int. Conf. on Image Process., pp.605-608, Oct., 2006.
  14. Mei-Juan Chen, Ming-Chung Chu and Chih-Wei Pan, "Efficient motion-estimation algorithm for reduced frame-rate video transcoder," IEEE Trans. on Circuits and Systems for Video Technology, pp.269-272, Apr. 2002.
  15. S. Borchert, R.P. Westerlaken, R. Klein Gunnewiek and R.L. Lagendijk, "Improving motion compensated extrapolation for distributed video coding," Proceedings of the 13th annual onference of the Advanced School for Computing and Imaging, Jun. 2007.