Fast Multiple Reference Frame Selection Method for Motion Estimation and Compensation in Video Coding

동영상 부호화의 움직임 추정 및 보상을 위한 고속 다중 참조 프레임 선택 기법

  • 김재훈 (중앙시스템) ;
  • 김명진 (숭실대학교 정보통신전자 공학부) ;
  • 홍민철 (숭실대학교 정보통신전자 공학부)
  • Published : 2007.11.30

Abstract

In this paper, we propose a fast multiple reference frame selection method for motion estimation and compensation in video coding. Reference frames selected as an optimal reference frame by variable block sizes motion estimation have the statistical characteristic that was based on block size. Using the statistical characteristic, reference frames for smaller block size motion estimation can be selected from reference frame which was decided as an optimal one for the upper layer block size. Simulation results show that the proposal method decreased the computations about 60%. Nevertheless, PSNR and bit rate were almost same as the performances of original H.264 multiple reference motion estimation.

본 논문에서는 동영상 부호화 방식의 움직임 추정을 위한 고속 다중 참조 프레임 선택 기법에 대해 제안한다. 움직임 추정을 위해 다중 프레임을 참조하는 H.264 동영상 부호화 방식의 경우, 블록별로 선택된 최적의 참조 프레임들은 일정한 상관관계를 유지하는 특성이 존재한다. 제안 방식은 이러한 통계적 특성을 이용하여, 임의의 블록 크기의 움직임 추정 모드에서 선택된 최적의 참조 프레임 정보를 이용하여 하위 블록 크기의 움직임 추정 모드에서 사용할 참조 프레임을 예측한다. 실험 결과를 통해 5개의 참조 프레임 사용을 기준으로 제안하는 기법을 사용하였을 때, 움직임 추정에 소요되는 시간은 가용한 모든 참조 프레임에 대해 움직임 추정을 수행하는 방식 대비 평균 60% 감소되었으며, PSNR 및 발생 비트율 측면에서 거의 동일한 성능을 유지함을 확인할 수 있었다.

Keywords

References

  1. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264|ISO/IEC 14496-10 AVC) JVT-G050, Geneva, Switzerland, 23-27 May, 2003
  2. T. Wiegand, G. Sullivan, G. Bjontegaard, and A. Luthar, 'Overview of the H.264/AVC Video Coding Standard,' IEEE Trans. Circuit and Systems for Video Technology, vol. 13, pp.560-576, July, 2003 https://doi.org/10.1109/TCSVT.2003.815165
  3. Iain E.G. Richardson, H.264 and MPEG-4 Video Compression, Wiley, 2003
  4. J. Ostermann, J. Bormans, P. List, D. Marpe, M. Narroschke, F. Pereira, T. Stockhammer, and T. Wedi, 'Video coding with H.264/AVC: tools, performance, and complexity,' IEEE Circuits and Systems Magazine, vol. 4, pp. 7-28, first quarter. 2004 https://doi.org/10.1109/MCAS.2004.1286980
  5. T. Wiegand, X. Zhang, and B. Girod, 'Motion-compensating long-term memory prediction,' Proc. IEEE Int. Conf. Image Processing, Santa Barbara, CA, Oct. 1997
  6. T. Wiegand, X. Zhang, and B. Girod, 'Block-based hybrid video coding using motion- compensated long-term memory prediction,' Proc. Picture Coding Symp. Berlin, Germany, Sept. 1997
  7. T. Wiegand, X. Zhang, and B. Girod, 'Long-term memory motion-compensated prediction,' IEEE Trans. Circuit and Systems for Video Technology, vol. 9, pp. 70-84, Feb. 1999 https://doi.org/10.1109/76.744276
  8. T. Wiegand and B. Girod, Multi-Frame Motion-Compensated Prediction for Video Transmission. Norwell, MA: Kluwer, 2001
  9. Y. W. Huang, B. Y. Hsieh, T. C. Wang, S. Y. Chen, S. Y. Ma, C. F. Shen, and L. G. Chen, 'Analysis and reduction of reference frames for motion estimation in MPEG-4 AVC/JVT/H.264,' Proc. Int. Conf. Multimedia and Expo (ICME), vol. 2, pp. II - 809-812, July. 2003
  10. C. W. Ting, L. M. Po, and C. H. Cheung, 'Center-biased frame selection algorithms for fast multi-frame motion estimation in H.264,' Proc. Int. Conf. Neural Networks and Signal Processing, vol. 2, pp. 1258-1261, Dec. 2003
  11. A. Chang, O. C. Au, Y. M. Yeung 'A novel approach to fast multi-frame selection for H.264 video coding,' Proc. Int. Symp. Circuits and Systems (ISCAS '03), vol. 2, pp. II-704-II-707, May. 2003
  12. H. J. Li, C. T. Hsu, M. J. Chen, 'Fast multiple reference frame selection method for motion estimation in JVT/H.264,' Proc. IEEE Asia-Pacific Conf. Circuit and Systems, vol. 1, pp. 605-608, Dec. 2004
  13. Y. Shen, C. Hunag, L. Yu, D. Zhang, J. Li, 'Fast multiframe motion estimation algorithm in H.264,' Proc. Int. Conf. Signal Processing (ICSP '04), vol. 2, pp. 1187-1190, Sept. 2004
  14. Yu-Wen Huang, Bing-Yu Hsieh, Shao-Yi Chien, Shyh-Yih Ma, Liang-Gee Chen, 'Analysis and Complexity Reduction of Multiple Reference Frames Motion Estimation in H.264/AVC,' IEEE Trans. Circuit and Systems for Video Technology, vol. 16, No. 4, pp.507-522, April 2006 https://doi.org/10.1109/TCSVT.2006.872783