An Improved Motion/Disparity Vector Prediction for Multi-view Video Coding

다시점 비디오 부호화를 위한 개선된 움직임/변이 벡터 예측

  • Lim, Sung-Chang (DMS Lab., Department of Computer Engineering, Sejong University) ;
  • Lee, Yung-Lyul (DMS Lab., Department of Computer Engineering, Sejong University)
  • 임성창 (세종대학교 컴퓨터공학과 DMS 연구실) ;
  • 이영렬 (세종대학교 컴퓨터공학과 DMS 연구실)
  • Published : 2008.03.25

Abstract

Generally, a motion vector and a disparity vector represent the motion information of an object in a single-view of camera and the displacement of the same scene between two cameras that located spatially different from each other, respectively. Conventional H.264/AVC does not use the disparity vector in the motion vector prediction because H.264/AVC has been developed for the single-view video. But, multi-view video coding that uses the inter-view prediction structure based on H.264/AVC can make use of the disparity vector instead of the motion vector when the current frame refers to the frame of different view. Therefore, in this paper, we propose an improved motion/disparity vector prediction method that consists of global disparity vector replacement and extended neighboring block prediction. From the experimental results of the proposed method compared with the conventional motion vector prediction of H.264/AVC, we achieved average 1.07% and 1.32% of BD (Bjontegaard delta)-bitrate saving for ${\pm}32$ and ${\pm}64$ of global vector search range, respectively, when the search range of the motion vector prediction is set to ${\pm}16$.

일반적으로 움직임 벡터는 한 카메라에서 촬영된 영상 속에서의 객체의 움직임 정보를 나타내고, 변이 벡터는 서로 다른 카메라에서 촬영된 영상 간 객체의 위치 차이를 나타낸다. 기존의 H.264/AVC에서는 단일 시점 영상을 위한 비디오 부호화 기술이기 때문에 변이 벡터를 고려하지 않는다. 하지만, 다시점 비디오 부호화 기술은 H.264/AVC를 기반으로 하여 시점 간 예측구조를 지원하기 때문에, 다른 시점에서의 영상을 참조할 때는 움직임 벡터 대신 변이 벡터가 고려된다. 따라서, 본 논문에서는 다시점 비디오 부호화 기술을 위해 전역 변이 벡터 대체 방법과 확장된 주변 블록 예측 방법을 이용하여 개선된 움직임/변이 벡터 예측 방법을 제안한다. 제안하는 방법을 통해서 움직임 벡터 탐색 범위를 ${\pm}16$으로 설정하고, 전역 변이 벡터 탐색 범위를 ${\pm}32$으로 설정한 경우 평균 1.07%의 BD (Bjontegaard delta)-비트율 감소를 얻었으며, 전역 변이 벡터 탐색 범위를 ${\pm}64$로 설정한 경우 평균 1.32%의 BD-비트율 감소를 얻을 수가 있었다.

Keywords

References

  1. A. Vetro, P. Pandit, H. Kimata, and A. Smolic, 'Joint Draft 4.0 on Multiview Video Coding,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-X209, Jul. 2007
  2. A. Vetro, P. Pandit, H. Kimata, and A. Smolic, 'Joint Multiview Video Model (JMVM) 5.0,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-X207, Jul. 2007
  3. A. Smolic and D. McCutchen, '3DAV Exploration of Video-Based Rendering Technology in MPEG,' IEEE Trans. Circuits Syst. Video Technol., vol. 14, pp. 348-356, Mar. 2004 https://doi.org/10.1109/TCSVT.2004.823395
  4. 'Requirements on Multi-view Video Coding v.7,' ISO/IEC JTC1/SC29/WG11, Doc. N8218, Jul. 2006
  5. ITU-T Recommendation H.264 and ISO/IEC 14496-10, Advanced Video Coding for Generic Audiovisual Services, May 2003
  6. K. Mueller, P. Merkle, A. Smolic, and T. Wiegand, 'Multiview Coding using AVC,' ISO/IEC JTC1/SC29/WG11, Doc. M12945, Jan. 2006
  7. Y.-L. Lee, J.-H. Hur, Y.-K. Lee, K.-H. Han, S. Cho, N. Hur, J. Kim, J.-H. Kim, P.-L. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, 'CE11: Illumination Compensation,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-U052, Oct. 2006
  8. H.-S. Koo, Y.-J. Jeon, and B.-M Jeon, 'MVC Motion Skip Mode', ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-W081, Apr. 2007
  9. S.-H Lee, S. H. Lee, and N. I. Cho, 'Disparity vector prediction methods in MVC,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-U040r1, Oct. 2006
  10. H. Yang, J. Huo, Y. Chang, S. Lin, P. Zeng, and L. Xiong, 'Regional disparity Est/Comp for MVC,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-U047, Oct. 2006
  11. H. Yang, J. Huo, Y. Chang, S. Lin, P. Zeng, and L. Xiong, 'Regional Disparity Based Motion and Disparity Prediction for MVC,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-V071r1, Jan. 2007
  12. P. Zeng, S. Lin, J. Zhou, C. Hu, L. Xiong, 'An Auxiliary Motion Vector prediction Scheme,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-V073r1, Jan. 2007
  13. H. Yang, J. Huo, Y. Chang, S. Lin, S. Gao, and L. Xiong, 'MV/DV prediction based on RDV,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-W101r1, Apr. 2007
  14. Y.-S. Ho, K.-J. Oh, C. Lee, P.-K. Park, and B. H. Choi, 'Global Disparity Compensation for Multi-view Video Coding,' ISO/IEC JTC1/SC29/WG11, Doc. M13581, Jul. 2006
  15. Y.-S. Ho, K.-J. Oh, C. Lee, P.-K. Park, and B. H. Choi, 'Global Disparity Compensation for Multi-view Video Coding,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-U100r1, Oct. 2006
  16. Y. Su, A. Vetro, A. Smolic, 'Common Test Conditions for Multiview Video Coding,' ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-U211, Oct. 2006
  17. from CVS repository of JMVM: jvtuser$\alpha$garcon.ient.rwth-aachen.de, Tag: JMVM_4_0
  18. G. Bjontegaard, 'Calculation of average PSNR differences between RD-curves,' ITU-T Q6/SG16, Doc. VCEG-M33, Apr. 2001