DOI QR코드

DOI QR Code

Improvement of Inter prediction by using Homography Reference Picture

Homography 참조 픽처를 사용한 화면 간 예측 효율 향상 방법

  • Kim, Tae Hyun (Dept. of Computer Science and Engineering, Kyung Hee University) ;
  • Park, Gwang Hoon (Dept. of Computer Science and Engineering, Kyung Hee University)
  • 김태현 (경희대학교 컴퓨터공학과) ;
  • 박광훈 (경희대학교 컴퓨터공학과)
  • Received : 2016.12.06
  • Accepted : 2017.02.02
  • Published : 2017.05.30

Abstract

Recently, a lot of images containing various global movements have been generated by the activation of the photographic equipment such as the drone and the action cam. In this case, when the motion such as rotation, scaling is generated, it is difficult to expect a high coding efficiency in the conventional inter-picture prediction method using the 2D motion vector. In this paper, we propose a video coding method that reflects global motion through homography reference pictures. As a proposed method, there are 1) a method of generating a new reference picture by grasping a global motion relation between a current picture and a reference picture by homography, and 2) a method of utilizing a homography reference picture for inter-picture prediction. The experiment was applied to the HEVC reference software HM 14.0, and the experimental result showed an increase in encoding efficiency of 6.6% based on RA. Especially, the results using the videos with rotational motion have a maximum coding efficiency of 32.6%, which is expected to show high efficiency in video, which is often represented by complex global motion such as drones.

최근 드론, 액션캠 등과 같은 촬영 장비의 활성화로 다양한 전역 움직임을 내포한 영상들이 많이 생성되고 있다. 이때 회전, 확대, 축소 등의 움직임이 발생한 경우, 2D motion vector를 활용하는 기존의 화면 간 예측 방법은 높은 부호화 효율을 기대하기 어렵다. 본 논문에서는 전역 움직임을 homography 참조 픽처를 통해 반영한 비디오 부호화 방법을 제안한다. 제안방법으로, 1) 현재 픽처와 참조 픽처간 전역 움직임 관계를 homography로 파악하여 새로운 참조 픽처를 생성하는 방법, 2) homography 참조 픽처를 화면 간 예측에 활용하는 방법이 있다. 실험은 HEVC 참조 소프트웨어인 HM 14.0에 적용하였고, 실험결과 RA 기준 6.6% 부호화 효율이 증가했다. 특히, 회전 전역 움직임을 지니는 영상을 이용한 실험 결과에서는 기존대비 최대 32.6%의 부호화 효율이 증가하는 결과를 나타내어, 드론과 같이 복잡한 전역 움직임이 자주 나타나는 비디오에서 높은 효율을 보일 수 있을 것으로 기대된다.

Keywords

References

  1. G. J. Sullivan, J. M. Boyce, Y. Chen, J. R. Ohm, C. A. Segall, and A. Vetro, "Standardized extensions of high efficiency video coding (HEVC)". IEEE Journal of selected topics in Signal Processing, Vol.7, No.6, pp.1001-1016, Dec 2013. https://doi.org/10.1109/JSTSP.2013.2283657
  2. I. K. Kim, J. Min, T. Lee, W. J. Han, and J. H. Park, "Block Partitioning Structure int the HEVC Standard", IEEE Transactions on CSVT, Vol.22, No.12, pp.1697-2012, Dec 2012.
  3. O. D. Faugeras, and F. Lustman. "Motion and structure from motion in a piecewise planar environment." International Journal of Pattern Recognition and Artificial Intelligence Vol.2, No.3, pp.485-508, June 1988. https://doi.org/10.1142/S0218001488000285
  4. G. J. Sullivan , J. R. Ohm , W. J. Han and T. Wiegand, "Overview of the high efficiencyvideo coding (HEVC) standard", IEEE Trans. CircuitsSyst. Video Technol., Vol. 22, No. 12, pp.1649-1668, Sep 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  5. G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," ITU-T SG16 Q.6, VCEG-M33, Texas, USA, Apr. 2001.