DOI QR코드

DOI QR Code

Adaptive Multi-view Video Interpolation Method Based on Inter-view Nonlinear Moving Blocks Estimation

시점 간 비선형 움직임 블록 예측에 기초한 적응적 다시점 비디오 보상 보간 기법

  • 김진수 (한밭대학교 정보통신공학과)
  • Received : 2014.01.23
  • Accepted : 2014.03.24
  • Published : 2014.04.28

Abstract

Recently, many researches have been focused on multi-view video applications and services such as wireless video surveillance networks, wireless video sensor networks and wireless mobile video. In multi-view video signal processing, to exploit the strong correlation between images acquired by different cameras plays great role in developing a core technique of multi-view video coding. This paper proposes an adaptive multi-view video interpolation technique which is applicable for multi-view distributed video coding without requiring any cooperation amongst the cameras. The proposed algorithm estimates the non-linear moving blocks and employs disparity compensated view prediction, and then fills in the unreliable blocks. Through computer simulations, it is shown that the proposed method outperforms the conventional methods.

최근에 무선 비디오 감사, 무선 비디오 센서 네트워크 그리고 무선 모바일 비디오와 같은 다시점 비디오 서비스에 대한 연구가 활발히 진행되고 있다. 다시점 비디오 신호처리에서 다수 개의 다른 카메라에서 획득되는 영상 사이에 존재하는 높은 상관성을 이용하는 것은 매우 핵심적인 기술이다. 본 논문에서는 카메라들 사이에 상호작용을 요구하지 않고, 다시점 분산 비디오 부호화에 효과적으로 사용할 수 있는 적응적인 다시점 보간 기법을 제안한다. 제안한 방법은 비선형적인 블록 예측, 시차 보상 시점 예측 그리고 비신뢰 블록에 대한 채우기 기법 등으로 구성된다. 모의실험을 통하여 제안한 방식은 기존의 방식에 비해 우수한 성능을 보인다.

Keywords

References

  1. A. Smolic, K. Mueller, T. Rein, P. Eisert, and T. Wiegand, "Free Viewpoint Video Extraction, Representation, Coding, and Rendering," IEEE International Conference on Image Processing, Vol. 5, pp. 3287-3290, 2004.
  2. ISO/IEC JTC1/SC29/WG11, "Requirements on Multi-view Video Codingv. 7," N8218, 2006(7).
  3. F. Dufaux, M. Ouaret, and T. Ebrahimi, "Recent Advances in Multi-View Distributed Video Coding," SPIE Mobile Multimedia/Image Processing for Military and Security Applications, 2012.
  4. M. Ouaret, F. Dufaux, and T. Ebrahimi, "Fusion-based Multiview Distributed Video Coding," ACM International Workshopon Video Surveilance and Sensor Networks, Santa Barbara, CA. USA, 2006(10).
  5. X. Artigas, F. Tarres, and L. Torres, "A Comparison of Different Side Information Generation Methods for Multiview Distributed Video Coding," International Conference on SIGMAP, 2007.
  6. X. Artigas, E. Angeli, and L. Torres, "Side Information Generation for Multiview Distributed Video Coding Using a Fusion Approach," NORSIG'06, Reykjavik, Iceland, 2006(6).
  7. T. Maugey, W. Miled, M. Cagnazzo, and B. P. Popsecu, "Fusion Schemes for Multiview Distributed Video Coding," 17th EUSIPCO 2009, Glasgow, Scotland, 2009(8).
  8. N. Cheung, A. Ortega, and G. Cheung, "Rate-Distortion Based Reconstruction Optimizationin Distributed Source Coding for Interactive Multiview Video Streaming," Proc. of 2010 IEEE 17th ICIP, HongKong, 2010(9).
  9. F. Xiao, J. Liu, and L. Liu, "Novel Side Information Generation Algorithm of Multiview Distributed Video Coding for Multimedia Sensor Networks," Int. Jour. of Distributed Sensor Networks, Vol. 2012
  10. S. H. Lee, O. J. Kwon, and R. H. Park, "Weighted-Adaptive Motion-Compensated Frame Rate Up-Conversion," IEEE Tr. on Consumer Electronics, Vol. 49, No. 3, pp. 485-492, 2003(8). https://doi.org/10.1109/TCE.2003.1233759
  11. J. S. Kim, "Frame-Adaptive Distortion Estimation for Motion Compensated Interpolated Frame," Journal of the Korea Contents Association, Vol. 3, No. 12, pp. 1-8, 2012(3). https://doi.org/10.5392/JKCA.2012.12.03.001
  12. E. Peixoto, R. L. Queiroz, and D. Mukherjee, "On Side Information Generation for Wyner-Ziv Video Coding," Proc. of Simposio Brasileiro de Tel., Rio de Janeiro, Brazil, 2008(9).