Robust Scalable Video Transmission using Adaptive Multiple Reference Motion Compensated Prediction

적응 다중 참조 이동 보상을 이용한 에러에 강인한 스케일러블 동영상 전송 기법

  • 김용관 (호서대학교 전기정보통신 공학부 정보통신전공) ;
  • 김승환 (서울대학교 전기.컴퓨터 공학부 신호처리연구실) ;
  • 이상욱 (서울대학교 전기.컴퓨터 공학부 신호처리연구실)
  • Published : 2004.03.01

Abstract

In this paper, we propose a novel scalable video coding algorithm based on adaptively weighted multiple reference frame method. To improve the coding efficiency in the enhancement layer, the enhancement frame is predicted by the sum of adaptively weighted double motion compensated frames in the enhancement layer and the current frame in the base layer, according to the input video characteristics. By employing adaptive reference selection scheme at the decoder, the proposed method reduce the drift problem significantly. From the experimental results, the proposed algorithm shows more than 1.0 ㏈ PSNR improvement, compared with the conventional scalable H.263+ for various packet loss rate channel conditions.

본 논문에서는 동영상 부호화의 이동 보상 과정에서 다중의 참조 영상들을 적응적으로 이용하는 새로운 스케일러블(scalable) 부호화 기법을 제안한다. 제안 기법은 입력 신호의 특성을 고려하여. 확장계층 및 기저계층에서 다중의 이동 참조 영상들에 대한 최적 가중 값을 적응적으로 구한다. 이러한 기법을 이용하여. 확장계층의 부호화 효율 및 오류에 대한 강인성을 향상시킨다. 또한 복호기에서 전송 오류가 검출된 경우. 적응적으로 참조 영상을 선택함으로써 에러 파급(drift) 현상을 현저히 감소시킨다 실험 결과들로부터, 제안하는 적응적인 스케일러블 부호화 기법은 다양한 채널 에러(channel error) 환경에서, 기존의 스케일러블 H.263+부호화 기법에 비하여 PSNR 성능이 약 1.0㏈ 이상 향상됨을 확인할 수 있었다.

Keywords

References

  1. IEEE J. Select Ares Commun. v.7 Two-layer coding of video signals for VBR network M.Ghanbari https://doi.org/10.1109/49.32343
  2. IEEE Trans. Veh Technol. v.43 Layered image transmission over cellular radio channels Y.Q.Zhang;Y.J.Liu;R.L.Pickholtz https://doi.org/10.1109/25.312766
  3. Proc. ICIP-95 v.Ⅲ Layered transmission of signals over power-constrained wireless channels M.Khansari;M.Vetterli
  4. IEEE Trans. Circuit Syst, Video Technol. v.6 Packet loss resilience of MPEG-2 scalable video coding algorithms R.Aravind;M.R.Civanlar;A.R.Reibman https://doi.org/10.1109/76.538925
  5. Signal Processing: Image Communication v.15 Scalable Internet video using MPEG-4 H.Radha;Y.Chen;K.Parthasarathy;R.Cohen https://doi.org/10.1016/S0923-5965(99)00026-0
  6. IEEE Trans. on Circuits and Syst. Video Technol. v.11 no.3 Overview of fine granularity scalability in MPEG-4 W.Li https://doi.org/10.1109/76.911157
  7. IEEE Trans. on Circuits and Syst. Video Technol. v.7 no.6 Layered coding using bitstream decomposition with drift correlation decomposition with drift correlation R.Mathew;J.F.Arnold
  8. ISO/IEC 13818-2(MPEG-2) Generic coding of moving pictures and associated audio information - Part 2 : Video ISO/IEC JTC1
  9. ITU-T recommendation H.263+ Video coding for low bitrate communication
  10. Document JVT-167 Joint Committee Draft (CD) Text of JVT
  11. IEEE Trans. on Circuits and Syst. Video Technol v.9 no.1 Logn-term memory motion-compensated prediction T.Wiegand;X.Zhang;G.Girod https://doi.org/10.1109/76.744276
  12. Proc. Int. Symp. Information Technol. Entropy-constrained linear vector prediction for motion-compensated video coding T.Wiegand;M.Flierl;B.Girod
  13. IEEE Trans. Circuits Syst. video Technol. v.11 no.9 Robust transmission of video sequence using double-vector motion compensation C.S.Kim;R.C.Kim;S.U.Lee https://doi.org/10.1109/76.946518
  14. Proc. IEEE Int. conf. Image Processing v.2 Adaptive multiple reference frame based scalable video coding algorithm S.H.Kim;Y.K.Kim;Sang-Uk Lee
  15. Signal Processing: Image communitation v.17 no.8 An efficient motion compensation algorithm based on double reference frame method S.H.Kim;C.S.Kim;Sang-Uk Lee https://doi.org/10.1016/S0923-5965(02)00058-9
  16. Signal Processing: Image communitation v.17 no.8 Error-resilient video coding using long-term memory prediction and feedback channel H.S.Jung;R.C.Kim;Sang-Ik Lee https://doi.org/10.1016/S0923-5965(02)00047-4
  17. IEEE Trans. on Image Processing v.10 no.2 Multiframe video coding for improved performance over wireless channels M.Budagavi;J.D.Gibson https://doi.org/10.1109/83.902290
  18. Proc. Int. Symp. Information Technol. Toward optimal scalability in predictive video for motion-compensated video coding K.Rose;S.L.Regunathan
  19. IEEE Trans. Circuits Syst. video Technol. v.11 no.9 Robust transmission of video sequence using double-vector motion compensation C.S.Kim;R.C.Kim;S.U.Lee https://doi.org/10.1109/76.946518
  20. Proc. IEEE Int. conf. Image Processing v.2 Adaptive multiple reference frame based scalable video coding algorithm S.H.Kim;Y.K.Kim;Sang-Uk Lee
  21. Signal Processing: Image communitaion v.17 no.8 An efficient motion compensation algorithm based on double reference frame method S.H.Kim;C.S.Kim;Sang-Uk Lee https://doi.org/10.1016/S0923-5965(02)00058-9
  22. Signal Processing: Image communitaion v.17 no.8 Errpr-resilient video coding using long-term memory prediction and feedback channel H.S.Jung;R.C.Kim;Sang-Uk Lee https://doi.org/10.1016/S0923-5965(02)00047-4
  23. IEEE Trans. on Image Processing v.10 no.2 Multiframe video coding for improved performance over wireless channels M.Budagavi;J.D.Gibson https://doi.org/10.1109/83.902290
  24. Proc. IEEE Int. conf. image Processing v.3 Toward optimal scalability in predictive video coding K.Rose;S.L.Regunathan
  25. IEEE Trans. on Circuits and Syst. Video Technol. v.11 no.3 Rate-distortion optimized layered coding with unequal error protection for robust internet video M.Gallant;F.Kossentini https://doi.org/10.1109/76.911161
  26. IEEE Trans. on Circuits and Syst. Video Technol. v.9 no.1 Rate control in DCT video coding for low-delay communications J.Ribas-Corbera;S.Lei https://doi.org/10.1109/76.744284
  27. IEEE Trans. on Circuits and Syst. Video Technol. v.11 no.5 A rate-control scheme for video transport over wireless channels S.Aramvith;I.M.Pao;M.T.Sun https://doi.org/10.1109/76.920187
  28. IEEE J. Select. Areas Commun. v.18 no.6 Analysis of video transmission over lossy channels K.Stuhmuller;N.Farver;M.Link;B.Girod https://doi.org/10.1109/49.848253