Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Dynamic Full-Scalability-Conversion in SVC

스케일러블 비디오 코딩에서의 실시간 스케일러빌리티 변환

  • Lee, Dong-Su (School of Engineering, Information and Communication University) ;
  • Bae, Tae-Meon (School of Engineering, Information and Communication University) ;
  • Ro, Yong-Man (School of Engineering, Information and Communication University)
  • 이동수 (한국정보통신대학교 공학부) ;
  • 배태면 (한국정보통신대학교 공학부) ;
  • 노용만 (한국정보통신대학교 공학부)
  • Published : 2006.11.25
Download PDF
⟨ Previous Next ⟩

Abstract

Currently, Scalable Video Coding (SVC) is being standardized. By using scalability of SVC, QoS managed video streaming service is enabled in heterogeneous networks even with only one original bitstream. But current SVC is insufficient to dynamic video conversion for the scalability, thereby the adaptation of bitrate to meet a fluctuating network condition is limited. In this paper, we propose dynamic full-scalability conversion method for QoS adaptive video streaming in H.264/AVC SVC. To accomplish full scalability dynamic conversion, we propose corresponding bitstream extraction, encoding and decoding schemes. On the encoder, we newly insert the IDR NAL to solve the problems of spatial scalability conversion. On the extractor, we analyze the SVC bitstream to get the information which enable dynamic extraction. By using this information, real time extraction is achieved. Finally, we develop the decoder so that it can manage changing bitrate to support real time full-scalability. The experimental results showed that dynamic full-scalability conversion was verified and it was necessary for time varying network condition.

유비쿼터스 환경에서의 비디오 적응 변환을 위하여 현재 MPEG-4 AVC/SE SVC에서는 공간적, 시간적, 품질적 스케일러빌리티를 지원하고 있다. 이러한 스케일러빌리티의 변환은 가변적인 대역폭을 가지는 네트워크 특성에 따라 실시간으로 이루어져야 한다. 그러나 현재의 SVC에서는 품질적 스케일러빌리티에 대해서는 실시간으로 스케일러빌리티를 변환할 수 잇지만 공간적, 시간적 스케일러빌리티에 대해서는 이를 제대로 지원할 수 없다. 이에 본 논문에서는 이와 관련된 문제점들을 자세히 알아보고 이를 해결하기 위한 방법을 제안한다. 부호시에는 주기적으로 IDR NAL을 삽입하였다. 추출시에는 실시간 추출에 필요한 정보들을 미리 분석한 후 실제 추출시에 활용하여 실시간 추출을 가능하도록 하였다. 마지막으로 복호시에는 실시간 스케일러빌리티를 지원할 수 있는 프로세스를 정의하였다. 이를 JSVM4.0에 구현하였고 주어진 네트워크 대역폭에 스케일러빌리티를 통하여 적응된 비트스트림의 비트레이트, PSNR, 스케일러빌리티를 측정하여 제안된 방법의 유효성을 검증하였다.

Keywords

References

  1. Chang, S.F., and Vetro, A., 'Video adaptation: concepts, technologies, and open issues,' Proceedings of the IEEE, Vol. 93, Issue 1, pp. 148-158, Jan. 2005 https://doi.org/10.1109/JPROC.2004.839600
  2. T. Stockhammer and M. M. Hannuksela, 'H.264/AVC video for wireless transmission,' IEEE wireless communication, vol. 12, pp. 6-13, Aug. 2005 https://doi.org/10.1109/MWC.2005.1497853
  3. A. K. Katsaggelos et al., 'Advances in efficient resource allocation for packet-based real-time video transmission,' Proceedings of the IEEE, Special Issue on Advances in Video Coding and Delivery, vol. 93, no. 1, pp. 135-147, Jan. 2005 https://doi.org/10.1109/JPROC.2004.839621
  4. Ohm, J.R., 'Advances in scalable video coding,' Proceedings of the IEEE, Vol. 93, Issue 1, pp. 42-56, Jan. 2005 https://doi.org/10.1109/JPROC.2004.839611
  5. H. Schwarz, D. Marpe, and T. Wiegand, 'MCTF and Scalability Extension of H.264/AVC,' Proc. of PCS, SanFrancisco, CA, USA, Dec. 2004
  6. E. Francois, J. Vieron, and G. Boisson, 'MPEG SVC: Why a New Video Coding Standard?,' Broadband Europe 2004 Conference, Session 10, pp. 1-5, Brugge, Belgium, Dec. 2004
  7. M. Mrak, M. Grgic, and S. Grgic, 'Scalable Video Coding in Network Applications,' Video/Image Processing and Multimedia Communications 4th EURASIP-IEEE Region 8 International Symposium on VIPromCom, pp. 205-211, June 2002 https://doi.org/10.1109/VIPROM.2002.1026656
  8. ISO/IEC JTC 1/SC 29/WG 11, 'Working Draft 4 of ISO/IEC 14496-10:2005/AMD3 Scalable Video Coding,' N7555, Nice, France, Oct. 2005
  9. W. H. Peng, C. Y. Tsai, T. Chiang and H. M. Hang, 'Advances of MPEG Scalable Video Coding Standard,' KES Int'l Workshop on Intelligent Information Hiding and Multimedia Signal Processing, Melbourne, pp. 889-895, Sep. 2005 https://doi.org/10.1007/11554028_124
  10. W.Li, 'Overview of Fine Granular Scalability in MPEG-4 Video standard,' IEEE Trans. Circuits Syst. Video Techno., 11(3), Vol. 11, no. 3, Mar. 2001
  11. ISO/IEC JTC 1/SC 29/WG 11, 'Joint Scalable Video Model (JSVM) 4.0 Reference Encoding Algorithm Description,' N7556, Nice, France, Oct. 2005
  12. H. Schwarz, D. Marpe, and T. Wiegand, 'Analysis of hierarchical B pictures and MCTF,' ICME, Toronto, Canada, Jul. 2006 https://doi.org/10.1109/ICME.2006.262934
  13. Schwarz, H., Marpe, D., Schierl, T., and Wiegand, T., 'Combined scalability support for the scalable extension of H.264/AVC,' Multimedia and Expo, ICME 2005. IEEE International Conference, pp. 6-8 July, 2005 https://doi.org/10.1109/ICME.2005.1521456
  14. Schwarz, H., Hinz, T., Marpe, D., and Wiegand, T., 'Constrained inter-layer prediction for single-loop decoding in spatial scalability,' IEEE International Conference on Image Processing, Vol. 2, 11-14 pp. 870-873, Sept. 2005 https://doi.org/10.1109/ICIP.2005.1530194
  15. ISO/IEC JTC 1/SC 29/WG 11, 'Text of ISO/IEC FDIS 14496-10: Advanced Video Coding 3rd Edition,' N6540, Redmond, July 2004
  16. Yang Ju Jung, and et. El, 'Analysis of Human Perception for Semantic Concept-based Video Transcoding,' IWATE 2005, pp. 251-256, 2005