Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Multimedia No-reference Video Quality Assessment Methods Using Bit Stream Information

비트스트림 정보를 이용한 멀티미디어 동영상의 무기준법 화질평가방법

  • Seo, Guiwon (Department of Electrical and Electronic Engineering, Yonsei University) ;
  • Ok, Jiheon (Department of Electrical and Electronic Engineering, Yonsei University) ;
  • Lee, Kwon (Department of Electrical and Electronic Engineering, Yonsei University) ;
  • Lee, Jae Ho (Department of Electrical and Electronic Engineering, Yonsei University) ;
  • Lee, Chulhee (Department of Electrical and Electronic Engineering, Yonsei University)
  • 서귀원 (연세대학교 전기전자공학부) ;
  • 옥지헌 (연세대학교 전기전자공학부) ;
  • 이권 (연세대학교 전기전자공학부) ;
  • 이재호 (연세대학교 전기전자공학부) ;
  • 이철희 (연세대학교 전기전자공학부)
  • Received : 2013.01.08
  • Accepted : 2013.03.19
  • Published : 2013.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

Various video services with networks are increasingly available as smart phones, computers and IPTV are widely used. However, transmission over networks may experience transmission errors due to traffic increases and noise. As a result, video quality may suffer. Therefore, quality monitoring emerges as an important issue. In this paper, we propose a video quality assessment method using bit stream information. The video quality metric is calculated using header information and ES (elementary stream) information. To assess performance of the proposed algorithm, subjective quality assessment tests are conducted (VGA resolution). It is shown high correlation between subjective result and the proposed method.

스마트기기 및 IPTV의 보급으로 인터넷망을 이용한 영상서비스가 증가하고 있다. 인터넷 망을 이용한 영상서비스에서는 과도한 트래픽으로 인한 화질 열화가 발생할 가능성이 존재한다. 사용자에게 일정한 화질의 영상서비스를 제공하기 위해 신뢰도 높은 화질 모니터링 시스템의 개발이 필요하다. 본 논문에서는 영상서비스에 사용되는 비트스트림 정보를 이용하여 체감화질을 측정하는 알고리즘을 제안한다. 통신망으로 전송되는 비트스트림에서 프로토콜 헤더정보와 ES(elementary stream) 정보를 사용하여 사용자에게 영상이 전달되었을 때의 화질지수를 측정한다. 알고리즘의 성능을 평가하기 위해 VGA 해상도로 주관적 화질 평가 실험을 진행하였으며, 제안하는 방법은 주관적 점수와 높은 상관도를 보였다.

Keywords

References

  1. Cisco, "Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2011-2016," February, 2102.
  2. A.M. Eskicioglu, P.S. Fisher, "Image quality measures and their performance," IEEE Trans. Comm. 43, pp. 2959-2965, December, 1995. https://doi.org/10.1109/26.477498
  3. B. Girod, "What's wrong with mean-squared error," A.B. Watson (Ed.) Digital Images and Human Vision, MIT Press, Cambridge, MA, pp. 207-220, 1993.
  4. P.C. Teo, D.J. Heeger, "Perceptual image distortion," Proceedings of the SPIE, Vol. 2179, pp. 127-141, 1994.
  5. Zhou Wang, Hamid R. Sheikh and Alan C. Bovik, "Objective Video Quality Assessment," in The Handbook of Video Databases: Design and Applications (B. Furht and O. Marques, eds.), CRC Press, September, 2003.
  6. Zhou Wang, Ligang Lu and Alan C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Processing: Image communication 19, pp. 121-132, 2004. https://doi.org/10.1016/S0923-5965(03)00076-6
  7. Margaret H. Pinson and Stephen Wolf, "A New Standardized Method for Objectively Measuring Video Quality," IEEE Trans. Broadcasting vol. 50, no. 3, pp. 312-322, September, 2004. https://doi.org/10.1109/TBC.2004.834028
  8. Zhou Wang and Eero P. Simoncelli, "Reduced-Reference Image Quality Assessment Using A Wavelet-Domain Natural Image Static Model," Proceedings of SPIE, vol. 5666, pp. 149-159, 2005.
  9. Irwan P. Gunawan and Mohammed Ghanbari, "Reduced-Reference Video Quality Assessment using Discriminative Local Harmonic Strength with Motion Consideration," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 1, January 2008.
  10. C. Lee, S. Lee, J. Lee, K. Lee, H. Choi, G. Seo and J. Park, "Video quality measurement for multimedia applications using reduced-reference signals," Optical Engineering 50(6), 067403, June, 2011. https://doi.org/10.1117/1.3589298
  11. Mylene C.Q. Farias and Sanjit K. Mitra, "No-reference Video Quality Metric based on Artifact Measurements," ICIP 2005, IEEE International Conference on, vol. 3, September, 2005.
  12. H. Choi and C. Lee, "No-reference image quality metric based on image classification," EURASIP Journal on Advances in Signal Processing, 2011:65. September, 2011.
  13. J. Choe and C. Lee, "Estimation of the peak signal-to-noise ratio for compressed video based on generalized Gaussian modeling," Optical Engineering 46(10), 107401, October, 2007. https://doi.org/10.1117/1.2799103
  14. H. Liu, N. Klomp and I. Heynderickx, "No-Reference Metric for Perceived Ringing Artifacts in Images," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 4, pp. 529-539, April, 2010. https://doi.org/10.1109/TCSVT.2009.2035848
  15. ITU-T Recommendation J.144, "Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference," 2004.
  16. ITU-T Recommendation J.246, "Perceptual visual quality measurement techniques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference," 2008.
  17. ITU-T Recommendation J.247, "Objective perceptual multimedia video quality measuremnt in the presence of a full reference," 2008.
  18. ITU-T Recommendation J.249, "Perceptual video quality measurement techniques for digital cable television in the presence of a reduced reference," 2010.
  19. ITU-T Recommendation J.341, "Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference," 2011.
  20. ITU-T Recommendation J.341, "Objective multimedia video quality measurement of HDTV for digital cable television in the presence of a reduced reference signal," 2011.
  21. S. Winkler and P. Mohandas, "The Evolution of Video Qulaity Measurment: From PSNR to Hybrid Metrics," IEEE Trans. Broadcasting, vol. 54, no. 3, September, 2008.
  22. ITU-T Recommendation P.1201, "Parametric non-intrusive assessment of audiovisual media streaming quality," 2012.
  23. ITU-T Recommendation P.1202, "Parametric non-intrusive bitstream assessment of video media streaming quality," 2012.
  24. S. Lee, K. Jung and D. Sim, "Real-time Objective Quality Assessment Based on Coding Parameters Extracted from H.264/AVC Bitstream," IEEE Trans. Consum. Electr., vol. 56, no. 2, pp. 1071-1078, May, 2010. https://doi.org/10.1109/TCE.2010.5506041
  25. X. Lin, H. Ma, L. Luo and Y. Chen, "No-reference Video Quality Assessment in the Compressed Domain," IEEE Trans. Consum. Electr., vol. 58, no. 2, pp. 505-512, May, 2012. https://doi.org/10.1109/TCE.2012.6227454
  26. M. Naccari, M. Tagliasacchi and S. Tubaro, "No-Reference Video Quality Monitoring for H.264/AVC Coded Video," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 932-946, August, 2009. https://doi.org/10.1109/TMM.2009.2021785
  27. O. Suguimoto, S. Natio, S. Sakazawa and A. Koike, "Objective Perceptual Video Quality Measurement Method Based on Hybrid No Reference Framework," in Proc. 16th IEEE Internal Conferenceon Image Processing, Egypt, November, 2009.
  28. A. Ichigaya, Y. Nishida and E. Nakasu, "Nonreference method for estimation PSNR of MPEG-2 Coded Video by using DCT coefficients and picture energy," IEEE Trans. Circuits Syst. Video Techonol. vol. 18, no. 6, pp.817-826, May 2008. https://doi.org/10.1109/TCSVT.2008.920658
  29. S. Shim, J. Moon and J. Han, "PSNR estimation using coefficient distribution of frequency domain in H.264 decoder," IET Electron. Lett. vol. 44, no,. 2, Jan. 2008.
  30. A. Eden, "No-reference estimation of the coding PSNR for H.264-coded sequences," IEEE Trans. Consum. Electr. vol. 53, no. 2, pp. 667-674, May 2007. https://doi.org/10.1109/TCE.2007.381744
  31. T. Brandao and M. P. Queluz, "No-reference quality assessment for H.264/AVC encoded video," IEEE Trans. Circuits Syst. Video Technol. vol. 20. no. 11, pp. 1437-1147, Nov. 2010. https://doi.org/10.1109/TCSVT.2010.2077474
  32. Y. Pitrey, U. Engelke, M. Barkowsky, R. Pepion, and P. L. Callet, "Subjective quality of svc-coded videos with different error-patterns concealed using spatial scalability," EUVIP, Paris, 2011.
  33. Y. Xu and Y. Zhou, "H.264 video communication based refined error concealment schemes," IEEE Trans. on Consumer Electronics, vol. 50, no. 4, pp. 1135-1141, Nov, 2004. https://doi.org/10.1109/TCE.2004.1362510
  34. S. Kumar, L. Xu, M. K. Mandal, S. Panchanathan, "Error resiliency schemes in H.264/AVC standard," J. Vis. Commun. Image R., vol. 17, pp. 425-450, 2006. https://doi.org/10.1016/j.jvcir.2005.04.006
  35. Y. Zhang, W. Gao, H. Sun, Q. Huang, Y. Lu, "Error resilience video coding in H.264 encoder with potential distortion tracking," Image Processing, ICIP 2004 International Conference on., 2004.
  36. ITU-R Recommendation BT.500-11, "Methodology for the subjective assessment for the quality of television pictures," 2002.
  37. ITU-T Recommendation P.910, "Subjective video quality assessment methods for multimedia applications," 2008.