Evaluation of Video Quality Based on Objectively Estimated Metric


Abstract

Multimedia applications and especially encoded video services, are expected to playa major role in the 3rd generation (3G) and beyond mobile communication systems. Given that future service providers are expected to provide video applications at various price and quality levels, quick and economically affordable methods for preparing/encoding the offering media at various qualities are necessary to be developed. This paper presents a method for objective evaluation of the perceived quality of MPEG­4 video content, based on a quantification of subjective assessments. Showing that subjectively derived perceived quality of service (PQoS) vs. bit rate curves can be successfully approximated by a group of exponential functions, the proposed method exploits a simple objective metric, which is obtained from the mean frame rate vs. bit rate curves of an encoded clip. The validity of this metric is assessed by comparing subjectively derived PQoS results to the corresponding ones, which come from the proposed objective method, showing that the proposed technique provides satisfactory PQoS estimation.

Keywords

References

  1. P. Seeling, M. Reisslein, and B. Kulapala, 'Network performance evaluation using frame size and quality traces of single layer and two layer video: A tutorial,' IEEE Commun. Surveys, vol. 6, no. 3, 3rd Quarter 2004
  2. T. Alpert and L. Contin, 'DSCQE experiment for the evaluation of the MPEG-4 VM on error robustness functionality,' ISO/IEC-JTC1/SC29/WG11, MPEG 97/M1604, 1997
  3. ITU-R, 'Methodology for the subjective assessment of the quality of television pictures,' Recommendation ITU-R BT,500-7, 2000
  4. F. Pereira and T. Alpert, 'MPEG-4 video subjective test procedures and results,' IEEE Trans. Circ. Syst. Video Technol., vol. 7, no. 1, pp. 32-51, 1997 https://doi.org/10.1109/76.554416
  5. K. T. Tan and M. Ghanbari, 'A multi-metric objective picture quality measurements model for MPEG video,' IEEE Trans. Circ. Syst. Video Technol., vol. 10, no. 7, pp. 1208-1213, 2000 https://doi.org/10.1109/76.875525
  6. St. Wolf and M. H. Pinson, 'Spatial-temporal distortion metrics for inservice quality monitoring of any digital video system,' in Proc. SPIE Int. Symp. Voice Video Data Commun., Boston, MA, Sept. 11-22, 1999
  7. A. B. Watson, J. Hu, and J. F. McGowan, 'DVQ: A digital video quality metric based on human vision,' J. Electron. Imaging, vol. 10, no. 1, pp. 20-29, 2001 https://doi.org/10.1117/1.1329896
  8. S. Daly, 'The visible difference predictor: An algorithm for the assessment of image fidelity,' in Proc. SPIE'92, vol. 1616, 1992, pp. 2-15
  9. A. P. Bradley, 'A wavelet difference predictor,' IEEE Trans. Image Processing, vol. 5, pp. 717-730, 1999
  10. Y. K. Lai and J. Kuo, 'A Haar wavelet approach to compressed image quality measurement,' J. Visual Commun. Image Understanding, vol. 11, pp. 81-84, 2000
  11. Z. Wang, H. R. Sheikh, and A. C. Bovik, Objective video quality assessment, in The Handbook of Video Databases: Design and Applications, B. Furht and O. Marqure, eds., CRC Press, pp. 1041-1078, 2003
  12. VQEG, 'Final report from the video quality experts group on the validation of objective models of video quality assessment,' 2000
  13. Z. Wang, A. C. Bovik, and L. Lu, 'Why is image auality assessment so difficult,' in Proc. IEEE ICASSP 2002, vol. 4, 2002, pp. 3313-3316
  14. Z. Wang, L. Lu, and A. C. Bovik, 'Video auality assessment based on structural distortion measurement,' Sig. Processing: Image Commun., special issue on 'Objective video quality metrics,' vol. 19, no. 2, pp. 121-132, 2004 https://doi.org/10.1016/S0923-5965(03)00076-6
  15. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, 'Image quality assessment: From error visibility to structural similarity,' IEEE Trans. Image Processing, vol. 13, no. 4, pp. 1-14, 2004 https://doi.org/10.1109/TIP.2003.819432
  16. I. P. Guawan and M. Ghanbari, 'Reduced-reference picture quality estimation by using local harmonic amplitude information,' in Proc. London Commun. Symp. 2003, 2003
  17. L. Lu, Z. Wang, A. C. Bovik, and J. Kouloheris, 'Full-reference video quality assessment considering structural distortion and no-reference quality evaluation of MPEG video,' in Proc. IEEE Int. Conf. Multimedia, 2002
  18. J. Lauterjung, 'Picture quality measurement,' in Proc. Int. Broadcasting Convention (IBC'98), Amsterdam, 1998, pp. 413-417
  19. MPEG, ISO-IEC/JTC1/SC29/WG11 N4668, 'MPEG-4 overview,' Mar. 2002
  20. MPEG, ISO-IEC/JTC1/SC29/WG11 N2604, 'Report of the formal verification tests on MPEG-4 video error resilience,' 1999
  21. R. P. Aldridge, D. S. Hands, D. E. Pearson, and N. K. Lodge, 'Continuous assessment of digitally-coded television pictures,' IEE Proc. Vision, Image, Sig. Processing, vol. 145, no. 2, pp. 116-123, 1998 https://doi.org/10.1049/ip-vis:19981843
  22. F. Pereira and T. Ebrahimi, The MPEG-4 Book, IMSC Press Multimedia Series, pp. 669-705, 2002
  23. W. Lee and J. Srivastava, 'An algebraic QoS-based resource allocation model for competitive multimedia applications,' Int. J. Multimedia Tools and Appl., Kluwer Editions, vol. 13, pp. 197-212, 2001 https://doi.org/10.1023/A:1009645328053