KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Model for Mobile Online Video viewed on Samsung Galaxy Note 5

  • Pal, Debajyoti (IP Communications Laboratory, School of Information Technology, King Mongkut's University of Technology Thonburi) ;
  • Vanijja, Vajirasak (IP Communications Laboratory, School of Information Technology, King Mongkut's University of Technology Thonburi)
  • Received : 2017.02.27
  • Accepted : 2017.07.24
  • Published : 2017.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

The primary aim of this paper is to propose a non-linear regression based technique for mapping different network Quality of Service (QoS) factors to an integrated end-user Quality of Experience (QoE) or Mean Opinion Score (MOS) value for an online video streaming service on a mobile phone. We use six network QoS factors for finding out the user QoE. The contribution of this paper is threefold. First, we investigate the impact of the network QoS factors on the perceived video quality. Next, we perform an individual mapping of the significant network QoS parameters obtained in stage 1 to the user QoE based upon a non-linear regression method. The optimal QoS to QoE mapping function is chosen based upon a decision variable. In the final stage, we evaluate the integrated QoE of the system by taking the combined effect of all the QoS factors considered. Extensive subjective tests comprising of over 50 people across a wide variety of video contents encoded with H.265/HEVC and VP9 codec have been conducted in order to gather the actual MOS data for the purpose of QoS to QoE mapping. Our proposed hybrid model has been validated against unseen data and reveals good prediction accuracy.

Keywords

References

  1. Cisco Global Mobile Data Traffic Forecast Update Report, 2014-2019, Cisco White Paper (2016).
  2. Ooyala, Q1 2013 Video Index-TV is no longer a single screen in your living room, 2013.
  3. P. Callet, S. Moller and A. Perkis, "Qualinet White Paper on Definitions of Quality of Experience," Lausanne, Switzerland, 2013.
  4. Quality of Experience Requirements for IPTV Services, ITU-T Recommendation G.1080, December 2008.
  5. T. Hobfeld, R. Schatz and A.D'Alconzo, "Challenges of QoE Management for Cloud Applications," IEEE Communications Magazine, vol. 50, no. 4, pp. 28-36, 2012. https://doi.org/10.1109/MCOM.2012.6178831
  6. K. Piamrat, C. Viho, J. M. Bonnin and A. Ksentin, "Quality of Experience Measurements for Video Streaming over Wireless Network," in Proc. Of 6th Int. Conf. on Information Technology: New Generations, pp. 1184-1189, November 2009.
  7. Subjective Video Quality Assessment Methods for Multimedia Applications, ITU-T Recommendation P.910, June 2008.
  8. Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-T Recommendation BT.500, January 2012.
  9. Methods for Subjective Determination of Transmission Quality, ITU-T Recommendation P.800, August 1996.
  10. Subjective Audiovisual Quality Assessment Methods for Multimedia Applications, ITU-T Recommendation P.911, December 1998.
  11. M. Vranjes, S. Rimac-Drlje and D. Zagar, "Subjective and Objective Quality Evaluation of the H.264/AVC Coded Video," in Proc. of 15th Int. Conf. on Systems, Signal and Image Processing, pp. 287-290, 2008.
  12. Quan H. Thu and M. Ghanbari, "The Accuracy of PSNR in Predicting Video Quality for Different Video Scenes and Frame Rates," Telecommunication Systems, vol. 49, no. 1, pp. 35-48, January 2012. https://doi.org/10.1007/s11235-010-9351-x
  13. Zhou Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, April 2004. https://doi.org/10.1109/TIP.2003.819861
  14. M. H. Pinson and S. Wolf, "A New Standardized Method for Objectively Measuring Video Quality," IEEE Transactions on Broadcasting, vol. 50, no. 3, pp. 312-322, September 2004. https://doi.org/10.1109/TBC.2004.834028
  15. Opinion Model for Video Telephony Applications, ITU-T Recommendation G.1070, July 2012.
  16. Kim. H. L and S.G. Choi, "A Study on a QoS/QoE Correlational Model for QoE Evaluation on IPTV Service," in Proc. of 12th International Conference on Advanced Communication Technology, pp. 1377-1382, 2010.
  17. Kim. H. L, D. H. Lee, J. M. Lee, K.H. Lyu and S.G. Choi, "The QoE Evaluation Method through the QoS-QoE Correlational Model," in Proc. of NCM'08, pp. 719-725, 2008.
  18. A. Khan, L. Sun and E. Ifeachor, "QoE Prediction Model and its Application in Video Quality Adaptation over UMTS Networks," IEEE Transactions on Multimedia, vol. 4, no. 2, pp. 431-442, 2012.
  19. B. Wang, X. Wen and Z. Wei, "A new approach measuring user's QoE in the IPTV," in Proc. of Asia-Pacific Conference on Circuits, Communication and Systems, pp. 453-456, 2009.
  20. F. Mercer Moss, K. Wang, F. Zhang, R. Baddeley and D. R. Bull, "On the Optimal Presentation Duration for Subjective Video Quality Assessment," IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 11, pp. 1977-1987, November 2016. https://doi.org/10.1109/TCSVT.2015.2461971
  21. M. H. Pinson and S. Wolf, "Comparing Subjective Video Quality Testing Methodologies," in Proc. of SPIE Video Communications and Image Processing Conference, pp. 573-582, 2003.
  22. D.M. Rouse, R. Pepion R. Callet and S. Hemami, "Tradeoffs in Subjective Testing Methods for Image and Video Quality Assessment," in Proc. of SPIE, Human Vision and Electronic Imaging Conference, 2010.
  23. P. Romaniak, M. Mu, A. Mauthe, M. Leszczuk and E. Cerqueria, "Framework for the Integrated Video Quality Assessment," Multimedia Tools and Applications, vol. 61, no. 3, pp. 787-817, December 2012. https://doi.org/10.1007/s11042-011-0946-3
  24. S. Kanumuri, P. C. Cosman, A. R. Reibman and V. A. Vaishampayan, "Modeling Packet-loss Visibility in MPEG-2 video," IEEE Transactions on Multimedia, vol. 8, no. 2, pp. 341-355, April 2006. https://doi.org/10.1109/TMM.2005.864343
  25. J. Sogaard, S. Forchhammer and J. Korhonen, "No-Reference Video Quality Assessment Using Codec Analysis," IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 10, pp. 1637-1650, October 2015. https://doi.org/10.1109/TCSVT.2015.2397207
  26. M. Sahid, A. Rossholm, B. Lovstorm and H. Zepernick, "No-reference Image and Video Quality Assessment: A Classification and Review of Recent Approaches," EURASIP Journal on Image and Video Processing, vol. 2014, no. 1, pp. 1-32, August 2014. https://doi.org/10.1186/1687-5281-2014-1
  27. R. Mok, E. Chan and R.K.C Chang, "Measuring the Quality of Experience of HTTP Video Streaming," in Proc. of IEEE International Symposium on Integrated Network Management, pp. 485-492, 2011.
  28. S. Khirman and P. Henricksen, "Relationship between Quality of Service and Quality of Experience for Public Internet Services," in Proc. of 3rd Workshop on Passive and Active Measurement, pp. 23-28, March 2002.
  29. P. Romaniak, "Towards Realization of a Framework for Integrated Video Quality of Experience Assessment," in Proc. of IEEE INFOCOM Workshops, pp. 1-2, 2009.
  30. M. Fiedler, T. Hossfeld and P. Tran-Gia, "A Generic Quantitative Relationship between Quality of Experience and Quality of Service," IEEE Network, vol. 24, no. 2, pp. 36-41, April 2010. https://doi.org/10.1109/MNET.2010.5430142
  31. P. Reichl, S. Egger, R. Schatz and A. D'Alconzo, "The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment," in Proc. of IEEE Int. Conf. on Communications, pp. 1-5, 2010.
  32. J. A. Lozano, A. Castro, B. Fuentes, J. M. Gonzalez and A. Rodriguez, "Adaptive QoE Measurement on Videostreaming IP services," in Proc. of 7th Int. Conf. on Network and Service Management, pp. 1-4, 2011.
  33. L. Skorin-Kapov and M. Varela, "A multi-dimensional view of QoE: the ARCU model," in Proc. of 35th Int. Convention MIPRO, pp. 662-222, 2012.
  34. D. Yun; K. Chung, "DASH-based Multi-view Video Streaming System," IEEE Transactions on Circuits and Systems for Video Technology, vol. PP, no.99, pp.1-1, April 4 2017.
  35. S. Colonnese, F. Cuomo, T. Melodia and I. Rubin, "A Cross-Layer Bandwidth Allocation Scheme for HTTP-Based Video Streaming in LTE Cellular Networks," IEEE Communications Letters, vol. 21, no. 2, pp. 386-389, Feb. 2017. https://doi.org/10.1109/LCOMM.2016.2628378
  36. K. Jia, Y. Guo, Y. Chen and Y. Zhao, "Measuring and Predicting Quality of Experience of DASH-based Video Streaming over LTE," in Proc. of 19th International Symposium on Wireless Personal Multimedia Communications (WPMC), Shenzhen, China, 2016, pp. 102-107.
  37. T. Maki, M. Varela and D. Ammar, "A Layered Model for Quality Estimation of HTTP Video from QoS Measurements," in Proc. of 11th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Bangkok, 2015, pp. 591-598.
  38. J. Jiang, V. Sekar and H. Zhang, "Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming With Festive," IEEE/ACM Transactions on Networking, vol. 22, no. 1, pp. 326-340, Feb. 2014. https://doi.org/10.1109/TNET.2013.2291681
  39. Y. Chen, K. Wu and Q. Zhang, "From QoS to QoE: A Tutorial on Video Quality Assessment," IEEE Communications Surveys & Tutorials, vol. 17, no. 2, pp. 1126-1165, 2015. https://doi.org/10.1109/COMST.2014.2363139
  40. M. Seufert, S. Egger, M. Slanina, T. Zinner, T. Hossfeld and P. Tran-Gia, "A Survey on Quality of Experience of HTTP Adaptive Streaming," IEEE Communications Surveys & Tutorials, vol. 17, no. 1, pp. 469-492, 2015. https://doi.org/10.1109/COMST.2014.2360940
  41. P. Juluri, V. Tamarapalli and D. Medhi, "Measurement of Quality of Experience of Video-on-Demand Services: A Survey," IEEE Communications Surveys & Tutorials, vol. 18, no. 1, pp. 401-418, 2016. https://doi.org/10.1109/COMST.2015.2401424
  42. Sabina Barakovii and Lea Skorin-Kapov, "Multidimensional Modeling of Quality of Experience for Mobile Web Browsing," Computers in Human Behavior, vol. 50, no. C, pp. 314-332, September 2015. https://doi.org/10.1016/j.chb.2015.03.071
  43. H. Kim and S. Chobi, "QoE Assessment Model for Multimedia Streaming Services using QoS Parameters," Multimedia Tools and Applications, vol. 72, no. 3, pp. 2163-2175, May 2013. https://doi.org/10.1007/s11042-013-1507-8
  44. B. Belmudez and S. Moller, "Audiovisual Quality Integration for Interactive Communications," EURASIP Journal on Audio, Speech and Music Processing, vol.2013, no. 1, pp. 1-23, 2013. https://doi.org/10.1186/1687-4722-2013-1
  45. W. Song, D. Tjondronegoro and M. Docherty, "Exploration and Optimization of User Experience in Viewing Videos on a Mobile Phone," International Journal on Software Engineering Knowledge, vol. 20, no. 8, pp. 1045-1075, 2010. https://doi.org/10.1142/S0218194010005067
  46. VQEG Standard Database maintained at http://www.its.bldrdoc.gov/vqeg/downloads.aspx
  47. J. Joskowiz and L. Ardao, "Enhancements to the Opinion-Model for Video Telephony Applications," in Proc. of 5th Int. Latin American Networking Conference, pp. 87-94, 2009.
  48. A. Khan, L. Sun and E. Ifeachor, "Impact of Video Content on Video Quality for Video over Wireless Networks," in Proc. of 2009 Fifth International Conference on Autonomic and Autonomous Systems, pp. 277-282, 2009.
  49. J. Nightingale, Q. Wang, C. Grecos and S. Goma, "The Impact of Network Impairment on Quality of Experience (QoE) in H.265/HEVC Video Streaming," IEEE Transactions on Consumer Electronics, vol. 60, no. 2, pp. 242-250, May 2014. https://doi.org/10.1109/TCE.2014.6852000
  50. N. Laoutaris and I. Stavrakakis, "Adaptive Playout Strategies for Packet Video Receivers with Finite Buffer Capacity," in Proc. of IEEE Int. Conf. on Communications, pp. 969-973, 2001.
  51. M. M. Krunz and M. Hassan, "Adaptive rate control scheme for video streaming over wireless channels," in Proc. of Conf. on Data Compression, pp. 242-251, 2004.
  52. D. Simone, F. Goldmann and T. Ebrahimi, "Towards High Efficiency Video Coding: Subjective Evaluation of Potential Coding Technologies," Journal of Visual Communication and Image Representation, vol. 22, no. 8, pp. 734-748, 2011 https://doi.org/10.1016/j.jvcir.2011.01.008
  53. J. Korhonen, N. Burini and E. Nadernejad, "How to evaluate Objective Video Quality Metrics Reliably," in Proc. of 4th International Workshop on Quality of Multimedia Experience (QoMEX), pp. 57-62, 2012.
  54. Methodological Framework for specifying accuracy and Cross calibration of Video Quality Metrics, ITU-R BT.1676, 2004.
  55. Estimating end to end Performance in IP Networks for Data Applications, ITU-Recommendation G.1030, 2005.

Cited by

  1. Subjective Imaging Effect Assessment for Intelligent Imaging Terminal Design: a Method for Engineering Site vol.14, pp.3, 2017, https://doi.org/10.3837/tiis.2020.03.008