Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Implementing VVC Tile Extractor for 360-degree Video Streaming Using Motion-Constrained Tile Set

  • Jeong, Jong-Beom (Department of Computer Education, Sungkyunkwan University) ;
  • Lee, Soonbin (Department of Computer Education, Sungkyunkwan University) ;
  • Kim, Inae (Department of Computer Education, Sungkyunkwan University) ;
  • Lee, Sangsoon (Department of Computer Engineering, Gachon University) ;
  • Ryu, Eun-Seok (Department of Computer Education, Sungkyunkwan University)
  • Received : 2020.10.29
  • Accepted : 2020.12.02
  • Published : 2020.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

360-degree video streaming technologies have been widely developed to provide immersive virtual reality (VR) experiences. However, high computational power and bandwidth are required to transmit and render high-quality 360-degree video through a head-mounted display (HMD). One way to overcome this problem is by transmitting high-quality viewport areas. This paper therefore proposes a motion-constrained tile set (MCTS)-based tile extractor for versatile video coding (VVC). The proposed extractor extracts high-quality viewport tiles, which are simulcasted with low-quality whole video to respond to unexpected movements by the user. The experimental results demonstrate a savings of 24.81% in the bjøntegaard delta rate (BD-rate) saving for the luma peak signal-to-noise ratio (PSNR) compared to the rate obtained using a VVC anchor without tiled streaming.

Keywords

References

  1. M. -L. Champel, T. Stockhammer, T. Fautier, E. Thomas, R. Koenen. "Quality Requirements for VR", 116th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG 116/m39532, 2016.
  2. J. Boyce, E. Alshina, A. Abbas, Y. Ye, "JVET common test conditions and evaluation procedures for 360° video", 118th MPEG meeting of ISO/IECJTC1/SC29/WG11, MPEG118/ n16891, 2017.
  3. J. B. Jeong, D. Jang, J. Son, E. -S. Ryu, "3DoF+ 360 Video Location-Based Asymmetric Down-Sampling for View Synthesis to Immersive VR Video Streaming", Sensors 18(9), 3148, 2018. https://doi.org/10.3390/s18093148
  4. J. -B. Jeong, S. Lee, D. Jang, E. -S. Ryu, "Towards 3DoF+ 360 Video Streaming System for Immersive Media", IEEE Access, 7, pp. 136399-136408, 2019. https://doi.org/10.1109/ACCESS.2019.2942771
  5. J. Son, D. Jang, E. -S. Ryu, "Implementing 360 video tiled streaming system", In Proceedings of the 9th ACM Multimedia Systems Conference, pp. 521-524, 2018.
  6. J. Son, E. -S. Ryu, "Tile-based 360-degree video streaming for mobile virtual reality in cyber physical system", Computers & Electrical Engineering, 72, 361-368, 2018. https://doi.org/10.1016/j.compeleceng.2018.10.002
  7. S. Lee, D. Jang, J. -B. Jeong, E. -S. Ryu, "Motion-constrained tile set based 360-degree video streaming using saliency map prediction", In Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, pp. 20-24, 2019.
  8. J. -B. Jeong, S. Lee, I. -W. Ryu, T. T. Le, E. -S. Ryu, "Towards Viewport-dependent 6DoF 360 Video Tiled Streaming for Virtual Reality Systems", In Proceedings of the 28th ACM International Conference on Multimedia, pp. 3687-3695, 2020.
  9. A. Zare, A. Aminlou, M. Hannuksela, M. Gabbouj, "HEVC-compliant tile-based streaming of panoramic video for virtual reality applications", In Proceedings of the 24th ACM international conference on Multimedia, pp. 601-605, 2016.
  10. M. Coban, V.Seregin, M. Karczewicz, "AHG12: On rectangular slices", 15th JVET meeting, JVET-O0199, 2019.
  11. L. Chen, C. -Y. Chen, Y. -W. Huang, S. -M. Lei, "AHG17: [SYS-VVC] 14th JVET meeting of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC 29/WG 11, JVET-B1001, 2019.
  12. C. Bampis, A. Bovik, Z. Li, "A Simple Prediction Fusion Improves Data-driven Full-Reference Video Quality Assessment Models", In 2018 Picture Coding Symposium (PCS), pp. 298-302, 2018.
  13. Z. Wang, E. Simoncelli, A. Bovik, "Multiscale structural similarity for image quality assessment", In The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Vol. 2, pp. 1398-1402, 2003.
  14. A. Dziembowski, "Software manual of IV-PSNR for Immersive Video", 128th MPEG meeting of ISO/IEC JTC1/SC29/ WG11, MPEG127/n18709, 2019.