Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

SHVC-based V-PCC Content ISOBMFF Encapsulation and DASH Configuration Method

SHVC 기반 V-PCC 콘텐츠 ISOBMFF 캡슐화 및 DASH 구성 방안

  • Nam, Kwijung (Department of Electronics and Information Convergence Engineering, Kyung Hee University) ;
  • Kim, Junsik (Department of Electronics and Information Convergence Engineering, Kyung Hee University) ;
  • Kim, Kyuheon (Department of Electronics and Information Convergence Engineering, Kyung Hee University)
  • 남귀중 (경희대학교 전자정보융합공학과) ;
  • 김준식 (경희대학교 전자정보융합공학과) ;
  • 김규헌 (경희대학교 전자정보융합공학과)
  • Received : 2022.04.15
  • Accepted : 2022.05.23
  • Published : 2022.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

Video based Point Cloud Compression (V-PCC) is one of the compression methods for compressing point clouds, and shows high efficiency in dynamic point cloud compression with movement due to the feature of compressing point cloud data using an existing video codec. Accordingly, V-PCC is drawing attention as a core technology for immersive content services such as AR/VR. In order to effectively service these V-PCC contents through a media streaming platform, it is necessary to encapsulate them in the existing media file format, ISO based Media File Format (ISOBMFF). However, in order to service through an adaptive streaming platform such as Dynamic Adaptive Streaming over HTTP (DASH), it is necessary to encode V-PCC contents of various qualities and store them in the server. Due to the size of the 2D media, it causes a great burden on the encoder and the server compared to the existing 2D media. As a method to solve such a problem, it may be considered to configure a streaming platform based on content obtained through V-PCC content encoding based on SHVC. Therefore, this paper encapsulates the SHVC-based V-PCC bitstream into ISOBMFF suitable for DASH service and proposes a configuration method to service it. In addition, in this paper, we propose ISOBMFF encapsulation and DASH configuration method to effectively service SHVC-based V-PCC contents, and confirm them through verification experiments.

V-PCC는 포인트 클라우드를 압축하기 위한 압축 방안 중 하나로, 기존 비디오 코덱을 활용하여 포인트 클라우드 데이터를 압축한다는 특징으로 인해 움직임을 가지는 동적 포인트 클라우드 압축에 높은 효율을 나타낸다. 이에 V-PCC는 AR/VR과 같은 실감형 콘텐츠 서비스의 핵심 기술로써 주목받고 있다. 이러한 V-PCC 콘텐츠를 효과적으로 미디어 스트리밍 플랫폼을 통해 서비스하기 위해서는 기존 미디어 파일 포맷인 ISOBMFF로 캡슐화 하는 것이 필요하다. 하지만, DASH와 같은 적응형 스트리밍 플랫폼을 통해 서비스 하기 위해서는 V-PCC 콘텐츠를 다양한 품질의 콘텐츠를 각각 인코딩하여 서버에 저장해야 하며, V-PCC의 높은 인코딩 복잡성과 방대한 데이터의 크기로 인해 기존의 2차원 미디어에 비해 인코더와 서버에 큰 부담을 발생시킨다. 이와 같은 문제점을 해결하기 위한 방법으로 SHVC 기반의 V-PCC 콘텐츠 인코딩을 통해 획득한 콘텐츠를 기반으로 스트리밍 플랫폼을 구성하는 것이 고려되어질 수 있다. 이에, 본 논문에서는 SHVC기반의 V-PCC 비트스트림을 DASH 서비스에 맞게 ISOBMFF로 캡슐화하고 이를 서비스하기 위한 구성방안을 제안하였다. 또한, 본 논문에서는 SHVC 기반 V-PCC 콘텐츠를 효과적으로 서비스하기 위한 ISOBMFF 캡슐화와 DASH 구성 방안에 대해 제안하고, 검증 실험을 통해 이를 확인한다

Keywords

Acknowledgement

This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ITRC(Information Technology Research Center) support program (IITP-2021-0-02046) and (Grant number: 2020-0-00452) supervised by the Institute of Information & communications Technology Planning & evaluation (IITP).

References

  1. Junsik Kim, Jiheon Im, Kyuheon Kim, "Dynamically Acquired Point Cloud Compression Method based on Video based Point Cloud Compression", 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp.189-192, 2019.
  2. Dong Tianyu, Euee S. Jang, "Review on codec-agnostic approach for MPEG V-PCC", 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp.388-390, 2019
  3. Doohwan Kim, Jiheon Im, Ktuheon Kim, "MPEG-DASH based 3D Point Cloud Content Configuration Method", Journal of Broadcast Engineering, Vol.24, No.4, pp.660-669, July 2019. doi: https://doi.org/10.5909/JBE.2019.24.4.660
  4. ISO/IEC JTC1/SC29/WG11 Doc. MPEG2015/N15778, Scalable HEVC (SHVC) Test Model 11 (SHM11), Geneva, October, 2015
  5. Y. Hwang, J. Kim, K. Kim, "A method of density scalability using SHVC codec in Video based Point Cloud Compression" 2020 The Korean Institute of Broadcast and Media Engineers Summer Conference, Korea, pp . 383-387, 2020.
  6. ISO/IEC JTC1/SC29/WG11 Doc. MPEG2020/N19092, V-PCC Codec Description, Brussels, March, 2020.
  7. ISO/IEC JTC1/SC29/WG11 Doc. MPEG2019/N18180, Video-based Point Cloud Compression, Marrakesh, January 2019
  8. ISO/IEC JTC1/SC29/WG3/N0163, "Draft text of ISO/IEC FDIS 23090-10 Carriage of Visual Volumetric Video-based Coding
  9. ISO/IEC 14496-12 - MPEG-4 Part 12, ISO base media file format, July, 2014.
  10. ISO/IEC 23009-1:2014 (Second edition), Information technology Dynamic adaptive streaming over HTTP (DASH) Part 1: Media presentation description and segment formats, 2014
  11. MPEG DASH Industry Forum, Guidelines for Inplementation: DASH-IF Interoperability Points, Retrieved April.09, 2018, from http://dashif.org/
  12. ISO/IEC JTC1/SC29/WG11 Doc. MPEG2020/N19324, Common Test Conditions for PCC, Alpbach, online , April 2020.