DOI QR코드

DOI QR Code

MPEG-I Immersive Audio Standardization Trend

MPEG-I Immersive Audio 표준화 동향

  • Kang, Kyeongok (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI) ;
  • Lee, Misuk (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI) ;
  • Lee, Yong Ju (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI) ;
  • Yoo, Jae-hyoun (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI) ;
  • Jang, Daeyoung (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI) ;
  • Lee, Taejin (Media Coding Research Section, Media Research Division, Communication & Media Research Laboratory, ETRI)
  • 강경옥 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실) ;
  • 이미숙 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실) ;
  • 이용주 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실) ;
  • 유재현 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실) ;
  • 장대영 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실) ;
  • 이태진 (한국전자통신연구원 통신미디어연구소 미디어연구본부 미디어부호화연구실)
  • Received : 2020.07.20
  • Accepted : 2020.08.28
  • Published : 2020.09.30

Abstract

In this paper, MPEG-I Immersive Audio Standardization and related trends are presented. MPEG-I Immersive Audio, which is under the development of standard documents at the exploration stage, can make a user interact with a virtual scene in 6 DoF manner and perceive sounds realistic and matching the user's spatial audio experience in the real world, in VR/AR environments that are expected as killer applications in hyper-connected environments such as 5G/6G. In order to do this, MPEG Audio Working Group has discussed the system architecture and related requirements for the spatial audio experience in VR/AR, audio evaluation platform (AEP) and encoder input format (EIF) for assessing the performance of submitted proponent technologies, and evaluation procedures.

본 고에서는 현재 탐색단계의 표준화가 진행 중인 MPEG-I Immersive Audio 표준화 동향을 소개한다. 이 표준은 5G/6G와 같은 초연결 환경에서 킬러 어플리케이션으로 기대되는 가상현실(Virtual Reality; VR) 및 증강현실(Augmemted Reality; AR)에서, 이용자가 가상환경과 상호작용을 통해 6 자유도(Degrees of freedom; DoF)로 소리를 실감나게 느끼고 실제 환경에서 경험하는 것과 같은 공간음향 체험을 제공하는 것을 목표로 한다. 이를 위하여, MPEG Audio Working Group에서는 가상현실 및 증강현실에서 공간음향 체험을 위한 시스템 구조 및 요구사항을 정의하였다. 이를 기반으로 요구사항에 대한 제안 기술 선정을 위한 오디오 평가 플랫폼(Audio evaluation platform; AEP), 인코더 입력 포맷(Encoder input format; EIF) 및 평가 절차 등에 대한 논의를 진행하고 있으며, 본 고에서는 그 주요 내용을 요약 기술한다.

Keywords

References

  1. ISO/IEC JTC1/SC29/WG11/N17685, "Proposed Draft 1.0 of TR: Technical Report on Architectures for Immersive Media", April 2018.
  2. Misuk Lee, Yongju Lee, Taejin Lee, "Audio standard for immersive media service - MPEG-H 3D Audio and MPEG-I Immersive Audio", TTA Journal, Vol. 185, pp. 26-32, October 2019. (in Korean)
  3. ISO/IEC JTC1/SC29/WG11/N18518, "MPEG-I Audio Architecture and Requirements", Jan. 2019.
  4. ISO/IEC JTC1/SC29/WG11/N19411, "Documentation for the MPEG-I Audio Evaluation Platform", July 2020.
  5. ISO/IEC JTC1/SC29/WG11/N19409, "Draft MPEG-I 6DoF Audio Encoder Input Format", July, 2020.
  6. Y.J. Lee, J. Yoo, D. Jang, M. Lee, T. Lee, "Spatial Audio Technologies for Immersive Media Service", ETRI Electronics and Telecommunications Trends, Vol. 34, pp. 14-22, June 2019. (in Korean)
  7. ISO/IEC JTC1/SC29/WG11/N19502, "Draft MPEG-I Audio Test and Evaluation Procedures", July, 2020.
  8. Recommendation ITU-R BS.1534-1, "Method for the subjective assessment of intermediate quality level of coding systems", 2001-2003.
  9. Recommendation ITU-T P.913, "Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment", March, 2016.
  10. Ulrike Sloma et.al., ISO/IEC JTC1/SC29/WG11/MPEG2020/m52368, "Thoughts on test methods for MPEG-I audio", Brussels, January 2020.
  11. Recommendation ITU-R BS.1284-2, "General methods for the subjective assessment of sound quality", January 2019.
  12. ISO/IEC JTC1/SC29/WG11/N19412, "Draft Call for Proposals for MPEG-I Immersive Audio", July, 2020.