Broadcasting and Media Magazine (방송과미디어)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지

플렌옵틱 영상 서비스를 위한 적응적 저지연 전송 기술

  • Published : 2021.01.30
Download PDF
⟨ Previous Next ⟩

Abstract

플렌옵틱은 물리공간 내 여러 방향의 빛 정보를 한꺼번에 센서에서 획득하고, 이를 그대로 재현함으로써 사용자에게 실제와 동일한 경험을 제공한다. 플렌옵틱 영상에 대한 스트리밍 서비스를 위해서는 여러 시점에서 획득된 영상 정보를 사용자로 전달하여야 하며, 또한 사용자의 시청 시점 변화에 대해 즉각적인 시점 전환이 이루어져야 한다. 이는 단순히 전송할 정보량의 증가뿐만 아니라 거의 실시간에 가까운 초저지연의 전송 기술을 요구한다. 본 고에서는 이러한 플렌옵틱 영상 서비스를 위해 적응적 저지연 전송 기술을 적용함으로써 고려해야 할 사항들에 대해 살펴본다.

Keywords

References

  1. Z. Pan, Y. Zhang, and S. Kwong, "Efficient motion and disparity estimation optimization for low complexity multiview video coding," IEEE Trans. Broadcast., vol. 61, no. 2, pp. 166-176, Jun. 2015 https://doi.org/10.1109/TBC.2015.2419824
  2. J. Lei, S. Li, C. Zhu, M.-T. Sun, and C. Hou, "Depth coding based on depth texture motion and structure similarities," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 2, pp. 275-286, Feb. 2015 https://doi.org/10.1109/TCSVT.2014.2335471
  3. Y. Fang, G. Ding, J. Li, and Z. Fang, "Deep3DSaliency: Deep stereoscopic video saliency detection model by 3D convolutional networks," IEEE Trans. Image Process., vol. 28, no. 5, pp. 2305-2318, May 2019 https://doi.org/10.1109/tip.2018.2885229
  4. J. Lei, X. He, H. Yuan, F. Wu, N. Ling, and C. Hou, "Region adaptive R-_ model-based rate control for depth maps coding," IEEE Trans. Circuits Syst. Video Technol., vol. 28, no. 6, pp. 1390-1405, Jun. 2018 https://doi.org/10.1109/TCSVT.2017.2658024
  5. M. M. Corral, A. Dorado, H. Navarro, A. Llavador, G. Saavedra, and B. Javidi, "From the plenoptic camera to the-at integral-imaging display," Proc. SPIE, vol. 9117, Jun. 2014, Art. no. 91170H
  6. G.Wu, B. Masia, A. Jarabo,Y. Zhang, L.Wang, Q. Dai, T. Chai, andY. Liu, "Light _eld image processing: An overview," IEEE J. Sel. Topics Signal Process., vol. 11, no. 7, pp. 926-954, Oct. 2017 https://doi.org/10.1109/JSTSP.2017.2747126
  7. A. Ghasemi and M. Vetterli, "Scale-invariant representation of light field images for object recognition and tracking," Proc. SPIE, vol. 9020, pp. 15-23, Mar. 2014
  8. Steven Tielemans , "The importance of low latency in video streaming", https://www.linkedin.com/pulse/importance-lowlatency-video-streaming-steven-tielemans, 2018.10.10.
  9. Eric Kim, "라이브 비디오 서비스 구축을 위한 노하우", https://www.popit.kr/라이브-비디오-서비스-구축을-위한-노하우-2편/, 2019.01.21.
  10. TTA, "멀미 저감을 위한 머리 장착형 영상 장치 기반 가상현실 콘텐츠 제작지침", TTAK.KO-10.1030/R1, 2018.12.19.
  11. GM Cusiac, "Why SRT, HLS, and MPEG-DASH are the future of streaming", https://www.epiphan.com/blog/why-srt-hlsmpegdash-streaming/, June 30, 2020
  12. T. Hossfeld, S. Egger, R. Schatz, M. Fiedler, K. Masuch, C. Lorentzen, "Initial delay vs. interruptions: Between the devil and the deep blue sea", 2012 Fourth International Workshop on Quality of Multimedia Experience, 2012.7.5.
  13. Kara, Peter A., et al. "Evaluation of the concept of dynamic adaptive streaming of light field video." IEEE Transactions on Broadcasting vol. 64. No. 2, pp. 407-421, 2018 https://doi.org/10.1109/tbc.2018.2834736
  14. T. Ebrahimi, S. Foessel, F. Pereira, and P. Schelkens, "JPEG Pleno: Toward an efficient representation of visual reality," IEEE Multimedia, vol. 23, no. 4, pp. 1420, Oct./Dec. 2016
  15. P. T. Kovacs, A. Boev, R. Bregovic, A. Gotchev, "Quality measurements of 3D light-field displays," Eighth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), 2014
  16. Holografika. (Jun. 2017). Holovizio 80WLT Light Field Display. [Online]. Available: http://www.holografika.com/Documents/80WLTemailsize.Pdf
  17. L. D'Acunto, J. van den Berg, E. Thomas, and O. Niamut, "Using MPEG DASH SRD for zoomable and navigable video," in Proc. ACM 7th Int. Conf. Multimedia Syst., Klagenfurt, Austria, 2016, Art. no. 34
  18. A. Cserkaszky, P. A. Kara, A. Barsi, M. G. Martini, "To Interpolate or not to Interpolate: Subjective Assessment of Interpolation Performance on a Light Field Display," IEEE International Conference on Multimedia and Expo (ICME) 8th Workshop on Hot Topics in 3D Multimedia (Hot3D), 2017
  19. V. K. Adhikarla, F. Marton, T. Balogh, and E. Gobbetti, "Real-time adaptive content retargeting for live multi-view capture and light field display," Vis. Comput., vol. 31, nos. 68, pp. 1023- 1032, 2015 https://doi.org/10.1007/s00371-015-1127-6
  20. P. A. Kara et al., "The interdependence of spatial and angular resolution in the quality of experience of light field visualization," in Proc. IEEE Int. Conf. 3D Immersion (IC3D), 2017, pp.18
  21. P. A. Kara, W. Robitza, M. G. Martini, C. T. Hewage, and F. M. Felisberti, "Getting used to or growing annoyed: How perception thresholds and acceptance of frame freezing vary over time in 3D video streaming," in Proc. IEEE Int. Conf. Multimedia Workshops (ICMEW), pp.16, 2016
  22. 박재형, "Light field display 기술", 한국정보디스플레이학지, 제16권 4호, 2015, 24p-34p
  23. Nicolas Weil, Romain Bouqueau, "Ultra Low Latency with CMAF", https://parisvideotech.com/wp-content/uploads/2017/07/Bouqueau-Weil_UltraLowLatencyWithCMAF.pdf, Paris Video Tech Meetup #4, July, 2017