Journal of Advanced Navigation Technology (한국항행학회논문지)

The Korean Navigation Institute (한국항행학회)
권호 표지
DOI QR코드

DOI QR Code

The Design of Spatial-Temporal Prediction Filter for saving resources on the view navigation of a panoramic video service

파노라마 영상에서 효율적인 시점탐색을 위한 시공간 비디오 스트림 예측 필터 설계 방법에 관한 연구

  • Seok, Joo-Myoung (Realistic broadcasting research Dept., Electronics and Telecommunication Research Institute(ETRI)) ;
  • Cho, Yong-Woo (Kyunghee University (KHUI))
  • Received : 2013.09.27
  • Accepted : 2013.12.30
  • Published : 2013.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

A panoramic video which supports to make viewers feel an immersion through fitting to a wide field of view (FOV) larger than the human visual angle needs an interactive viewing method such as selecting targeted view point among widely viewing points of a panoramic video because it difficult to simultaneously view a whole panoramic video due to a limited viewing environment and bandwidth. When a user officially uses a view navigation in order to select a view point, it happens waste of resources such as bandwidth owing to the transmitted video data of unnecessary view points. Therefore, this paper proposes the spatial-temporal prediction filter (STPF) which is based on the direction and velocity of the view navigation for transmitting only the necessary video data. As a result of simulation, STPF reduces bitrate saving rates by from 6% to 37% compared to conventional methods in the interactive panoramic video streaming service required high bandwidth.

사람의 시야각 이상으로 넓게 영상을 채워줌으로써 현장감을 제공하는 파노라마 영상은 넓은 해상도로 인하여 제한된 재생환경과 대역폭의 한계로 파노라마 영상의 넓은 시점을 한 번에 보기 어렵기 때문에 사용자가 시점을 선택하여 시청하는 방법이 필요로 한다. 그러나 시청시점을 선택하기 위해 빈번하게 사용하는 시점탐색 시에 재생하지 않는 시점의 영상데이터까지 전송함에 따라 발생하는 자원낭비를 최소화하기 위하여 본 논문에서는 시점탐색 시 필요한 영상데이터만 전송할 수 있도록 시점탐색 방향과 속도에 기반한 시공간예측 필터방법을 제안한다. 본 제안방법으로 높은 대역폭 사용이 불가피한 인터랙티브 파노라마 영상 스트리밍 서비스에 있어 기존 대비 6%에서 37% 정도의 대역폭 사용을 줄일 수 있다.

Keywords

References

  1. O. Scheer et al., "Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production," Proc. IEEE, vol. 101, no.1, pp. 99-114,Jan. 2013. https://doi.org/10.1109/JPROC.2012.2193850
  2. http://immersivemedia.com/
  3. http://www.airbus.com/innovation/future-by-airbus/concept-planes/the-airbus-concept-cabin/
  4. I. Kopilovic, and M. Wagner, "A benchmark for fast channel change in IPTV," in IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1-7, Apr. 2008.
  5. H. Kimata, K. Fulazawa, and N. Matsuura, "Partial delivery method with multi-bitrates and resolutions for interactive panoramic video streaming system," ICCE, 2011 IEEE Int. Conf. on, vol. 4, no. 1, pp. 891-892, Jan. 2011.
  6. M. Makar et al., "Real-time video streaming with interactive region of-interest," Image Processing (IPCP) 2010 17thIEEEint.Conf.on, pp.1558-1565, Oct. 2007.
  7. E. Kurutepe, M.R. Civanlar, and A.M. Tekalp, "Client-driven selective streaming of multi-view video for interactive 3DTV," IEEE Trans. Circuits System Video Technology, vol. 17, no. 11, pp. 1558-1565, Oct. 2007. https://doi.org/10.1109/TCSVT.2007.903664
  8. C.Y. Lee, C.K. Hong, and K.Y. Lee, "Reducing Channel Zapping Time in IPTV Based on User's Selection Behaviors," IEEE Trans. on Broadcasting, vol. 56, no. 3, Sep. 2010, pp. 321-330. https://doi.org/10.1109/TBC.2010.2051494
  9. J.M. Seok et al., "A visual perception based view navigation trick mode in the panoramic video streaming service," IEICE Trans. on Comm., vol. E94-B, no. 12, pp. 3631-3634, Dec. 2011.
  10. J. You et al., "Visual Contrast Sensitivity Guided Video Quality Assessment," ICME, 2012 IEEE Int. Conf. on, Jul. 2012, pp. 824-829.
  11. S. Daly, "Engineering observations from spatiovelocity and spatiotemporal visual models," Proc. SPIE Human Vision and Electron. Imaging, vol. 3299, pp. 180-191, Jan. 1998.
  12. R. Szeliski, "Image Alignment and Stitching: A Tutorial," Microsoft Research, Technical Report MSR-TR-2004-92, http://research.microsoft.com, Dec. 2006.
  13. http://media.xiph.org/video/derf/
  14. Drive the City Streets of NYC, "http://www.immersivemedia.com/demos/index.php"
  15. Text of ISO/IEC 14496-10:2005/FDAM 3 Scalable Video Coding, Joint Video Team (JVT) of ISO-IEC MPEG & ITU-T VCEG, Lausanne, N9197, Sep. 2007.