Journal of Internet Computing and Services (인터넷정보학회논문지)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지

Performance improvement for Streaming of High Capacity Panoramic Video

대용량 파노라마 비디오 스트리밍의 성능개선

  • 김영백 (대구가톨릭대학교) ;
  • 김태호 (대구대학교 정보통신공학부) ;
  • 이대규 (대구대학교 정보통신공학부) ;
  • 김재준 (대구대학교 정보통신공학부)
  • Received : 2009.11.26
  • Accepted : 2010.02.16
  • Published : 2010.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

When providing high quality panoramic video across the Internet, mobile communications, and broadcasting areas, it requires a suitable video codec that satisfies both high-compression efficiency and random access functionality. The users must have high-compression efficiency in order to enable video streaming of high-volume panoramic data. Random access allows the user to move the viewpoint and direction freely. In this paper, we propose the parallel processing scheme under cell units in order to improve the performance of streaming service for large screen panoramic video in 10Mbps bandwidths based on H.264/AVC with high compression rate. This improved algorithm divides a screen composed of cells less than $256{\times}256$ in size, encodes it, and decodes it with the cells in the present view. At this point, encoding/decoding is parallel processed by the present cell units. Also, since the cells only included in the present view are packed and transmitted, the possible processing of not extricating blocks is proven by experiment.

인터넷, 이동통신 및 방송분야에 걸쳐 고화질 파노라마 비디오를 제공할 경우 고압축률과 임의 접근 기능 모두를 만족하는 적절한 비디오 코덱이 요구된다. 사용자 측면에서 고압축률은 대용량 파노라마 데이터의 비디오 스트리밍을 하기 위해 반드시 필요하다. 임의 접근 기능은 시점과 방향을 사용자가 자유롭게 이동할 수 있게 해 준다. 본 논문에서는 압축 효율이 높은 H.264/AVC를 기반으로 셀 단위 병렬 처리 기법을 통해 10Mbps 대역폭에서 대화면 파노라마 영상의 스트리밍 서비스를 위한 성능 개선 방안을 제안한다. 제안된 방안은 전체 화면을 $256{\times}256$ 이하 크기의 셀로 나누어 인코딩하고 현재 뷰(view)에 포함된 셀들만 디코딩한다. 이때 인코딩/디코딩은 셀 단위로 병렬 처리한다. 또한 현재 뷰에 포함된 셀들만 전송함으로써 블록 추출 없이 임의 접근 기능이 가능함을 실험을 통해 보여준다.

Keywords

References

  1. S.E.Chen, "QuickTime VR - An Image-Based Approach to Virtual Environment Navigation", ACM SIGGRAPH, pp. 29-38, August 1995.
  2. Foote, J, Kimber, D., "FlyCam: practical panoramic video and automatic camera control", Multimedia and Expo, Vol. 3, pp.1419-1422, 2000.
  3. Nagase, Y., Yamamoto, T., Kawamura, T., Sugahara, K., "Hardware realization of panoramic camera with speaker-oriented face extraction for teleconferencing", IEEE International Symposium on Circuits and Systems, Vol. 6, pp. 6256-6259, May 2005.
  4. Kar-Han Tan, Hong Hua, Ahuja, N., "Multiview panoramic cameras using mirror pyramids", Pattern Analysis and Machine Intelligence, IEEE Transactions on, Vol. 26, Issue 7, pp. 941-946, July 2004. https://doi.org/10.1109/TPAMI.2004.33
  5. Smolic, A,. "Robust generation of 360 degree panoramic views from consumer video sequences", Video/Image Processing and Multimedia Communications 4th EURASIP-IEEE Region 8 International Symposium on VIPromCom, pp 431-435, June 2002.
  6. Tzavidas, S., Katsaggelos, A.K., "A multicamera setup for generating stereo panoramic video", Multimedia, IEEE Transactions on, Vol. 7, Issue 5, pp. 880-890, Oct. 2005 https://doi.org/10.1109/TMM.2005.854430
  7. Li-Shen Juhn,, Li-Ming Tseng., "Harmonic broadcasting for video-on-demand service", Broadcasting, IEEE Transactions on, Vol. 43, Issue 3, pp. 268-271, Sept. 1997. https://doi.org/10.1109/11.632927
  8. Grunheit C, Smolic, A, Wiegand T, "Efficient representation and interactive streaming of high-resolution panoramic views", Image Processing. 2002. Proceedings. 2002 International Conference on, Vol. 3, pp. 209-212, June 2002.
  9. King-To Ng, Shing-Chow Chan, Heung-Yeung Shum, "Data compression and transmission aspects of panoramic videos", Circuits and Systems for Video Technology, IEEE Transactions on, Vol. 15, Issue 1, pp. 82-95., Jan. 2005. https://doi.org/10.1109/TCSVT.2004.839989
  10. Hsiu-Cheng Chang, Chien-Chang Lin, Jiun-In Guo. "A novel low-cost high-performance VLSI architecture for MPEG-4 AVC/H.264 CAVLC decoding", Circuits and Systems, 2005. ISCAS 2005. IEEE International Symposium on, Vol.6, pp. 6110-6113, May 2005.
  11. Immersive Midea, http://www.immersiveme-dia.com.
  12. Hannuksela, M., "Random access using isolated regions", ICIP 2003., Vol. 3, pp. 841-844, Sep. 2003.
  13. Ghina G., Sophia K., "Multimedia Codec Evaluation and Overview", Master program in Electrical Engineering, Blekinge Institute of Technology, Jan. 2007.
  14. Jentz B., "Low-Cost Solutions for Video Compression Systems", Altera Corporation, 2005.
  15. Raja, G, Mirza, M.J, "JVT H.264/AVC: Evaluation with Existing Standards for Low Bit Rate Video Coding", Microelectronics, 2005. ICM 2005, The 17th International Conference on, pp. 301-304, Dec. 2005.
  16. Wai-Kwan Tang, Tien-Tsin Wong, Heng, P., "A System for Real-Time Panorama Generation and Display in Tele-Immersive Applications", Multimedia, IEEE Transactions on, Vol. 7, Issue 2, pp. 280-292, Apr. 2005. https://doi.org/10.1109/TMM.2005.843811
  17. P. J. Shenoy, P. Goyal, and H. M. Vin, "Issues in multimedia server design", Comput. Surv., vol. 27, no. 4, pp. 636-639, 1995. https://doi.org/10.1145/234782.234810
  18. Network Working Group, "Real time streaming protocol (RTSP)", Request for Comments 2326, Apr. 1998.
  19. Weerasinghe C., Wanqing Li, Ogunbona, P., "STEREOSCOPIC PANORAMIC VIDEO GENERATION USING CENTRO-CIRCULAR PROJECTION TECHNIQUE", Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). 2003 IEEE International Conference on, Vol.3, pp. 473-476, April 2003.
  20. Yo-Sung Ho, Seung-Hwan Kim, H.264 Recommendation Advanced Video Coding, H.264/AVC standard for source code analysis (Korean version), Dooyangsa, p. 253, Seoul, 2006.
  21. De Vito, F, De Martin, J.C, "PSNR control for GOP-level constant quality in H.264 video coding", Signal Processing and Information Technology, pp 612-617, 2005.