Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Multi-View Video Processing: IVR, Graphics Composition, and Viewer

  • Kwon, Jun-Sup (Dept. of Computer and Communications Engineering Kangwon National University) ;
  • Hwang, Won-Young (Dept. of Computer and Communications Engineering Kangwon National University) ;
  • Choi, Chang-Yeol (Dept. of Computer and Communications Engineering Kangwon National University) ;
  • Chang, Eun-Young (Broadcasting System Research Group, Radio & Digital Broadcasting Division Electronics and Telecommunications Research Institute) ;
  • Hur, Nam-Ho (Broadcasting System Research Group, Radio & Digital Broadcasting Division Electronics and Telecommunications Research Institute) ;
  • Kim, Jin-Woong (Broadcasting System Research Group, Radio & Digital Broadcasting Division Electronics and Telecommunications Research Institute) ;
  • Kim, Man-Bae (Dept. of Computer and Communications Engineering Kangwon National University)
  • Published : 2007.07.29
Download PDF
⟨ Previous Next ⟩

Abstract

Multi-view video has recently gained much attraction from academic and commercial fields because it can deliver the immersive viewing of natural scenes. This paper presents multi-view video processing being composed of intermediate view reconstruction (IVR), graphics composition, and multi-view video viewer. First we generate virtual views between multi-view cameras using depth and texture images of the input videos. Then we mix graphic objects to the generated view images. The multi-view video viewer is developed to examine the reconstructed images and composite images. As well, it can provide users with some special effects of multi-view video. We present experimental results that validate our proposed method and show that graphic objects could become the inalienable part of the multi-view video.

Keywords

References

  1. A. Vetro, W. Matusik, H. Pfister, J. Xin, 'Coding approaches for end-to-end 3D TV systems,' Picture Coding Symposium, Dec. 2004
  2. Q. Zhang, W. Zhu and Y-Q Zhang, 'Resource allocation for multimedia streaming over the Internet,' IEEE Trans. on Multimedia, Vol. 3, No.3, Sep. 2001
  3. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, 'High-Quality Video View Interpolation Using a Layered Representation', SIGGRAPH04, Los Angeles, CA, USA, August 2004
  4. C. Zhang and T. Chen, 'A survey on image-based rendering - representation, sampling and compression', EURASIP Signal processing: image communication, vol. 19. no. 1, pp. 1-28, 2004
  5. L. McMillan, 'An image-based approach in three-dimensional computer graphics', Ph.D thesis, UNC, 1997
  6. P. J. Narayanan, 'Visible space models: $ 2\frac{1}{2}$-D representations for large virtual enviromnents, In ICVC99, 1999
  7. Hartley, R.I. and Zisserman, A. Multiple View Geometry in Computer Vision, Cambridge University Press, 2nd Edition, 2004
  8. W. Woo, N. Kim, and Y. Iwadate, 'Photo-realistic interactive 3D virtual environment generation using multi-view video,' In SPIE PW-EI Image and Video Communications and Processing (IVCP), Bellingham, WA, Jan. 2001, Vol. 4310, pp. 245-254
  9. http://research.rnicrosoft.com/vision/lnteractive VisualMediaGroup/ 3DVideoDownload/, Microsoft Research
  10. F. S. Hill, Jr. Computer Graphics using OpenGL, Prentice Hall, 2nd ed., 2001