Accelerating Depth Image-Based Rendering Using GPU

GPU를 이용한 깊이 영상기반 렌더링의 가속

  • 이만희 (인하대학교 정보통신공학과) ;
  • 박인규 (인하대학교 정보통신공학부)
  • Published : 2006.10.15

Abstract

In this paper, we propose a practical method for hardware-accelerated rendering of the depth image-based representation(DIBR) of 3D graphic object using graphic processing unit(GPU). The proposed method overcomes the drawbacks of the conventional rendering, i.e. it is slow since it is hardly assisted by graphics hardware and surface lighting is static. Utilizing the new features of modem GPU and programmable shader support, we develop an efficient hardware-accelerating rendering algorithm of depth image-based 3D object. Surface rendering in response of varying illumination is performed inside the vertex shader while adaptive point splatting is performed inside the fragment shader. Experimental results show that the rendering speed increases considerably compared with the software-based rendering and the conventional OpenGL-based rendering method.

본 논문에서는 깊이 영상기반의 3차원 그래픽 객체에 대하여 그래픽 처리 장치(Graphics Processing Unit, GPU)의 가속을 이용한 고속의 렌더링 기법을 제안한다. 제안하는 알고리즘은 최근의 그래픽 처리 장치의 새로운 특징과 프로그래밍이 가능한 쉐이더 기법을 이용하여, 속도가 느리거나 정적인 조명과 같은 기존의 일반적인 깊이 영상기반 렌더링 방법이 갖고 있는 단점을 극복할 수 있다. 깊이 영상기반 데이타의 3차원 변환 및 조명에 의한 효과 연산은 정점 쉐이더(vertex shader)에서 수행을 하고, 점 데이타의 적응적인 스플래팅(splatting)은 화소 쉐이더(fragment shader)에서 수행된다. 모의 실험결과, 소프트웨어 렌더링 또는 OpenGL 기반의 렌더링과 비교해서 괄목할 만한 렌더링 속도의 향상이 이루어졌다.

Keywords

References

  1. L. McMillan and G. Bishop, 'Plenoptic modeling: An image-based rendering system,' Proc. SIGGRAPH '95, pp. 39-46, August 1995 https://doi.org/10.1145/218380.218398
  2. M. Zwicker, H. Pfister, J. Van Baar, and M. Gross, 'Surface splatting,' Proc. SIGGRAPH '01, pp. 371-378, July 2001 https://doi.org/10.1145/383259.383300
  3. Information Technology - Coding of Audio-Visual Objects - Part 16: Animation Framework eXtension (AFX), ISO/IEC Standard JTCl/SC29/WG1114496-16: 2003
  4. L. Levkovich-Maslyuk et al, 'Depth image-based representation and compression for static and animated 3D objects,' IEEE Trans. on Circuits and Systems for Video Technology, 14(7): 1032-1045, July 2004 https://doi.org/10.1109/TCSVT.2004.830676
  5. M. Oliveira, G. Bishop, and D. McAllister, 'Relief textures mapping,' Proc. SIGGRAPH '00, pp. 359-368, July 2000 https://doi.org/10.1145/344779.344947
  6. D. Wood et al, 'Surface light fields for 3D photography,' Proc. SIGGRAPH '00, pp. 359-368, July 2000 https://doi.org/10.1145/344779.344925
  7. W. Chen et al, 'Light field mapping: Efficient representation and hardware rendering of surface light fields,' ACM Trans. on Graphics, 21(3): pp. 447-456, July 2002 https://doi.org/10.1145/566654.566601
  8. M. Botsch and L. Kobbelt, 'High-quality pointbased rendering on modem GPUs,' Proc. 11th Pacific Conference on Computer Graphics and Applications, October 2003
  9. R. Pajarola, M. Sainz, and P. Guidotti, 'Confetti: Object-space point blending and splat-ting,' IEEE Trans. on Visualization and Computer Graphics, 10(5): 598-608, September/October 2004 https://doi.org/10.1109/TVCG.2004.19
  10. NVIDIA GPU Programming Guide Version 2.2.0, http://developer.nvidia.com/object/gpu-programming_guide.html
  11. J. Leech and P. Brown (editors), The OpenGL Graphics System: A Specification (Version 2.0), October 2004
  12. R. Rost, OpenGL Shading Language Second Editition, Addison Wesley, 2006
  13. C. Zitnick et al, 'High-quality video view interpolation using a layered representation,' ACM Trans. on Graphics, 23(3): 600-608, August 2004 https://doi.org/10.1145/1015706.1015766