Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Effective Ray-tracing based Rendering Methods for Point Cloud Data in Mobile Environments

모바일 환경에서 점 구름 데이터에 대한 효과적인 광선 추적 기반 렌더링 기법

  • Received : 2023.06.16
  • Accepted : 2023.07.05
  • Published : 2023.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

The problem of reconstructing three-dimensional models of people and objects from color and depth images captured by low-cost RGB-D cameras has long been an active research area in computer graphics. Color and depth images captured by low-cost RGB-D cameras are represented as point clouds in three-dimensional space, which correspond to discrete values in a continuous three-dimensional space and require additional surface reconstruction compared to rendering using polygonal models. In this paper, we propose an effective ray-tracing based technique for visualizing point clouds rather than polygonal models. In particular, our method shows the possibility of an effective rendering method even in mobile environment which has limited performance due to processor heat and lack of battery.

컴퓨터 그래픽스 분야에서 저가의 RGB-D 카메라로 촬영된 색상 및 깊이 영상을 이용한 사람 및 사물을 3차원 모델로 복원하는 문제는 오랫동안 이를 해결하기 위하여 다양한 연구들이 진행되어왔다. 저가의 RGB-D 카메라로 촬영된 색상 및 깊이 영상은 3차원 공간에서 점 구름 형태로 다루어지며, 이는 연속적인 3차원 공간상에 이산적인 값을 대응시키기 때문에 다면체 모델을 이용한 렌더링에 비해 추가적인 표면 재구성 과정이 필요하다. 본 논문에서는 다면체 모델이 아닌 점 구름을 시각화하기 위한 효과적인 광선 추적 기반 렌더링 기법을 제안한다. 특히 프로세서의 발열과 배터리 문제로 인한 모바일 환경에서의 제한적인 성능에서도 효과적인 렌더링 기법으로서의 가능성을 보인다.

Keywords

Acknowledgement

이 성과는 정부 (과학기술정보통신부)의 재원으로 한국연구재단의 지원을 받아 수행된 연구임 (No. NRF-2020R1A2C2011709).

References

  1. Y. Kim, W. Seo, Y. Kim, Y. Lim, J.-H. Nah, and I. Ihm, "Adaptive Undersampling for Efficient Mobile Ray Tracing," The Visual Computer, vol. 32, no. 6-8, pp. 801-811, 2016.  https://doi.org/10.1007/s00371-016-1251-y
  2. J.-H. Nah, Y.-S. Kang, K.-J. Lee, S.-J. Lee, T.-D. Han, and S.-B. Yang, "MobiRT: An implementation of OpenGL ES-based CPU-GPU hybrid ray tracer for mobile devices," In Proceedings of the ACM SIGGRAPH ASIA 2010 Sketches, 2010. 
  3. B. Adams, R. Keiser, M. Pauly, L. J. Guibas, M. Gross, and P. Dutre, "Efficient Raytracing of Deforming Point-Sampled Surfaces," Computer Graphics Forum, vol. 24, no. 3, pp. 677-684, 2005.  https://doi.org/10.1111/j.1467-8659.2005.00892.x
  4. A. Adamson and M. Alexa, "Ray tracing point set surfaces," In Proceedings of the 2003 Shape Modeling International, pp. 272-279, 2003. 
  5. A. Beddiaf and M. C. Babahenini, "An improved splat-based ray tracing for point-based objects," In Proceedings of the 2015 12th International Symposium on Programming and Systems, pp. 1-5, 2015. 
  6. S. Kashyap, R. Goradia, P. Chaudhuri, and S. Chandran, "Real time ray tracing of point-based models," In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 2010. 
  7. I. Wald and H.-P. Seidel, "Interactive ray tracing of point-based models," In Proceedings of the ACM SIGGRAPH 2005 Sketches, p. 54-es, 2005. 
  8. A. Collet, M. Chuang, P. Sweeney, D. Gillett, D. Evseev, D. Calabrese, H. Hoppe, A. Kirk, and S. Sullivan, "High-quality streamable free-viewpoint video," ACM Transactions on Graphics, vol. 34, no. 4, 2015. 
  9. M. Dou, P. Davidson, S. R. Fanello, S. Khamis, A. Kowdle, C. Rhemann, V. Tankovich, and S. Izadi, "Motion2fusion: Real-time volumetric performance capture," ACM Transactions on Graphics, vol. 36, no. 6, 2017. 
  10. M. Dou, S. Khamis, Y. Degtyarev, P. Davidson, S. R. Fanello, A. Kowdle, S. O. Escolano, C. Rhemann, D. Kim, J. Taylor, P. Kohli, V. Tankovich, and S. Izadi, "Fusion4D: real-time performance capture of challenging scenes," ACM Transactions on Graphics, vol. 35, no. 4, 2016. 
  11. K. Guo, P. Lincoln, P. Davidson, J. Busch, X. Yu, M. Whalen, G. Harvey, S. Orts-Escolano, R. Pandey, J. Dourgarian, D. Tang, A. Tkach, A. Kowdle, E. Cooper, M. Dou, S. Fanello, G. Fyffe, C. Rhemann, J. Taylor, P. Debevec, and S. Izadi, "The Relightables: Volumetric Performance Capture of Humans with Realistic Relighting," ACM Transactions on Graphics, vol. 38, no. 6, 2019. 
  12. S. Orts-Escolano, C. Rhemann, S. Fanello, W. Chang, A. Kowdle, Y. Degtyarev, D. Kim, P. L. Davidson, S. Khamis, M. Dou, V. Tankovich, C. Loop, Q. Cai, P. A. Chou, S. Mennicken, J. Valentin, V. Pradeep, S. Wang, S. B. Kang, P. Kohli, Y. Lutchyn, C. Keskin, and S. Izadi, "Holoportation: Virtual 3D Teleportation in Real-time," In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, p. 741-754, 2016. 
  13. M. Habermann, W. Xu, M. Zollh ̈ofer, G. Pons-Moll, and C. Theobalt, "LiveCap: Real-Time Human Performance Capture From Monocular Video," ACM Transactions on Graphics, vol. 38, no. 2, 2019. 
  14. M. Habermann, W. Xu, M. Zollhofer, G. Pons-Moll, and C. Theobalt, "DeepCap: Monocular Human Performance Capture Using Weak Supervision," In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020. 
  15. H. Li, B. Adams, L. J. Guibas, and M. Pauly, "Robust Single-View Geometry and Motion Reconstruction," ACM Transactions on Graphics, vol. 28, no. 5, p. 1-10, 2009.  https://doi.org/10.1145/1618452.1618521
  16. M. Zollhofer, M. Niessner, S. Izadi, C. Rehmann, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, C. Theobalt, and M. Stamminger, "Real-Time Non-Rigid Reconstruction Using an RGB-D Camera," ACM Transactions on Graphics, vol. 33, no. 4, 2014. 
  17. T. Yu, Z. Zheng, K. Guo, P. Liu, Q. Dai, and Y. Liu, "Function4D: Real-Time Human Volumetric Capture From Very Sparse Consumer RGBD Sensors," In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5746-5756, 2021. 
  18. M. Tolgyessy, M. Dekan, Chovanec, and P. Hubinsky, "Evaluation of the Azure Kinect and Its Comparison to Kinect V1 and Kinect V2," Sensors, vol. 21, no. 2, 2021. 
  19. S. Garrido-Jurado, R. Munoz-Salinas, F. Madrid-Cuevas, and M. Marin-Jimenez, "Automatic generation and detection of highly reliable fiducial markers under occlusion," Pattern Recognition, vol. 47, no. 6, pp. 2280-2292, 2014.  https://doi.org/10.1016/j.patcog.2014.01.005
  20. D. P. Mitchell, "Generating Antialiased Images at Low Sampling Densities," In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, p. 65-72, 1987. 
  21. A. Williams, S. Barrus, R. K. Morley, and P. Shirley, "An Efficient and Robust Ray-Box Intersection Algorithm," In Proceedings of the ACM SIGGRAPH 2005 Courses, p. 9-es, 2005.