전자통신동향분석 (Electronics and Telecommunications Trends)

한국전자통신연구원 (Electronics and Telecommunications Research Institute)
권호 표지

RGB-D 카메라 기반 실시간 3차원 복원기술 동향

Recent Trends of Real-time 3D Reconstruction Technology using RGB-D Cameras

  • 발행 : 2016.08.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

실 환경에 존재하는 모든 것을 3차원 모델로 쉽게 복원할 수 있을 것이라는 생각과 원격지에 있는 환경과 사람을 같은 공간에 있는 듯 상호작용할 수 있게 된 것은 그리 오래되지 않았다. 이는 일정 해상도를 보장해주는 RGB-D 센서의 개발과 이러한 센서들을 사용한 3차원 복원 관련 연구들이 활발히 수행되면서 가능하게 되었다. 본고에서는 널리 쓰이고 있는 RGB-D 카메라를 사용하여 실시간으로 때로는 온라인상에서 3차원으로 복원하고 가시화하는 기술에 대하여 살펴보고자 한다. 하나 또는 여러 개의 RGB_D 카메라를 사용하거나 모바일 장치에 장착된 RGB-D 센서를 사용하여 넓은 공간, 움직이는 사람, 온라인 상태의 환경 등을 실시간으로 복원하기 위한 기술들을 세부적으로 설명한다. 또한, 최근에 발표된 기술들이 다루고 있는 이슈들을 설명하고 향후 3차원 복원기술의 연구개발 방향에 대해서 논의한다.

키워드

참고문헌

  1. S. Izadi et al., "KinectFusion: Real-Time Dynamic 3D Surface Reconstruction and Interaction," Procceding ACM SIGGRAPH Talks, Article no. 23, 2011.
  2. F. Endres et al., "An Evaluation of the RGB-D SLAM System," Proc. IEEE Int. Conf. Robotics and Automation (ICRA), St. Paul, MA, USA, May 2012, pp. 1691-1696.
  3. T. Whelan et al., "Robust Real-Time Visual Odometry for Dense RGB-D Mapping," IEEE Inter. Conf. Robotics and Automation (ICRA), May 2013, pp. 5724-5731.
  4. An open source implementation of KinectFusion, http://pointclouds.org/news/2011/12/08/kinectfusion-opensource/
  5. T. Whelan et al., "Kintinuous: Spatially Extended Kinect-Fusion," In Workshop on RGB-D: Advanced Reasoning with Depth Cameras, in conjunction with Robotics: Science and Systems, 2012.
  6. P. Henry et al., "Patch Volumes: Segmentation-based Consistent Mapping with RGBD Cameras," International Conference on 3D Vision (3DV), June 2013, pp. 1550-6185.
  7. R. Newcomne, D. Fox, and S.M. Seitz, "DynamicFusion: Reconstruction and Tracking of Non-rigid Scenes in Real-Time," CVPR, 2015.
  8. M. Zollhofer et al., "Real-time Non-rigid Reconstruction Using an RGB-D Camera," ACM Transactions on Graphics(TOG), vol. 33, no. 4, July 2014.
  9. G. Ye et al., "Performance Capture of Interacting Characters with Handheld Kinects," Computer Vision-ECCV, LNCS, vol. 7573, 2012, pp. 828-841.
  10. P. Henry et al., "RGB-D Mapping: Using Kinect-style Depth Cameras for Dense 3D Modeling of Indoor Environments," International Journal of Robotics Research, vol. 31, 2012, pp. 647-663. https://doi.org/10.1177/0278364911434148
  11. D. Gallup et al., "3D Reconstruction Using an n-Layer Heightmap," DAGM, LNCS, vol. 6376, 2010, pp. 1-10.
  12. M. Zeng et al., "Octree-based Fusion for Realtime 3D Reconstruction," Journal Graphical Models, vol. 75, no. 3, May 2012, pp. 126-136.
  13. M. NieBner et al., "Real-time 3D Reconstruction at Scale Using Voxel Hashing," ACM Transactions on Graphics (TOG), 2013.
  14. T.K. Lee at al., "Indoor Mapping Using Planes Extracted from Noisy RGB-D Sensors," Proc. IEEE Inter. Conf. Intelligent Robots and Systems, 2012, pp. 1727-1733.
  15. N. Silberman et al., "A Contour Completion Model for Augmenting Surface Reconstructions," Computer Vision-ECCV, LNCS, vol. 8691, 2014, pp. 488-503.
  16. Y. Zhang et al., "Online Structure Analysis for Real-time Indoor Scene Reconstruction," ACM Transactions on Graphics, vol. 34, no. 159, Oct. 2015.
  17. O. Kahler et al., "Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices," Proceedings International Symposium on Mixed and Augmented Reality, vol. 22, no. 11, 2015.
  18. M. Klingensmith et al., "CHISEL: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially-Hashed Signed Distance Fields," Proceedings of Robotics: Science and Systems, July, 2015.
  19. P. Ondruska et al., "MobileFusion: Real-time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones," IEEE Transactions on Visualization and Computer Graphics, vol. 21, 2015, pp. 1251-1258. https://doi.org/10.1109/TVCG.2015.2459902
  20. A. Maimone and H. Fuchs, "Encumbrance-Free Telepresence System with Real-Time 3D Capture and Display Using Commodity Depth Cameras," In Mixed and Augmented Reality (ISMAR), 2011.
  21. A. Maimone and H. Fuchs, "A First Look at a Telepresence System with Room-Sized Real-Time 3D Capture and Large Tracked Display Wall," 21st International Conference on Artificial Reality and Telexistence (ICAT), 2011.
  22. A. Maimone and H. Fuchs, "Real-Time Volumetric 3D Capture of Room-Sized Scenes for Telepresence," 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video, Oct. 2012, pp. 1-4.
  23. D.S. Alexiadis et al., "Real-Time, Realistic Full-body 3D Reconstruction and Texture Mapping from Multiple Kinects," IVMSP Workshop, June 2013, pp. 1-4.
  24. M. Kowalski et al., "LiveScan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors," International Conference on 3D Vision, Oct. 2015, pp. 318-325.