Journal of Digital Contents Society (디지털콘텐츠학회 논문지)

Digital Contents Society (한국디지털콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Real-time 3D model generation system using multi-view images

다시점 영상을 이용한 실시간 3D 모델 생성 시스템

  • Park, Jeong-Sun (Department of KonanLink, KONAN Technology) ;
  • Son, Hyung-Jae (Department of KonanLink, KONAN Technology) ;
  • Park, Jeung-Chul (SMEs Support Section, Electronics and Telecommunications Research Institute (ETRI)) ;
  • Oh, Il-Seok (Division of Computer Science and Engineering, Chonbuk National University)
  • 박정선 (코난테크놀로지 코난링크사업부) ;
  • 손형재 (코난테크놀로지 코난링크사업부) ;
  • 박정철 (한국전자통신연구원 기업현장지원실) ;
  • 오일석 (전북대학교 컴퓨터공학부)
  • Received : 2017.03.20
  • Accepted : 2017.04.25
  • Published : 2017.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper introduces a real-time 3D model generation system that can process in real time from multi-view image acquisition to image-based 3D model generation. This system describes how to collect, transmit, and manage the HD images input from 18 cameras and explain the background separation and smooth 3D volume model generation process. This paper proposes a new distributed data transmission and reception method for real-time processing of HD images input from 18 cameras. In addition, we describe a codebook-based background separating algorithm and a modified marching cube algorithm using perspective difference interpolation to generate smooth 3D models from multi-view images. The system is currently being built with a throughput rate of 30 frames per second.

본 논문은 다시점 영상 획득에서 영상 기반 3D 모델 생성까지 실시간으로 처리가 가능한 실시간 3D 모델 생성 시스템을 소개한다. 이 시스템은 18대의 카메라에서 입력되는 HD급 영상을 수집, 전송, 관리하는 방법을 소개하며, 전경과 배경의 분리와 부드러운 3D 볼륨 모델 생성 과정을 설명한다. 이 논문은 18대의 카메라에서 입력되는 HD급 영상을 실시간으로 처리하기 위한 새로운 분산 데이터 송수신 및 관리 방법을 제안한다. 또한, 다시점 영상으로부터 부드러운 3D 모델을 생성하기 위한 시각 차이를 이용한 코드북 기반 전경과 배경 분리 알고리즘, 원근 보정 보간법을 이용한 수정된 마칭 큐브 알고리즘을 기술한다. 이 시스템은 현재 초당 30프레임 처리 속도로 구축되어 있다.

Keywords

References

  1. Y. Ohta, I. Kitahara, Y. Kameda, H. Ishikawa, and T. Koyama, "Live 3D Video in Soccer Stadium," International Journal of Computer Vision, Vol. 75, No. 1, pp. 173-187, 2007. https://doi.org/10.1007/s11263-006-0030-z
  2. A. Chapiro, S. Heinzle, et al., "Optimizing Stereo-to-Multiview Conversion for Autostereoscopic Displays," Computer graphics forum, Vol. 33, No. 2, pp. 63-72, May 2014. https://doi.org/10.1111/cgf.12291
  3. Cheon Lee, Yo-Sung Ho, "Depth-tuned Intermediate View Generation for Comfortable 3D Video," 2012 KICS, Vol. 6, pp. 349-350, 2012.
  4. Lang, Manuel., et al., "Nonlinear Disparity Mapping for Stereoscopic 3D," ACM Transactions on Graphics (TOG), Vol. 29, Issue 4, Article No. 75, July 2010
  5. C.Kim, A. Hornung, S. Heinzle, et al., "Multi-Perspective Stereoscopy from Light Fields," Proceeding SA '11 Proceedings of the 2011 SIGGRAPH Asia Conference, Vol. 30, Issue 6, Article No. 190, December 2011.
  6. D. E. C. P. R. Fergus, "Depth map prediction from a single image using a multi-scale deep network," NIPS'14 Proceedings of the 27th International Conference on Neural Information Processing Systems, pp. 2366-2374, 2014.
  7. P. Gargallo, P. Sturm, "Bayesian 3D modeling from images using multiple depth maps," CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 885-891, 2005.
  8. Jae-young Jung, "Codebook-Based Foreground Extraction Algorithm with Continuous Learning of Background," Journal of Digital Contents Society, Vol. 15, No. 4, pp. 449-455, 2014. https://doi.org/10.9728/dcs.2014.15.4.449
  9. Malvar, Henrique S., Li-wei He, and Ross Cutler, "High-quality linear interpolation for demosaicing of Bayer-patterned color images," Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP'04). IEEE International Conference on., Vol. 3, pp. 482-485, 2004.
  10. K. Kim, et al., "Background Modeling and Subtraction by Codebook Construction," Image Processing, 2004. ICIP'04. 2004 International Conference on., Vol. 5, pp. 3061-3064, 2004.
  11. W. Matusik, C. Buehler, R. Raskar, et al., "Image-based visual hulls," SIGGRAPH '00 Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pp. 369-374, 2000.

Cited by

  1. Image data process for reflector 3D modeling vol.20, pp.11, 2017, https://doi.org/10.9728/dcs.2019.20.11.2263