Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Generation of ROI Enhanced High-resolution Depth Maps in Hybrid Camera System

복합형 카메라 시스템에서 관심영역이 향상된 고해상도 깊이맵 생성 방법

  • Published : 2008.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps in the hybrid camera system, which is composed of a low-resolution depth camera and a high-resolution stereoscopic camera. The proposed method creates an ROI depth map for the left image by carrying out a three-dimensional (3-D) warping operation onto the depth information obtained from the depth camera. Then, we generate a background depth map for the left image by applying a stereo matching algorithm onto the left and right images captured by the stereoscopic camera. Finally, we merge the ROI map with the background one to create the final depth map. The proposed method provides higher quality depth information on ROI than the previous methods.

본 논문은 저해상도의 깊이 카메라와 고해상도의 양안식 카메라를 결합한 복합형 카메라 시스템에서 관심영역(region of interest, ROI)이 향상된 깊이맵을 생성하는 새로운 방법을 제안한다. 제안하는 방법은 깊이 카메라로 획득한 깊이 정보를 3차원 워핑(warping)하여 좌영상의 ROI 깊이맵을 생성한다. 그런 다음, 양안식 카메라로 획득한 좌우영상의 배경 영역을 스테레오 정합하여 좌영상의 배경 깊이맵을 생성한다. 최종적으로, ROI 깊이맵과 배경 깊이맵을 결합하여 최종 깊이맵을 생성한다. 제안하는 방법으로 생성한 고해상도 깊이맵은 기존의 스테레오 정합 방법보다 ROI에 정확한 깊이 정보를 제공한다.

Keywords

References

  1. C. Fehn, "A 3D-TV System Based on Video Plus Depth Information," Proc. of Asilomar Conference on Signals, Systems and Computers, vol. 2, pp. 1529-1533, 2003
  2. D. Scharstein and R. Szeliski, "A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms," Interna- tional Jour. of Computer Visioin, vol. 47, no. 1-3, pp. 7-42, 2002 https://doi.org/10.1023/A:1014573219977
  3. M. Waschbusch, S. Wurmlin, D. Cotting, and M. Gross, "Point-sampled 3D Video of Real-world Scenes," Signal Processing Image Communication, vol. 22, no. 2, pp. 203-216, 2007 https://doi.org/10.1016/j.image.2006.11.009
  4. G.J. Iddan and G. Yahav, "3D Imaging in the Studio and Elsewhere," Proc. of SPUE Videometrics and Optical Methods for 3D Shape Measurements, pp. 48-55, 2001
  5. G. Um, K.Y. Kim, C. Ahn, and K.H. Lee, "Thee-dimensional Scene Reconstruction Using Multi-view Images and Depth Camera," Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XII, vol. 5664, pp. 271-280, 2005
  6. J. Diebel and S. Thrun, "An Application of Markov Random Fields to Range Sensing," Proc. of Advances in Neural Information Processing systems, pp. 291-298, 2005
  7. Camera calibraion toolbox program for Matlab provided by Caltech, http://www.vision.caltech.edu/bouguetj/calib_doc/
  8. Y.S. Kang, C. Lee, Y.S. Ho, "An Efficient Rectification Algorithm for Multi-view Images in Parallel Camera Array," Proc. of 3DTV Conference, pp. 61-64, 2008
  9. J.H. Cho, I.Y. Chang, S.M Kim, and K.H. Lee, "Depth Image Processing Technique for Representing Human Actors in 3DTV Using Single Depth Camera," Proc. of 3DTV conference, paper no. 15, 2007
  10. P. F. Felzenszwalb and D.P. Huttenlocher, "Efficient Belief Propa- gation for Early Vision," International Jour. of Computer Vision, vol. 70, no. 1, pp. 41-54, 2006 https://doi.org/10.1007/s11263-006-7899-4
  11. LMS-Z390i, http://www.riegl.com/