DOI QR코드

DOI QR Code

Stereoscopic Image Generation with Optimal Disparity using Depth Map Preprocessing and Depth Information Analysis

깊이맵의 전처리와 깊이 정보의 기하학적 분석을 통한 최적의 스테레오스코픽 영상 자동 생성 기법

  • Lee, Jae-Ho (Deft. of Information and Communications Engineering, Korea Advanced Institute of Science and Technology (KAIST) KAIST) ;
  • Kim, Chang-Ick (Deft. of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST))
  • 이재호 (한국과학기술원 정보통신공학과) ;
  • 김창익 (한국과학기술원 전기 및 전자공학과)
  • Published : 2009.03.30

Abstract

The DIBR(depth image-based rendering) method gives the sense of depth to viewers by using one color image and corresponding depth image. At this time, the qualities of the generated left- and right-image depend on the baseline distance of the virtual cameras corresponding to the view of the generated left- and right-image. In this paper, we present a novel method for enhancing the sense of depth by adjusting baseline distance of virtual cameras. Geometric analysis shows that the sense of depth is better in accordance with the increasing disparity due to the reduction of the image distortion. However, the entailed image degradation is not considered. Experimental results show that there is maximum bound in the disparity increasement due to image degradation and the visual field. Since the image degradation is reduced for increasing that bound, we add a depth map preprocessing. Since the interactive service where the disparity and view position are controlled by viewers can also be provided, the proposed method can be applied to the mobile broadcasting system such as DMB as well as 3DTV system.

DIBR(depth image-based rendering) 기법은 한 장의 칼라 영상과 그에 대응하는 깊이맵을 이용하여 수신측에서 가상의 좌우 영상을 생성하여 시청자에게 깊이감을 제공해주는 방법이다. 이 때 생성되는 좌우 영상의 화질과 깊이감은 좌우 영상의 시점에 해당하는 가상 카메라의 간격에 영향을 받게 된다. 본 논문에서는 가상 카메라의 간격 조절을 통해 양질의 깊이감을 제공하는 기법을 제안한다. 영상의 기하 분석에 따르면 스테레오스코픽 영상의 변이가 증가할수록 영상의 왜곡이 줄어들어 깊이감이 좋아지게 되나, 이 경우에는 그에 따른 영상의 열화가 고려되지 않았다. 실험결과에 따르면 영상열화나 시역형성의 제한 등으로 인해 변이의 증가폭에 제한이 있음을 알 수 있다. 변이 증가폭을 늘리기 위해서는 영상의 열화 현상을 줄여야 하므로 깊이맵의 전처리 과정을 추가하였다. 제안하는 방법은 시청자의 요구에 따라 카메라의 위치와 시점을 추가적으로 조절할 수 있게 하는 양방향 서비스를 추가로 제공하므로 3차원 TV 뿐만 아니라, DMB와 같은 이동형 방송 시스템에도 적용이 가능하다.

Keywords

References

  1. C. Fehn, P. Kauff, M. Op de Beeck, F. Ernst, W. A. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, and I. Sexton, “An Evolutionary and Optimised Approach on 3D-TV,” in Proc. of International Broadcast Conference '02, pp. 357-365, Sept. 2002
  2. Larry F. Hodges, “Basic Principles of Stereographic Software Development,” in Proc. of SPIE, Stereoscopic Displays and Applications II, vol. 1457, pp. 9-17, 1991
  3. A. Woods, T. Docherty, and R. Koch, “Image Distortions in Stereoscopic Video Systems,” in Proc. of SPIE, Stereoscopic Displays and Applications IV, vol. 1915, pp. 36-48, 1993
  4. H. Yamanoue, “The Relation between Size Distortion and Shooting Conditions for Stereoscopic Images,” SMPTE journal, vol. 106, no. 4, pp. 225-232, 1997 https://doi.org/10.5594/J00566
  5. C. Smith, “3-D or not 3-D?”, New Scientist, vol. 102#1407, pp. 40-44, 1984
  6. Y. Ho, S. Na, K. Oh, and C. Lee, “Depth Coding and Virtual View Synthesis for FTV”, ISO/IEC JTC1/SC29/WG11 M14996, October 2007
  7. H. Huang and T. Lee, “Data Adaptive Median Filters for Signal and Image Denoising Using a Generalized SURE Criterion,” IEEE Signal Processing Letters, vol. 13, no. 9, pp. 561-564, 2006 https://doi.org/10.1109/LSP.2006.874463
  8. S. Tsekeridou, C. Kotropoulos, and I. Pitas, “Morphological Signal Adaptive Filter for Noise Removal,” IEEE Conf. Eletronics, Circuits, and Systems, vol. 1, pp. 191-194, 1996
  9. N. Otsu, “A Threshold Selection Method from Gray-Level Histograms,” IEEE Trans. on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, 1979 https://doi.org/10.1109/TSMC.1979.4310076
  10. P. S. Liao, T. S. Chen, and P. C. Chung, “A Fast Algorithm for Multilevel Thresholding," Jouurnal of Information Science and Engineering 17, pp. 713-727, 2001
  11. L. Zhang and W. J. Tam, “Stereoscopic Image Generation Based on Depth Images for 3D TV,” IEEE Trans. on Broadcasting, vol. 51, no. 2, pp. 191-199, June 2005 https://doi.org/10.1109/TBC.2005.846190
  12. G.M. Um, F. Speranza, L. Zhang, W. J. Tam ,R. Renaud, L. B. Stelmach and C. H. Ahn, “Investigation of the Effect of Disparity-Based Asymmetrical Filtering on Stereoscopic Video,” in Proc. of Visual Communications and Image Processing, vol. 5150, no. 3, pp. 110-118, July 2003
  13. C. Fehn, “Depth-Image-Based Rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV,” in Proc. of SPIE, Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93-104, 2004
  14. H. Tamanoue, M. Okui and F. Okano, “Geometrical Analysis of Puppet-Theater and Cardboard Effects in Stereoscopic HDTV Images”, IEEE Trans. on CSVT, vol. 16, no. 6, pp. 744-752, June 2006 https://doi.org/10.1109/TCSVT.2006.875213
  15. I. Park, M. Kim, S. Lee, Y. Lee, J. Kwon, W. Hwang, H. Kim, J. Bae, J. Yoo, and H. Byun, “Interactive Multi-view Video and View-dependent Audio under MPEG-21 DIA,” 3DTV Conference 2007, Kos Island, Greece, pp. 7-9, May 2007
  16. T. Alpert and J. Evain, “Subjective Quality Evaluation – The SSCQE and DSCQE Methodologies,” EBU Technical Review, no. 271, 1997
  17. http://research.microsoft.com/vision/InteractiveVisualMediaGroup/3DVideoDownload/, MSR

Cited by

  1. Study on the Methods of Enhancing the Quality of DIBR-based Multiview Intermediate Images using Depth Expansion and Mesh Construction vol.19, pp.1, 2015, https://doi.org/10.6109/jkiice.2015.19.1.127