Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Hybrid Stereoscopic Camera System

이종 카메라를 이용한 스테레오 카메라 시스템

  • Shin, Hyoung-Chul (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kim, Sang-Hoon (Department of Broadcasting and Video, Cheju Halla College) ;
  • Sohn, Kwang-Hoon (School of Electrical and Electronic Engineering, Yonsei University)
  • 신형철 (연세대학교 전기전자공학부) ;
  • 김상훈 (제주한라대학 방송영상과) ;
  • 손광훈 (연세대학교 전기전자공학부)
  • Received : 2011.03.16
  • Accepted : 2011.06.17
  • Published : 2011.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a hybrid stereoscopic camera system which acquires and utilizes stereoscopic images from two different camera modules, the main-camera module and the sub-camera module. Hybrid stereoscopic camera can effectively reduce the price and the size of a stereoscopic camera by using a relatively small and cheap sub-camera module such as a mobile phone camera. Images from the two different camera modules are very different from each other in aspects of color, angle of view, scale, resolution and so on. The proposed system performs an efficient hybrid stereoscopic image registration algorithm that transforms hybrid stereoscopic images into normal stereoscopic images based-on camera geometry. As experimental results, the registered stereoscopic images and applications of the proposed system are shown to demonstrate the performance and the functionality of the proposed camera system.

본 논문에서는 단안 디지털 카메라(주 카메라)에 크기와 성능이 다른 이종의 보조 카메라 모듈을 추가하여 스테레오 영상을 획득하고 활용하는 이종 스테레오 카메라 시스템을 제안한다. 이종 스테레오 카메라는 보조 카메라로 휴대폰 카메라와 같이 상대적으로 크기가 작고 저가인 카메라를 사용함으로써 스테레오 카메라의 제작 단가를 낮추고 크기를 줄일 수 있는 장점이 있다. 그러나 주 카메라와 보조 카메라 모듈로부터 획득한 이종 스테레오 영상은 영상의 화각, 해상도 등이 서로 다르기 때문에 이종 스테레오 영상을 스테레오영상으로 변환하는 과정이 필요하다. 제안한 시스템은 이종 스테레오 카메라의 기하학적 분석을 통해 이종 스테레오 영상을 일반 스테레오 영상으로 변환하는 이종 스테레오 영상 정합 알고리즘을 수행한다. 실험 결과로 정합을 통하여 얻은 스테레오 영상의 품질을 분석하고 응용 기술을 제시함으로써 제안 시스템의 성능과 활용성을 평가한다.

Keywords

References

  1. http://www.fujifilm.com/products/3d/camera/
  2. http://www.panasonic.net/avc/lumix/systemcamera/gms/lens/g_3dlens.html
  3. http://panasonic.net/avc/camcorder/
  4. T. Chen, P. Catrysse, A. El Gamal, and B. Wandell, "How small should pixel size be?,"Proc. SPIE, vol. 3965, pp. 451-461, Jan. 2000. https://doi.org/10.1117/12.385463
  5. H. S. Sawhney, Y. Guo, K. Hanna, R. Kumar, S. Adkins, and S. Zhou, "Hybrid stereo camera: an ibr approach for synthesis of very high resolution stereoscopic image sequences,"Proc. SIGGRAPH 2001: ACM Transactions on Graphics, pp 451-460, 2001.
  6. F. Li, J. Yu, and J. Chai, "A Hybrid Camera for Motion Deblurring and Depth Map Super-Resolution," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp 1-8, 2008. https://doi.org/10.1109/CVPR.2008.4587574
  7. J. Kopf, M. F. Cohen, D. Lischinski and M. Uyttendaele, "Joint bilateral upsampling," ACM Trans. Graphics, vol. 26, no. 3, article. 96, July 2007. https://doi.org/10.1145/1276377.1276497
  8. S. Schuon, C. Theobalt, J. Davis and S. Thrun, "High-quality scanning using time-of-flight depth superresolution," Proc. IEEE Conf. Comp. Vision and Pattern Recogn. Workshops, June 2008. https://doi.org/10.1109/CVPRW.2008.4563171
  9. S. Borman and R. L. Stevenson, "Super-resolution from image sequences-a review," Proc. Midwest Symp. Circuits and Systems, vol. 5, pp. 374-378, April 1998.
  10. L. Wang, M. Liao, M. Gong, R. Yang and D. Nister, "High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming,"Proc. Int. Symp. 3D Data Proc., Vis. and Transm., pp. 798-805, 2006.
  11. J. Choi, D. Min and K. Sohn, "2D-plus-Depth based Resolution and Frame-rate Up-conversion Technique for Depth Video," IEEE Trans. on Consumer Electronics, Vol 56, Issue 4, pp. 2489-2497, Nov. 2010. https://doi.org/10.1109/TCE.2010.5681132
  12. R. Hartley and A. Zisserman, Multiple View Geometry. Cambridge, U.K.: Cambridge Univ. Press, 2000.
  13. R. Y. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robot. Automat., vol. RA-3, pp. 323 - 344, 1987. https://doi.org/10.1109/JRA.1987.1087109
  14. Y. I. Abdel-Aziz and H. M. Karara, "Direct linear transformation from comparator coordinates into object space coordinates in close-range photogrammetry," Proc. ASP/UI Symp. Close-Range Photogrammetry, pp. 1 - 18, 1971.
  15. H. Hatze,"High-precision three-dimensional photogrammetric calibration and object space reconstruction using a modified DLT approach," J. Biomechanics, vol. 21, pp. 533 - 538, 1988. https://doi.org/10.1016/0021-9290(88)90216-3
  16. 김대현, 신형철, 오주현, 남승진, 손광훈, "비선형 줌-렌즈 왜곡 모델을 이용한 렌즈 왜곡 보정에 관한 연구", 한국방송공학회논문지, 14권 제3호, pp 299-310, 2009년 5월. https://doi.org/10.5909/JBE.2009.14.3.299
  17. R.G.Willson and S.A.Shafer, "What is the Center of the Image?," Journal of the Optical Society of America A,Vol.11, no.11, pp. 2946-2955, Nov. 1994. https://doi.org/10.1364/JOSAA.11.002946
  18. A. Mancini, "Disparity estimation and intermediate view reconstruction for noble applications in stereoscopic video," Master Thesis, McGill University, February 1998.
  19. S. Park, J. Moon and N. Lee, "Automatic vergence and focus control of a microstereoscopic camera," J. Electron. Imaging, vol 18, 023006, May 2009. https://doi.org/10.1117/1.3126384
  20. F. Kooi and A. Toet, "Visual comfort of binocular and 3d displays," Displays 25, pp.99-108, 2004. https://doi.org/10.1016/j.displa.2004.07.004
  21. 3DC Safty Guidelines for Popularization of Human-friendly 3D," 3D Consortium, 2006.
  22. G. Zhang, Z. Dong, J. Jia, L. Wan, T.-T. Wong, and H. Bao., "Refilming with depth-inferred videos," IEEE Trans. on Visu. and Comp. Graph., 2009. https://doi.org/10.1109/TVCG.2009.47
  23. A. Fusiello, E. Trucco and A. Verri. "A compact algorithm for rectification of stereo pairs," Machine Vision and Applications, Vol. 12, No. 1, pp. 16-22, July 2000. https://doi.org/10.1007/s001380050120
  24. H. Kim, Y. Choe and K. Sohn, "Disparity estimation using region-dividing technique with energy-based regularization," Optical Engineering, vol. 43, no. 8, pp 1882-1890, Aug. 2004. https://doi.org/10.1117/1.1766299

Cited by

  1. A Calibration Method for Multimodal dual Camera Environment vol.19, pp.9, 2015, https://doi.org/10.6109/jkiice.2015.19.9.2138