Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A New Refinement Method for Structure from Stereo Motion

스테레오 연속 영상을 이용한 구조 복원의 정제

  • Published : 2002.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

For robot navigation and visual reconstruction, structure from motion (SFM) is an active issue in computer vision community and its properties arc also becoming well understood. In this paper, when using stereo image sequence and direct method as a tool for SFM, we present a new method for overcoming bas-relief ambiguity. We first show that the direct methods, based on optical flow constraint equation, are also intrinsically exposed to such ambiguity although they introduce robust methods. Therefore, regarding the motion and depth estimation by the robust and direct method as approximated ones. we suggest a method that refines both stereo displacement and motion displacement with sub-pixel accuracy, which is the central process f3r improving its ambiguity. Experiments with real image sequences have been executed and we show that the proposed algorithm has improved the estimation accuracy.

Keywords

References

  1. S. K. Park and I. S. Kweon, 'Robust and direct estimation of 3-D motion and scene depth from stereo image sequence,' Pattern Recognition, pp. 1713-1728, Vol. 34, No. 9, 2001 https://doi.org/10.1016/S0031-3203(00)00104-7
  2. J. Weng, N. Ahuja and T. S. Huang, 'Optimal motion and structure estimation,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 15, No. 9, pp. 864-884, 1993 https://doi.org/10.1109/34.232074
  3. R. Szeliski and S. B. Kang, 'Shape ambiguities in structure from motion,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 19, No. 5, pp. 506-512, 1997 https://doi.org/10.1109/34.589211
  4. S. Soatto and R. Brockett, 'Optimal structure from motion: Local Ambiguities and Global Estimates,' CVPR, pp. 282-288, 1998 https://doi.org/10.1109/CVPR.1998.698621
  5. M. Irani, B. Rousso and S. Peleg, ' Recovery of Ego-Motion using region alignment,' IEEE Tr. On Pattern Analysis and Machine Intelligence, Vol. 19, No. 3, pp. 268-272, 1997 https://doi.org/10.1109/34.584105
  6. A. Jepson and D. Heeger, 'Linear space method for recovering rigid motion,'Spatial Vision in Humans and Robots, Cambridge University Press, 1992
  7. G. P. Stein and A. Shahsua, 'Model-Based brightness constraints: On direct estimation of structure and motion,' IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 22, No. 9, pp. 992-1015, 2000 https://doi.org/10.1109/34.877522
  8. A. M. Tekalp, Digital Video Processing, Prentice Hall PTR, Upper Saddle River, NJ 07458, 1995
  9. T. Kanade and M. Okutomi, 'A stereo matching algorithm with an adaptive window : Theory and Experiment,' IEEE Tr. On Pattern Analysis and Machine Intelligence, Vol. 16, No. 9, pp. 920-932, 1994 https://doi.org/10.1109/34.310690
  10. H. Longuett-Higgins and P. Prazdny, 'The interpretation of a moving retinal image,' Proceedings of the Royal Society of London B, Vol. 208, pp. 385-397, 1980 https://doi.org/10.1098/rspb.1980.0057
  11. S. Park, Robust and Direct Estimation of Camera Motion and 3-D Structure from Stereo Image Sequence, PhD Thesis, KAIST, Korea, 2000
  12. Y. Tsai, 'A versatile camera calibration technique for High-Accuracy 3D machine vision metrology using Off-the-Shelf TV cameras and lenses,' IEEE Journal of Robotics and Automation, Vol. 3, No. 4, pp. 323-344, 1987 https://doi.org/10.1109/JRA.1987.1087109
  13. B. K. P. Horn, Robot Vision, The MIT Press, USA, 1986