Journal of Korea Game Society (한국게임학회 논문지)

Korea Game Society (한국게임학회)
권호 표지
DOI QR코드

DOI QR Code

EKF SLAM-based Camera Tracking Method by Establishing the Reference Planes

기준 평면의 설정에 의한 확장 칼만 필터 SLAM 기반 카메라 추적 방법

  • Nam, Bo-Dam (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University) ;
  • Hong, Hyun-Ki (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University)
  • 남보담 (중앙대학교 첨단영상대학원 영상학과) ;
  • 홍현기 (중앙대학교 첨단영상대학원 영상학과)
  • Received : 2012.03.28
  • Accepted : 2012.04.10
  • Published : 2012.06.20
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a novel EKF(Extended Kalman Filter) based SLAM(Simultaneous Localization And Mapping) system for stable camera tracking and re-localization. The obtained 3D points by SLAM are triangulated using Delaunay triangulation to establish a reference plane, and features are described by BRISK(Binary Robust Invariant Scalable Keypoints). The proposed method estimates the camera parameters from the homography of the reference plane when the tracking errors of EKF SLAM are much accumulated. Using the robust descriptors over sequence enables us to re-localize the camera position for matching over sequence even though the camera is moved abruptly.

본 논문에서는 시퀀스 상에서 확장 칼만필터(Extended Kalman Filter) 기반의 SLAM(Simultaneous Localization And Mapping) 시스템의 안정적인 카메라 추적과 재위치(re-localization) 방법이 제안된다. SLAM으로 얻어진 3차원 특징점에 들로네(Delaunay) 삼각화를 적용하여 기준(reference) 평면을 설정하며, 평면상에 존재하는 특징점의 BRISK(Binary Robust Invariant Scalable Keypoints) 기술자(descriptor)를 생성한다. 기존 확장 칼만필터의 오차가 누적되는 경우를 판단하여 기준 평면의 호모그래피로부터 카메라 정보를 해석한다. 또한 카메라가 급격하게 이동해서 특징점 추적이 실패하면, 저장된 강건한 기술자 정보를 매칭하여 카메라의 위치를 다시 추정한다.

Keywords

References

  1. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," Proc. of ISMAR, pp. 225-234, 2007.
  2. A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, "MonoSLAM: real-time single camera SLAM," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 29, no. 6, pp. 1052-1067, 2007. https://doi.org/10.1109/TPAMI.2007.1049
  3. D. Nister, O. Naroditsky and J. Bergen, "Visual odometry," Proc. of CVPR, pp. 652-659, 2004.
  4. M. Pupilli and A. Calway, "Real-time camera tracking using a particle filter," Proc. of BMVC, pp. 519-528, 2005.
  5. L. M. Paz, P. Pinies, J. D. Tardos, and J. Neira, "Large scale 6DOF SLAM with a stereo camera in hand," IEEE Transactions on Robotics, vol. 24, no. 5, pp. 946-957, 2008. https://doi.org/10.1109/TRO.2008.2004637
  6. N. Engelhard, F. Endres, J. Hess, J. Sturm and W. Burgard, "Real-time visual odometry from dense RGB-D images," Proc. of Workshop on Live Dense Reconstruction with Moving Cameras at ICCV, 2011.
  7. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," Proc. of ISMAR, pp. 225-234, 2007.
  8. D. Chekhlov, M. Pupilli, W. Mayol-Cuevas, and A. Calway, "Real-time and robust monocular SLAM using predictive multi-resolution descriptors," Proc. of Int'l. Symposium on Visual Computing, pp. 276-285, 2006.
  9. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," IJCV, Vol. 60, No. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  10. H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "SURF: speeded up robust features," Proc. of CVIU, Vol. 110, No. 3, pp. 346-359, 2008.
  11. Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, no. 11, pp. 1330-1334, 2000. https://doi.org/10.1109/34.888718
  12. S. Leutenegger, M. Chli and R. Siegwart, "BRISK: binary robust invariant scalable keypoints," Proc. of the IEEE Int. Conf. on Computer Vision, 2011.
  13. N. Molton, A. J. Davison and I. Reid, "Locally planar patch features for real-time structure from motion", Proc. of BMVC, 2004.
  14. M. Calonder, V. Lepetit, C. Strecha, P. Fua, "BRIEF: binary robust independent elementary features," Proc. of ECCV, 2010.
  15. B. Williams, G. Klein, I. Reid, "Real-time SLAM relocalisation," IEEE Int. Conf. on Computer Vision pp. 1-8. 2007.
  16. B. Williams, P. Smith, and I. D. Reid, "Automatic relocalisation for a single-camera simultaneous localisation and mapping system," Proc. of Int'l. Conf. on Robotics and Automation, pp. 2784-2790, 2007.
  17. D. Chekhlov, A. P. Gee, A. Calway, and W. M. Cuevas, "Ninja on a plane: automatic discovery of physical planes for augmented reality using visual SLAM," Proc. of ISMAR, pp. 153-156, 2007.
  18. M. I. A. Lourakis, A. A. Argyros, and S. C. Orphanoudakis, "Detecting planes in an uncalibrated image pair," Proc. of BMVC, pp. 587-596, 2002.
  19. G. Simon, "Automatic online walls detection for immediate use in AR tasks," Proc. of ISMAR, pp. 39-42, 2006.
  20. J. Civera, O. C. Grasa, A. J. Davison, and J. M. M. Motiel, "1-Point RANSAC for EKF-based structure from motion," Proc. of Intelligent Robots and System, pp. 3498-3504, 2009.
  21. R. Hartely, and A. Zisserman, "Multiple View Geometry in Computer Vision," Cambridge University Press, Cambridge, 2003.