The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Reliable Camera Pose Estimation from a Single Frame with Applications for Virtual Object Insertion

가상 객체 합성을 위한 단일 프레임에서의 안정된 카메라 자세 추정

  • 박종승 (인천대학교 컴퓨터공학과) ;
  • 이범종 (인천대학교 컴퓨터공학과)
  • Published : 2006.10.30
Download PDF
⟨ Previous Next ⟩

Abstract

This Paper describes a fast and stable camera pose estimation method for real-time augmented reality systems. From the feature tracking results of a marker on a single frame, we estimate the camera rotation matrix and the translation vector. For the camera pose estimation, we use the shape factorization method based on the scaled orthographic Projection model. In the scaled orthographic factorization method, all feature points of an object are assumed roughly at the same distance from the camera, which means the selected reference point and the object shape affect the accuracy of the estimation. This paper proposes a flexible and stable selection method for the reference point. Based on the proposed method, we implemented a video augmentation system that inserts virtual 3D objects into the input video frames. Experimental results showed that the proposed camera pose estimation method is fast and robust relative to the previous methods and it is applicable to various augmented reality applications.

본 논문에서는 실시간 증강현실 시스템에서의 가상 객체 삽입을 위한 빠르고 안정된 카메라 자세 추정 방법을 제안한다. 단일 프레임에서 마커의 특징점 추출을 통해 카메라의 회전행렬과 이동벡터를 추정한다. 카메라 자세 추정을 위해 정사영 투영모델에서의 분해기법을 사용한다. 정사영 투영모델에서의 분해기법은 객체의 모든 특징점의 깊이좌표가 동일하다고 가정하기 때문에 깊이좌표의 기준이 되는 참조점의 설정과 점의 분포에 따라 카메라 자세 계산의 정확도가 달라진다. 본 논문에서는 실제 환경에서 일반적으로 잘 동작하고 융통성 있는 참조점 설정 방법과 이상점 제거 방법을 제안한다. 제안된 카메라 자세추정 방법에 기반하여 탐색된 마커 위치에 가상객체를 삽입하기 위한 비디오 증강 시스템을 구현하였다. 실 환경에서의 다양한 비디오에 대한 실험 결과, 제안된 카메라 자세 추정 기법은 기존의 자세추정 기법만큼 빠르고 기존의 방법보다 안정적이고 다양한 증강현실 시스템 응용에 적용될 수 있음을 보여주었다.

Keywords

References

  1. S. Gibson, J. Cook, T. Howard, R. Hubbold, and D. Oram, 'Accurate camera calibration for off-line, video-based augmented reality,' Proceedings of International Symposium on Mixed and Augmented Reality, pp.37 -46, 2002 https://doi.org/10.1109/ISMAR.2002.1115068
  2. M. Lourakis and A. Argyros, 'Camera Matchmoving in Unprepared, Unknown Environments,' Computer Vision and Pattern Recognition, p.1190, 2005 https://doi.org/10.1109/CVPR.2005.96
  3. J. Heikkila, 'Accurate camera calibration and feature based 3-D reconstruction from monocular image sequences,' Ph.D. dissertation, University of Oulu, Finland, 1997
  4. M. Lourakis and A. Argyros, 'Vision-Based Camera Motion Recovery for Augmented Reality,' Computer Graphics International, pp.569-576, 2004 https://doi.org/10.1109/CGI.2004.100
  5. Y.-K. Jung, K.-W. Lee, and Y.-S. Ho, 'Feature-Based Object Tracking with an Active Camera,' Proceedings of the Third IEEE Pacific Rim Conference on Multimedia, pp. 1137-1144, 2002
  6. G. Simon, A. Fitzgibbon, and A. Zisserman, 'Markerless tracking using planar structures in the scene,' Proceeding of IEEE and ACM International Symposium on Augmented Reality, pp.120-128, 2000 https://doi.org/10.1109/ISAR.2000.880935
  7. S. Yamamoto and S. Hirai, 'Robust and Video-frame Rate Tracking of Planar Motion by Matched Filtering on FPGA,' Proceeding of IEEE and International Conference on Robotics & Automation, pp.4707-4712, April, 2004 https://doi.org/10.1109/ROBOT.2004.1302460
  8. M. Pressigout and E. Marchand, 'Real Time Planar Structure Tracking for Visual Servoing: a Contour and Texture Approach,' IEEE Intelligent Robots and System, pp.251-256, August, 2005 https://doi.org/10.1109/IROS.2005.1545223
  9. K. Kutulakos and J. Vallino, 'Calibration-free augmented reality,' IEEE Transactions on Visualization and Computer Graphic, pp.346- 359, October, 2000 https://doi.org/10.1109/2945.895879
  10. H. Park and J.-I. Park, 'Invisible Marker Tracking for AR,' Third IEEE and ACM International Symposium on Mixed and Augmented Reality, pp.272-273, 2004 https://doi.org/10.1109/ISMAR.2004.37
  11. A. Ali and S. Afghani, 'Support Vectors a Way to Adapt for Lane Marker Tracking: A Step towards Intelligent Transportation Systems,' Proceeding of IEEE and International Conference on Emerging Technologies, pp. 151 -156, September, 2005 https://doi.org/10.1109/ICET.2005.1558871
  12. X. Zhang, S. Fronz, and N. Navab, 'Visual Marker Detection and Decoding in AR Systems: A Comparative Study,' International Symposium on Mixed and Augmented Reality, p.97, 2002 https://doi.org/10.1109/ISMAR.2002.1115078
  13. R. Carceroni and C. Brown, 'Numerical methods for model based pose recovery,' Technical Report 659, The University of Rochester, New York, 1997
  14. C. Tomasi and T. Kanade, 'Shape and motion from image streams under orthography: A factorization approach,' International Journal of Computer Vision, pp.137-154, 1992 https://doi.org/10.1007/BF00129684
  15. D. Oberkampf, D. Dementhon, and L. Davis, 'Iterative pose estimation using coplanar feature points,' Comput. Vis. Image Underst., pp.495-511, 1996 https://doi.org/10.1006/cviu.1996.0037
  16. D. Dementhon and L. Davis, 'Model-based object pose in 25 lines of code,' International Journal of Computer Vision, pp.123-141, 1995 https://doi.org/10.1007/BF01450852
  17. Z. Zhang, 'A flexible new technique for camera calibration,' IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.1330-1334, 2000 https://doi.org/10.1109/34.888718
  18. C. Poleman and T. Kanade, 'A paraperspective factori zation method for shape and motion recovery,' IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.206-218, 1997 https://doi.org/10.1109/34.584098