Video Augmentation of Virtual Object by Uncalibrated 3D Reconstruction from Video Frames

비디오 영상에서의 비보정 3차원 좌표 복원을 통한 가상 객체의 비디오 합성

  • 박종승 (인천대학교 컴퓨터공학과) ;
  • 성미영 (인천대학교 컴퓨터공학과)
  • Published : 2006.04.01


This paper proposes a method to insert virtual objects into a real video stream based on feature tracking and camera pose estimation from a set of single-camera video frames. To insert or modify 3D shapes to target video frames, the transformation from the 3D objects to the projection of the objects onto the video frames should be revealed. It is shown that, without a camera calibration process, the 3D reconstruction is possible using multiple images from a single camera under the fixed internal camera parameters. The proposed approach is based on the simplification of the camera matrix of intrinsic parameters and the use of projective geometry. The method is particularly useful for augmented reality applications to insert or modify models to a real video stream. The proposed method is based on a linear parameter estimation approach for the auto-calibration step and it enhances the stability and reduces the execution time. Several experimental results are presented on real-world video streams, demonstrating the usefulness of our method for the augmented reality applications.