Journal of KIISE:Computer Systems and Theory (한국정보과학회논문지:시스템및이론)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

View Morphing for Generation of In-between Scenes from Un-calibrated Images

비보정 (un-calibrated) 영상으로부터 중간영상 생성을 위한 뷰 몰핑

  • Published : 2005.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

Image morphing to generate 2D transitions between images may be difficult even to express simple 3D transformations. In addition, previous view morphing method requires control points for postwarping, and is much affected by self- occlusion. This paper presents a new morphing algorithm that can generate automatically in-between scenes from un-calibrated images. Our algorithm rectifies input images based on the fundamental matrix, which is followed by linear interpolation with bilinear disparity map. In final, we generate in-between views by inverse mapping of homography between the rectified images. The proposed method nay be applied to photographs and drawings, because neither knowledge of 3D shape nor camera calibration, which is complex process generally, is required. The generated in-between views can be used in various application areas such as simulation system of virtual environment and image communication.

영상들 간의 2차원 변환을 표현하는 영상 몰핑(morphing)기술은 대상 물체의 위치나 카메라 시점 변화를 반영하지 않기 때문에 부자연스러운 왜곡현상이 발생한다. 또한 기존의 뷰(view) 몰핑 방법은 사후 워핑(postwarping)을 위한 제어점이 필요하고 영상 내 가려짐 등에 대한 제약이 존재한다. 본 논문에서는 비보정(un-calibrated)된 카메라로부터 취득된 두 영상을 이용하여 임의 중간(in-between) 시점에서의 영상을 자동으로 생성하는 새로운 몰핑 알고리즘이 제안된다. 제안된 방법은 두 영상의 기본행렬(fundamental matrix)을 구하여 영상을 교정(rectification)한 다음, 양방향 시차맵(disparity map)을 이용해 선형 보간(linear interpolation)한다. 그리고 대상 영상과 교정된 영상간의 변환행렬(homography)을 역투영(inverse projection)하여 중간영상들을 생성하였다. 제안된 방법은 카메라의 복잡한 보정(calibration)과정과 대상 장면에 대한 3차원 정보가 필요 없기 때문에 사진이나 그림 등에 효과적으로 적용될 수 있다. 다양한 영상에 대한 실험결과로부터 제안된 방법의 성능을 확인하였으며, 생성된 중간영상은 가상 시스템의 시뮬레이션 환경 및 영상통신 등의 분야에 활용될 수 있다.

Keywords

References

  1. S. E. Chen, 'Quicktime VR-An image-based approach to virtual environment navigation,' Proc. SIGGRAPH, pp. 29-38, 1995 https://doi.org/10.1145/218380.218395
  2. S. M. Seitz and Charles R. Dye, 'View morphing,' Proc. SIGGRAPH. pp. 21-30, 1996 https://doi.org/10.1145/237170.237196
  3. N. L. Chang and A. Zakhor, 'View generation for three-dimensional scenes from video sequences,' IEEE Transactions on Image Processing, vol. 6, no. 4, pp. 584-598, 1997 https://doi.org/10.1109/83.563323
  4. D. Scharstein, 'Stereo vision for view synthesis,' Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 852-858, 1996 https://doi.org/10.1109/CVPR.1996.517171
  5. X. Sun and E. Dubois, 'A method for the synthesis of intermediate views in image-based rendering using image rectification,' Proc. of the Canadian Conference on Electrical & Computer Engineering, pp. 991-994, 2002 https://doi.org/10.1109/CCECE.2002.1013078
  6. R. A. Manning and C. R. Dyer, 'Interpolating view and scene motion by dynamic view morphing,' Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 125-131, 1999 https://doi.org/10.1109/CVPR.1999.786968
  7. T. Kanade and P. Tander, 'Virtualized reality: constructing virtual worlds from real scenes,' IEEE Multimedia, vol. 4, pp. 34-47, 1997 https://doi.org/10.1109/93.580394
  8. H. Huang, S. Nain, Y. Hung, and T. Cheng, 'Disparity-based view morphing - a new techniques for image-based rendering,' Proc. SIGGRAPH. pp. 9-16, 1998 https://doi.org/10.1145/293701.293703
  9. S. E. Chen and L. Williams, 'View interpolation for image synthesis,' Proc. SIGGRAPH, pp. 279-288, 1993 https://doi.org/10.1145/166117.166153
  10. W. R. Mark, L. McMillan, and G. Bishop, 'Post-rendering 3D warping,' Proc. Symposium on Interactive 3D Graphics, pp. 7-16, 1997 https://doi.org/10.1145/253284.253292
  11. R. Hartley, 'In defense of the eight-point algorithm,' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, pp. 580-593, 1997 https://doi.org/10.1109/34.601246
  12. Z. Zhang, 'Computing rectifying homographies for stereo vision,' Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 125-131, 1999 https://doi.org/10.1109/CVPR.1999.786928
  13. C. J. Tasi and A. K. Katsaggelos, ' Dense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique,' IEEE, Trans. Multimedia, Vol.1, No.1, pp.18-29, March, 1999 https://doi.org/10.1109/6046.748168
  14. S. S. Intille and A. F. Bobick, 'Disparity-space images and large occlusion stereo,' 2nd European Conference on Computer Vision, pp. 179-186, 1994
  15. 김대현, 최종수, '양방향 시차 몰핑을 이용한 중간 시점 영상 보간', 대한전자공학회 논문지, pp. 215-223, 제 35권 SP편 제 2호, 2002년 3월
  16. Open Source Computer Vision Library Referece Manual, Intel Co., Dec. 2000