Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Stitcing for Panorama based on SURF and Multi-band Blending

SURF와 멀티밴드 블렌딩에 기반한 파노라마 스티칭

  • 라연 (전북대학교 컴퓨터공학) ;
  • 신성식 (전북대학교 컴퓨터공학) ;
  • 박현주 (전북대학교 컴퓨터공학부) ;
  • 권오봉 (전북대학교 컴퓨터공학부)
  • Received : 2010.10.11
  • Accepted : 2010.12.30
  • Published : 2011.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

This paper suggests a panorama image stitching system which consists of an image matching algorithm: modified SURF (Speeded Up Robust Feature) and an image blending algorithm: multi-band blending. In this paper, first, Modified SURF is described and SURF is compared with SIFT (Scale Invariant Feature Transform), which also gives the reason why modified SURF is chosen instead of SIFT. Then, multi-band blending is described, Lastly, the structure of a panorama image stitching system is suggested and evaluated by experiments, which includes stitching quality test and time cost experiment. According to the experiments, the proposed system can make the stitching seam invisible and get a perfect panorama for large image data, In addition, it is faster than the sift based stitching system.

이 논문은 이미지 매칭 알고리즘의 일종인 수정된 SURF(Speeded Up Robust Feature)와 이미지 블렌딩 알고리즘의 일종인 멀티밴드 블렌딩으로 구성된 파노라마 이미지 스티칭 시스템을 제안한다. 이 논문은 처음에 수정된 SURF를 기술하고 SIFT(Scale Invariant Feature Transform)와 비교하여 SURF를 이 시스템에서 채택한 이유에 대하여 논한다. 그리고 멀티밴드 블렌딩에 대하여 기술하고, 이어서 제안된 파노라마 이미지 스티칭 시스템의 구조에 대하여 설명하고 마지막으로 이미지 질과 처리시간에 대한 평가를 한다. 평가결과는 제안된 시스템이 개별 이미지들을 이음매 없이 연결하였으며, 많은 개개의 이미지 데이터에 대해서도 완전한 파노라마 이미지를 생성하였으며 처리 시간도 SIFT보다 빨랐다.

Keywords

References

  1. D. Lowe. "Distinctive Image Features from Scale-Invariant Keypoints," IJCV, Vol. 60, No.2, pp.910110, 2004.
  2. Y. Ke and R. Sukthankar. "PCA-SIFT: A More Distinctive Representation for Local Image Descriptors," Proc. Conf. Computer Vision and Pattern Recognition, pp. 511-517, 2004.
  3. Herbert Bay, Andreas Ess, Tinne Tuytelaars, and Luc Van Gool. "SURF: Speeded Up Robust Features," Computer Vision and Image Understanding (CVIU), Vol.110, No.3, pp.346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  4. Zhan-long Yang and bao-long Guo. "Image Mosaic Based On SIFT.," International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp.1422- 1425, 2008.
  5. M. Brown and D. Lowe. "Recognizing Panoramas," Proc. Ninth Int'l Conf. Computer Vision, pp.1218-1227, 2003.
  6. Luo Juan and Oubong Gwun. "A Comparison of SIFT, PCA-SIFT and SURF," International Journal of Image Processing (IJIP), Vol.3, No.4, 2009.
  7. K. Mikolajzyk and C. Schmid. "A Perforance Evaluation of Local Descriptors," IEEE, Trans. Pattern Analysis and Machine Intelligence, Vol.27, No.10, pp.1615-1630, October 2005. https://doi.org/10.1109/TPAMI.2005.188
  8. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L.V. Gool. "A Comparison of Affine Region Detectors," IJCV, 65(1/2), pp.43-72, 2005. https://doi.org/10.1007/s11263-005-3848-x
  9. "Interpolation and blenders," http://www.autopano.net/wiki-en/action/view/Interpolation_and_blenders.
  10. Manolis I. A. Lourakis. "A Brief Description of the Levenberg-Marquardt Algorithm Implemented by levmar," Vol.11, Feb., 2005.
  11. P. J. Burt and E. H. Adelson. "A multiresolution spline with application to image mosaics.," ACM Trans. On Graphics, Vol.2, No.4, 1983.
  12. W. Zhang and J. Kosecka. "Generalized ransac framework for relaxed correspondence prob lems," In International Symposium on 3D Data Processing, Visualization and Transmission, 2006.
  13. M. Brown and D. Lowe. "Automatic Panoramic Image Stitching using Invariant Features," International Journal of Computer Vision, Vol.74, No.1, pp.59-73, 2007. https://doi.org/10.1007/s11263-006-0002-3
  14. "Demo Software", SIFT Keypoint Detection, http://people.cs.ubc.ca/-lowe/keypoints
  15. "A c/c++ library for robust, non linear homog raphy estimation," http://www.ics.forth.gr/-lourakis/levmar/.
  16. N. Mueller and T. Q. "NguyenImage. inter polation using classification and stitching," ICIP08, pp.901-904.
  17. "Image dataset," ftp://210.117.178.61/stitching image test dataset.
  18. Eung-kon Kim and Gyoung-nam Park, "Design and Implementation of a Web-based 3D Virtual Gallery using Panorama Images," 멀티미디어학회 논문지 제5권 제6호, pp.655-664 2002.

Cited by

  1. An X-ray Image Panorama System Using Robust Feature Matching and Per ception-Based Image Enhancement vol.15, pp.5, 2012, https://doi.org/10.9717/kmms.2012.15.5.569
  2. High Resolution 360 degree Video Generation System using Multiple Cameras vol.19, pp.8, 2016, https://doi.org/10.9717/kmms.2016.19.8.1329
  3. Improvement Method of Tracking Speed for Color Object using Kalman Filter and SURF vol.15, pp.3, 2012, https://doi.org/10.9717/kmms.2012.15.3.336
  4. Multi-scale 3D Panor ama Content Augmented System using Depth-map vol.17, pp.6, 2014, https://doi.org/10.9717/kmms.2014.17.6.733