Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient image-stitching using preprocessing for a super resolution image

전처리를 활용한 고해상도 영상을 위한 효율적인 영상 스티칭

  • Bae, JoungEun (Department of Media Software, Sangmyung University) ;
  • Yoo, Hoon (Department of Media Software, Sangmyung University)
  • Received : 2016.10.17
  • Accepted : 2016.11.07
  • Published : 2017.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents an efficient image stitching method using preprocessing in order to generate a super resolution image. Two-dimensional (2D) scanners are consistently used in various areas but they have limitations such as paper sizes and materials. To overcome these problem with low-cost, an efficient imaging stitching method is proposed for producing a super resolution panorama image. To scan a very large sized paper using mobile phones, a simple portable cradle which fixes height is employed producing an input image set. To improve matching performance, a preprocessing method is introduced before searching correspondences. Then alpha blending is applied to an input image set to produce a super resolution panorama image. The proposed method is faster and easier than the existing method which is employed by Open CV. Experiment results show that the proposed method is three times faster and performs better than the existing method.

본 논문은 전처리를 이용하여 고해상도 영상을 얻어내는 효율적인 이미지 스티칭 기술을 제안한다. 2D스캐너는 문서처리를 위해 다양한 분야에서 꾸준히 사용되고 있으나 용지 크기 및 재질의 제한을 가지고 있다. 이런 한계를 저가 시스템으로 극복하기 위해서, 본 논문에서는 고해상도의 파노라마 영상을 생성하기 위한 효율적인 영상 스티칭 방법을 제안한다. 크기가 큰 문서를 모바일폰을 이용하여 스캔하기위해서, 촬영 높이를 고정해줄 간단한 휴대형 거치대를 이용하여 입력 영상 집합을 준비한다. 영상 정합 성능을 개선하기 위해서 전처리를 적용한 후, 연결 포인트를 검색한다. 알파 블렌딩으로 고해상도의 파노라마 이미지를 생성한다. 제안하는 기술은 기존 기술인 Open CV가 제공하는 영상 스티칭 기술보다 빠르고 간편하게 결과 영상을 제공한다. 실험 결과는 제안하는 기술이 기존 방법보다 약 3배 빠르며 성능 또한 더 우수함을 보여준다.

Keywords

References

  1. R. Szeliski, "Image alignment and stitching: A tutorial," Technical Report MSR-TR-2004-92, Microsoft Research, Dec. 2004.
  2. R. Szeliski, and S.Kang, "Direct methods for visual scene reconstruction," IEEE Workshop on Representations of Visual Scenes, Cambridge, MA, pp. 26-33, 1995
  3. A. Zisserman, and R. Szeliski, "Vision algorithms: Theory and practice," LNCS 1883, pp.267-277, Springer-Verlag, Corfu, Greece, Sept. 1999.
  4. H. Sawhney and R. Kumar, "True multi-image alignment and its application to mosaicing and lens distortion correction," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 3, pp.235-243, Mar. 1999. https://doi.org/10.1109/34.754589
  5. H. Shum and R. Szeliski, "Construction of panoramic mosaics with global and local alignment," International Journal of Computer Vision, vol. 36, no. 2, pp.101-130, Feb. 2000. https://doi.org/10.1023/A:1008195814169
  6. D. Capel and A. Zisserman, "Automated mosaicing with super-resolution zoom," Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR98),Santa Barbara, CA, pp. 885-891, 1998.
  7. P. McLauchlan and A. Jaenicke, "Image mosaicing using sequential bundle adjustment," Image and Vision Computing, vol. 20, no.9-10, pp.751-759, Aug. 2002. https://doi.org/10.1016/S0262-8856(02)00064-1
  8. M. Brown and D. G. Lowe "Automatic panoramic image stitching using invariant features," International Journal of Computer Vision, vol.74, no.1, pp.59-73, Aug. 2007. https://doi.org/10.1007/s11263-006-0002-3
  9. Y. H. Zhang, X. Jin, and Z. J. Wang, "A new modified panoramic UAV image stitching model based on the GA-SIFT and adaptive threshold method," Springer Memetic Computing, vol.9, no.3, pp.231-244, Sep. 2017. https://doi.org/10.1007/s12293-016-0219-9
  10. F. B. Wang, B. Fu, C. Wu, L. Chen, and D. Feng, "Multi-image mosaic with SIFT and vision measurement for microscale structures processed by femtosecond laser," Elsevier Optics and Lasers in Engineering, vol.100, pp.124-130, Jan. 2018. https://doi.org/10.1016/j.optlaseng.2017.08.004
  11. H. Yoo, "Axially moving a lenslet array for high-resolution 3D images in computational integral imaging," OSA Optics Express, vol. 21, no. 7, pp. 8876-8887, 3 Apr. 2013.
  12. Y. Lee and H. Yoo, "Adaptive thresholding for twodimensional barcode images using two thresholds and the integral image," Journal of the Korea Institute of Information and Communication Engineering, vol.16, no.11, pp.2453-2458, Nov. 2012. https://doi.org/10.6109/jkiice.2012.16.11.2453
  13. K. Lee, H. Yoo, "Fast 3D mesh generation using projection for line laser-based 3D Scanners," Journal of the Korea Institute of Information and Communication Engineering, vol.20, no.3, pp.513-518, Mar. 2016. https://doi.org/10.6109/jkiice.2016.20.3.513
  14. Realviz [Internet]. Available: http://www.realviz.com.
  15. Microsoft Digital Image Pro. [Internet]. Available: http://www.microsoft.com/products/imaging.
  16. K. Lin, S. Liu, L.-F. Cheong. and B. Zeng, "Seamless video stitching from hand-held camera inputs," Computer Graphics Forum. vol. 35, no. 2, pp. 479-487, May 2016. https://doi.org/10.1111/cgf.12848