Journal of Korea Game Society (한국게임학회 논문지)

Korea Game Society (한국게임학회)
권호 표지
DOI QR코드

DOI QR Code

Planar Texture Replacement in Spherical Images using Cubemap

큐브맵을 사용한 구면 영상에서의 평면 텍스처 대치

  • Park, Jeong-Hyeon (Dept. of Computer Science & Engineering, Incheon National University) ;
  • Park, Jong-Seung (Dept. of Computer Science & Engineering, Incheon National University)
  • 박정현 (인천대학교 컴퓨터공학부) ;
  • 박종승 (인천대학교 컴퓨터공학부)
  • Received : 2017.11.11
  • Accepted : 2017.12.20
  • Published : 2017.12.20
Download PDF
⟨ Previous Next ⟩

Abstract

In spherical panoramic images, SURF, a feature description method for planar patterns, does not work correctly due to heavy spherical distortion. Since a plane pattern is distorted in a spherical image, the pattern search and replacement in a spherical panoramic image should be treated differently from the case of the planar image. This paper proposes a planar texture replacement method, which transforms a spherical panoramic image into a cubemap panoramic image, searches a pattern using SURF, replaces a plane pattern, and then converts it into a spherical panoramic image.

구면 파노라마 영상에서는 심한 구면 왜곡으로 인하여 기존의 평면 패턴의 탐색 방법인 SURF가 올바르게 작동되지 않는다. 평면 패턴은 구면 영상에서 왜곡되어 나타나므로 구면 파노라마 영상에서의 패턴 탐색 및 다른 텍스처로의 대치는 평면 영상의 경우와 다르게 처리되어야 한다. 본 논문에서는 구면 파노라마 영상을 큐브맵 영상으로 변환하고 구면 왜곡이 제거된 평면 영상에서 SURF를 사용하여 패턴을 탐색하고 해당 평면 텍스처를 대치한 후 다시 구면 파노라마 영상으로 변환하는 구면 파노라마 영상에서의 평면 대치 방법을 제안한다.

Keywords

References

  1. G. Fangi, C. Nardinocchi, "Photogrammetric processing of spherical panoramas", The photogrammetric record, Vol. 28, No. 143, pp. 293-311, 2013. https://doi.org/10.1111/phor.12031
  2. D.G. Lowe, "Distinctive image features from scale-invariant keypoints", International journal of computer vision, Vol. 60, No. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  3. B. Herbert, A. Ess, T. Tuytelaars, L.V. Gool, "Speeded-up robust features (SURF)", Computer vision and image understanding, Vol. 110, No. 3, pp. 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  4. B.S. Kim, J.S. Park, "Estimating Geometric Transformation of Planar Pattern in Spherical Panoramic Image", Journal of KIISE, Vol. 42, No. 10, pp. 1185-1194, 2015. https://doi.org/10.5626/JOK.2015.42.10.1185
  5. B.S. Kim, J.S. Park, "Matching between Spherical Panorama and Planar Image", Proc. Korea Computer Congress, pp. 1322-1324, 2014.
  6. D.R. Kim, J.S. Park, "Pattern Replacement in Spherical Panoramic Image Using Pattern Matching Technique", Proc. Korea Game Society Fall Conference, pp. 193-196. 2016.
  7. J. Cruz-Mota, I. Bogdanova, B. Paquier, M. Bierlaire, J.-P. Thiran, "Scale invariant feature transform on the sphere: Theory and applications", International journal of computer vision , Vol. 98, No. 2, pp. 217-241, 2012. https://doi.org/10.1007/s11263-011-0505-4
  8. S. Liu, L. Zhao, J. Li, Q. Cai, "The SIFT features matching for spherical panoramic images", 11th IEEE International Conference on Control & Automation, pp. 914-917, 2014.
  9. G. Tong, X. Chen, N. Ye, "A Spherical Model Based Keypoint Descriptor and Matching Algorithm for Omnidirectional Images", Advances in Mechanical Engineering, Vol. 6, 154376, 2014. https://doi.org/10.1155/2014/154376
  10. G. Tong, J. Gu, "Locating objects in spherical panoramic images", International Conference on Robotics and Biomimetics, pp. 818-823, 2011.
  11. X. Guan, L.-K. Shark, G. Hall, W. Deng, "Distortion correction for immersive navigation in spherical image environment", International Conference on CyberWorlds, pp. 96-101, 2009.
  12. C.M. Grimm, B. Niebruegge, "Continuous cube mapping", Journal of Graphics Tools, pp. 25-34, 2007.
  13. F. Kangni, R. Laganiere, "Epipolar geometry for the rectification of cubic panoramas", Canadian Conference on Computer and Robot Vision, pp. 70-79, 2006.
  14. Z. Zhou, B. Niu, C. Ke, W. Wu, "Static object tracking in road panoramic videos", International Symposium on Multimedia, pp. 57-64, 2010.