Journal of Digital Contents Society (디지털콘텐츠학회 논문지)

Digital Contents Society (한국디지털콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Error Correction Scheme in Location-based AR System Using Smartphone

스마트폰을 이용한 위치정보기반 AR 시스템에서의 부정합 현상 최소화를 위한 기법

  • Received : 2014.09.16
  • Accepted : 2015.04.10
  • Published : 2015.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Spread of smartphone creates various contents. Among many contents, AR application using Location Based Service(LBS) is needed widely. In this paper, we propose error correction algorithm for location-based Augmented Reality(AR) system using computer vision technology in android environment. This method that detects the early features with SURF(Speeded Up Robust Features) algorithm to minimize the mismatch and to reduce the operations, and tracks the detected, and applies it in mobile environment. We use the GPS data to retrieve the location information, and use the gyro sensor and G-sensor to get the pose estimation and direction information. However, the cumulative errors of location information cause the mismatch that and an object is not fixed, and we can not accept it the complete AR technology. Because AR needs many operations, implementation in mobile environment has many difficulties. The proposed approach minimizes the performance degradation in mobile environments, and are relatively simple to implement, and a variety of existing systems can be useful in a mobile environment.

스마트폰의 보급 확산으로 다양한 콘텐츠가 등장하고 있다. 이러한 콘텐츠 중에서 위치 기반 서비스를 이용한 증강현실 응용프로그램의 필요성이 널리 대두되고 있다. 본 논문에서는 안드로이드 스마트폰을 이용한 위치정보기반 AR 시스템에서 발생하는 정합 오차를 컴퓨터 비전 기술을 이용하여 효과적으로 줄이는 방법을 제안한다. 위치정보 오차 누적 때문에 객체가 정확하게 정합되지 않는 부정합 현상 최소화를 위해 연산 속도는 유지하면서 연산량을 줄여 성능을 향상한 방법인 SURF(Speeded Up Robust Features)를 사용해 초기 특징점을 검출하고 검출된 특징점을 추적하여 모바일 환경에 적용한다. 위치정보 검색을 위해 GPS 정보를 사용하고 자세추정 및 방향 정보를 위해 자이로 센서, G-센서 등을 이용한다. 하지만 위치정보의 누적된 오차는 객체가 고정되지 않는 부정합 현상을 유발한다. 또한, 증강현실 기술은 구현하면서 많은 연산량이 필요하므로 모바일 환경에서 구현하는데 어려움이 발생한다. 제안된 방법은 모바일 환경에서 성능 저하를 최소화하고 비교적 간단하게 구현할 수 있어 기존 시스템 및 다양한 모바일 환경에서 유용하게 이용될 수 있다.

Keywords

References

  1. S. H. Lee, S. K. Lee and J. S. Choi, "Real-time camera tracking using a particle filter and multiple featuretrackers," Games Innovations Conference, 2009. ICE-GIC 2009. International IEEE Consumer Electronics Society's, pp. 29-36, Aug. 2009.
  2. H. Park and J. I. Park, "Invisible Marker Tracking for AR," in Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality, Arlington, USA, Nov. 2004.
  3. R. Azuma, "Recent Advances in Augmented Reality", IEEE Computer Graphic and Applications, vol. 21, pp. 34-47, 2001.
  4. http://www.ovjet.com
  5. http://www.layar.com
  6. http://www.scan-search.com
  7. S. K. Choi, "The Case Analysis of Augmented Reality Contents Services and Business Forecast," KSII, vol. 12, no. 1, pp. 51-62, Mar. 2011.
  8. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," in Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225-234, Sep. 2007.
  9. A. Davison, I. Reid, N. Morton and O. Stasse, "Monoslam: Real-time single camera slam," IEEE Trans.Pattern Analysis and Machine Intelligence, vol. 29,no.6, pp. 1052-1067, Jun. 2007. https://doi.org/10.1109/TPAMI.2007.1049
  10. P. Keitler, "Mobile Augmented Reality based 3D Snapshots," in Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 199-200, 2009.
  11. S. J. Velat, J. S. Lee, N. Johnson, and C. D. Crane,"Vision Based Vehicle Localization for Autonomous Navigation," in Proc. IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 528-533, Jun. 2007.
  12. D. Wanger, T. Langlotz and D. Schmalstieg, "Robust and Unbtrusive Marker Tracking on Mobile Phones," in Proc. IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225-234,Sep. 2008.
  13. P. Viola and M. Jones, "Rapid object detection usinga boosted cascade of simple features," IEEE Conference on Computer Vision and Pattern Recognition,pp. 511-518, 2001.
  14. D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60, pp. 91-110, Feb. 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  15. H. Bay, T. Tuytelaars, and L. V. Gool, "Speeded-Up Robust Features(SURF)," Similarity Matching in Computer Vision and Multimedia, vol. 110, pp. 346-359, Jun. 2008.
  16. K. Mikolajczyk and C. Schmid, Indexing based onscale invariant interest points," in Proc. IEEE Conference on Computer Vision, vol. 1, pp. 525-531, 2001.
  17. T. Lindeberg. "Feature detection with automatic scale selection," International Journal of Computer Vision, Vol. 30 pp. 77-116, Nov. 1998.
  18. A. H. Lee, J. Y. Lee, S. H. Lee, and J. S. Choi, "Augmented Reality System using Planar Natural Feature Detection," IEEK, vol. 48, SP no. 4, pp.49-58, Jul.2011.
  19. S. H. Lee and J. S. Choi, "Estimation of HumanHeight and Position using a Single Camera," IEEK, vol. 45, SC no. 3, pp. 20-31, May. 2008.
  20. J-Y. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker," Intel Corporation, Microprocessor Research Labs, 2000.
  21. J. Y. Lee and J. S. Kwon, "Touch-based Gaming System using Augmented Reality Technology," Journal of Digital Contents Society, vol. 15, no. 1, pp.69-76, Feb. 2014. https://doi.org/10.9728/dcs.2014.15.1.69

Cited by

  1. 다중 시구간 신경회로망을 이용한 인간 행동 인식 vol.18, pp.3, 2015, https://doi.org/10.9728/dcs.2017.18.3.559
  2. A Study on Tracking and Augmentation in Mobile AR for e-Leisure vol.2018, pp.None, 2018, https://doi.org/10.1155/2018/4265352