Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

An Implementation of QR Code based On-line Mobile Augmented Reality System

QR코드 기반의 온라인 모바일 증강현실 시스템의 구현

  • 박민우 (경북대학교 IT대학 컴퓨터학부) ;
  • 박정필 (경북대학교 IT대학 컴퓨터학부) ;
  • 정순기 (경북대학교 IT대학 컴퓨터학부)
  • Received : 2012.04.18
  • Accepted : 2012.07.06
  • Published : 2012.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a mobile augmented reality system to provide detail information of the products using QR code included in them. In the proposed system, we perform the estimation of the camera pose using both of marker-based and markerless-based methods. If the camera can see the QR code, we perform the estimation of the camera pose using the set of rectangles in the QR code. However, if the QR code is out of sight, we perform the estimation of the camera pose based homography between consecutive frames. Moreover, the content of the augmented reality in the proposed system is made by using meta-data. Therefore, the user can make contents of various scenario using only meta-data file without modification of our system. Especially, our system maintains the contents as newly updated state by the on-line server. Thus, it can reduce the unnecessary update of the program.

본 논문에서는 제품에 삽입된 QR코드를 사용해 제품의 상세한 정보를 제공해주는 모바일 증강현실 시스템을 제안한다. 본 시스템에서는 마커기반의 자세 추정 기법과 마커리스 기반의 기법을 함께 적용하여 보다 강인한 카메라 자세 추정을 수행한다. QR코드가 근거리에 있거나, QR코드 전체가 영상 내에 들어올 경우에는 QR코드 내/외부의 사각형 집합을 추적하여 카메라 자세를 추정한다. 하지만, 영상 내에서 마커가 사라지거나, 모바일 기기가 QR코드 식별이 힘든 먼 거리에 위치할 경우 프레임간의 호모그래피에 기반을 둔 카메라 자세 보정을 수행한다. 또한 제안된 시스템은 증강현실 콘텐츠 제작을 위해서 메타데이터를 사용함으로서 사용자가 프로그램 수정 없이 메타데이터 파일을 작성하는 것만으로 다양한 시나리오의 콘텐츠를 제작 및 수정하는 것이 가능하다. 특히 증강현실 콘텐츠 가시화를 위한 메타데이터와 미디어 파일을 온라인 서버를 통해 항상 최신의 상태로 전송받을 수 있기 때문에 프로그램 업데이트와 같은 불필요한 작업을 최소화할 수 있다.

Keywords

References

  1. 한국정보화진흥원, 스마트 정보문화 확산을 위한 중장기 발전전략 수립 연구, 연구보고서, NIA IV-PER-11091, 2011.
  2. R. Azuma, "A Survey of Augmented Reality," Presence-Teleoperators and Virtual Environments, Vol.6, No.4, pp. 355-385, 1997. https://doi.org/10.1162/pres.1997.6.4.355
  3. G. Papagiannakis, G. Singh, and N.M. Thalmann, "A Survey of Mobile and Wireless Technologies for Augmented Reality Systems," Computer Aninmation and Virtual Worlds, Vol.19, Issue 1, pp. 3-22, 2008. https://doi.org/10.1002/cav.221
  4. ARToolKit, http://www.hitl.washington.edu/artoolkit, 2001.
  5. H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System," 2nd IEEE and ACM International Workshop on Augmented Reality, pp. 85-89, 1999.
  6. V. Teichrieb, JPS do Monte Lima, E.L. Apolinario, TSMC de Farias, M.A.S. Bueno, J. Kelner, and Ismael H.F. Santos, "A Survey of Online Monocular Markerless Augmented Reality," International Journal of Modeling and Simulation for The Petroleum Industry, Vol.1, No.1, pp. 1-7, 2007.
  7. 이정진, 김종호, 김태영, "증강현실 응용을 위한 손 끝점 추출과 손동작 인식 기법," 멀티미디어학회논문지, 제13권, 제2호, pp. 316-323, 2010.
  8. T. Korah, J. Wither, Y. Tsai, and R. Azuma, "Mobile Augmented Reality at the Hollywood Walk of Fame," IEEE Conference of Virtual Reality, pp. 183-186, 2011.
  9. M. Hirzer, Marker Detection for Augmented Reality Applications, Research Paper at Granz University of Technology, 2008.
  10. T.W. Kan, C.H. Teng, and W.S. Chou, "Applying QR code in Augmented Reality Applications," Proc. of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry, pp. 253-257, 2009.
  11. N. Park, W. Lee, and W. Woo, "Barcode- Assisted Planar Object Tracking Method for Mobile Augmented Reality," International Symposium on Ubiquitous Virtual Reality, pp 40-43, 2011.
  12. G. Simon, A.W. Fitzgibbon, and A. Zisserman, "Markerless Tracking using Planar Structures in the Scene," IEEE and ACM International Symposium on Augmented Reality, Vol. 40, Issue 1, pp. 120-128, 2000.
  13. S. Taylor, E. Rosten, and T. Drummond, "Robust Feature Matching in $2.3{\mu}s$," IEEE CVPR Workshop on Feature Detectors and Descriptors: The State of The Art and Beyond, June, 2009.
  14. Qualcomm Augmented Reality, https://developer.qualcomm.com/develop/mobiletechnol-ogies/augmented-reality, 2012.
  15. Metaio Mobile AR, http://www.metaio.com/projects/mobile, 2012.
  16. ZXing Project, http://code.google.com/p/zxing/, 2012.
  17. Denso Wave, About QR Code, http://www.denso-wave.com/qrcode/index-e.html, 2007.
  18. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, second edition, London, 2004.
  19. E. Rosten and T. Drummond, "Fusing Points and Lines for High Performance Tracking," IEEE International Conference on Computer Vision, Vol. 2, pp. 1508-1511, 2005.
  20. E. Rosten and T. Drummond, "Machine Learning for High-Speed Corner Detection," European Conference on Computer Vision, Vol. 1, pp. 430-443, 2006.
  21. Rafael C. Gonzalez and Richard E. Woods, Digital Image Processing, Prentice Hall, third edition, New Jersey, 2008.
  22. M. Kim and I.S. Oh, "Estimation of Rapidmotion for Mobile Devices using Temporal Coherence," 23rd International Conference Image and Vision Computing New Zealand, pp. 1-6, 2008.
  23. Introducing JSON, http://www.json.org, 2012.
  24. QR Code Generator from the ZXing Project, http://zxing.appspot.com/generator, 2012.
  25. OptiTrack, http://www.naturalpoint.com/optitrack/, 2012.

Cited by

  1. Design and Implementation of AR-based Notification View System at Subway Arrival Stations vol.13, pp.4, 2013, https://doi.org/10.7236/JIIBC.2013.13.4.135
  2. Design and Implementation of Piping Spool Management Android Application using QR Code vol.13, pp.4, 2012, https://doi.org/10.9728/dcs.2012.13.4.609
  3. Community-Based Travel Information System Using Augmented Reality vol.18, pp.2, 2015, https://doi.org/10.9717/kmms.2015.18.2.097
  4. Developing a Mobile Application for Asthma Management and User Test vol.17, pp.1, 2014, https://doi.org/10.9717/kmms.2014.17.1.094
  5. A Study on Training System for Fire Prevention based on Virtual Reality vol.17, pp.3, 2016, https://doi.org/10.9728/dcs.2016.17.3.189
  6. Development of a Self-Calibrated Motion Capture System by Nonlinear Trilateration of Multiple Kinects v2 vol.17, pp.8, 2017, https://doi.org/10.1109/JSEN.2017.2671420
  7. Educational Utilization of Smart Devices in the Convergence Education Era vol.13, pp.6, 2015, https://doi.org/10.14400/JDC.2015.13.6.29