A Mobile Tour Guide System using Wearable See-through Device and Hand-held Device based on Shared Touring Context

여행자 상황 정보 기반 안경형 웨어러블 디바이스 및 핸드헬드 디바이스 투어 가이드 시스템

  • 김도연 (과학기술연합대학원대학교 HCI 및 로봇응용공학) ;
  • 서대일 (한국과학기술연구원 영상미디어연구단) ;
  • 유병현 (한국과학기술연구원 영상미디어연구단) ;
  • 고희동 (한국과학기술연구원 영상미디어연구단)
  • Received : 2015.11.06
  • Accepted : 2015.12.09
  • Published : 2016.05.31

Abstract

Mobile tour guide applications help tourists to search for and visit their surrounding POIs(Points of Interest) of their locations and to obtain their guide information. With the development of wearable devices like smart watches and wearable glasses, people using multiple mobile devices are increasing; a tourist may use a hand-held device, a wearable device or both to obtain tour information. However, most mobile tour guides using mobile devices provide the tour information with little consideration of their hand-held and wearable characteristics. In particular, a tourist with multiple mobile devices who search for the tour information from multiple mobile devices must input their intention separately to each device. To alleviate these problems, we propose a mobile tour guide system with the following features: one is to reduce redundant user input by sharing the touring context between hand-held and wearable devices; the other is to present tour information according to capabilities and usage pattern of the devices. The proposed system guides tourists by complementing disadvantage of the devices and also minimizes user interaction between applications and tourists.

모바일 투어 가이드 어플리케이션은 여행 정보를 제공하여 여행자가 여행 중에 주변의 관심 지점(POI; Point of Interest) 을 검색하고 찾아갈 수 있도록 돕는다. 최근 모바일 컴퓨팅 기술이 발전하면서 핸드헬드 디바이스와 웨어러블 디바이스를 여행 정보 검색에 활용하는 사용자가 늘어나고 있지만, 모바일 투어 가이드 어플리케이션들은 디바이스의 특성을 고려하지 않고 여행 정보를 제공한다. 특히 이들 투어 가이드 어플리케이션들은 여행 상황을 공유하지 않기 때문에 여러 모바일 디바이스를 이용하는 여행자는 각각의 디바이스에 여행자의 검색 의도를 별도로 입력해야 하고, 동기화된 여행 정보를 제공받지 못한다. 이러한 문제들을 개선하기 위해 본 논문에서는 디바이스의 특성에 따라 여행 정보를 제공하고 여행 상황을 공유하는 모바일 투어 가이드 시스템을 제안한다. 제안된 시스템은 핸드헬드 디바이스와 안경형 웨어러블 디바이스를 이용하여 여행자에게 여행 정보를 제공하고, 각각의 디바이스가 가진 단점을 상호 보완하면서 여행자를 안내한다. 또한 제안된 시스템은 각각의 디바이스들에 설치된 어플리케이션 사이에 여행 상황을 공유하여 여행자의 입력을 최소화하고, 여행 상황에 맞는 여행 정보를 제공한다.

Keywords

References

  1. Google, Field Trip. http://www.fieldtripper.com/, November 2. 2015.
  2. Concur Technologies, Inc., TripIt. https://www.tripit.com/, November 2. 2015.
  3. NYC & SF, Foursquare. https://www.foursquare.com/, November 3. 2015.
  4. 이진수, 양승훈. 보행 시 스마트폰 사용이 시각 및 청각 자극에 대한 신체반응 속도에 미치는 영향. 한국엔터테인먼트산업학회논문지. 제9권 제3호. 한국엔터테인먼트산업학회. pp. 299-305. 2015.
  5. Malu, M. and Findlater, L. "OK Glass?" A Preliminary Exploration of Google Glass for Persons with Upper Body Motor Impairments, In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. New York. pp. 267-268. 2014.
  6. Emmanouilidis, C., Koutsiamanis, R. A. and Tasidou, A. Mobile guides: Taxonomy of architectures, context awareness, technologies and applications. Journal of Network and Computer Applications. Elsevier. 36(1). pp. 103-125. 2013. https://doi.org/10.1016/j.jnca.2012.04.007
  7. Lee, G. A., Dunser, A., Kim, S. and Billinghurst, M. CityViewAR: A mobile outdoor AR application for city visualization. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality. Atlanta. pp. 57-64. 2012.
  8. Herbst, I., Braun, A. K., McCall, R. and Broll, W. TimeWarp: interactive time travel with a mobile mixed reality game. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. Amsterdam. pp. 235-244. 2008.
  9. Brothers and Sisters Creative Ltd, Museum of London - Street Museum http://www.museumoflondon.org.uk/Resources/app/you-are-here-app/home.html, November 4.2015.
  10. Balduini, M., Celino, I., Dell'Aglio, D., Della Valle, E., Huang, Y., Lee, T., Kim, S. and Tresp, V. BOTTARI: An augmented reality mobile application to deliver personalized and location-based recommendations by continuous analysis of social media streams. Web Semantics: Science. Services and Agents on the World Wide Web. 16. Elsevier. pp. 33-41. 2012.
  11. DuNser, A., Billinghurst, M., Wen, J., Lehtinen, V. and Nurminen, A. Exploring the use of handheld AR for outdoor navigation. Computers & Graphics, Elsevier, 36(8), pp. 1084-1095. 2012. https://doi.org/10.1016/j.cag.2012.10.001
  12. Vadas, K., Patel, N., Lyons, K., Starner, T. and Jacko, J. Reading on-the-go: a comparison of audio and hand-held displays. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services. Helsinki. pp. 219-226. 2006.
  13. Baldauf, M., Frohlich, P. and Hutter, S. KIBITZER: a wearable system for eye-gaze-based mobile urban exploration. In Proceedings of the 1st ACM Augmented Human International Conference. Matthias Baldauf, France. pp. 1-5. 2010.
  14. Langlotz, T., Regenbrecht, H., Zollmann, S. and Schmalstieg, D. Audio stickies: visually-guided spatial audio annotations on a mobile augmented reality platform. In Proceedings of the 25th ACM Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration. Australia. pp. 545-554. 2013.
  15. Szymczak, D., Rassmus-Gröhn, K., Magnusson, C. and Hedvall, P. O. A real-world study of an audio-tactile tourist guide. In Proceedings of the 14th ACM international conference on Human-computer interaction with mobile devices and services. California. pp. 335-344. 2012.
  16. Reitmayr, G. and Schmalstieg, D. Collaborative Augmented Reality for Outdoor Navigation and Information Browsing. In Proceedings of the Second Symposium on Location Based Services and TeleCartography. Vienna. pp. 31-41. 2004.
  17. Kerr, S. J., Rice, M. D., Teo, Y., Wan, M., Cheong, Y. L., Ng, J., Ng-Thamrin L., Thura-Myo. T. and Wren, D. Wearable mobile augmented reality: evaluating outdoor user experience. In Proceedings of the 10th ACM International Conference on Virtual Reality Continuum and Its Applications in Industry. Hongkong. pp. 209-216. 2011.
  18. Caggianese, G., Neroni, P. and Gallo, L. Natural Interaction and Wearable Augmented Reality for the Enjoyment of the Cultural Heritage in Outdoor Conditions. Augmented and Virtual Reality. Paolis, D., Tommaso, L., Mongelli and Antonio. (Ed.) Springer International Publishing. pp. 267-282. New York. 2014.
  19. Alce, G., Wallergürd, M. and Hermodsson, K. WozARd: a wizard of oz method for wearable augmented reality interaction-a pilot study. Advances in Human-Computer Interaction. 30(9). pp. 740-751. 2015.
  20. Altwaijry, H., Moghimi, M. and Belongie, S. Recognizing locations with google glass: A case study. In Proceedings of the IEEE Winter Conference on Application of Computer Vision. Steamboat Springs, CO. pp. 167-174. 2014.
  21. Feiner, S., MacIntyre, B., Höllerer, T. and Webster, A. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies. 1(4). pp. 208-217. 1997. https://doi.org/10.1007/BF01682023
  22. Vlahakis V., Karigiannis, J., Tsotros, M., Ioannidis N. and Stricker, D. Personalized augmented reality touring of archaeological sites with wearable and mobile computers. In Proceedings of Sixth International Symposium on IEEE Wearable Computers. pp. 15-22. 2002.
  23. Cazenave, F., Quint, V. and Roisin, C. Timesheets.js: when SMIL meets HTML5 and CSS3, In Proceedings of the 11th ACM symposium on Document engineering. California. pp. 43-52. 2011.
  24. 김정빈. Sharing Context between Three Types of Views for Effective In-situ Exploration. 석사학위논문. 과학기술연합대학원대학교 HCI 및 로봇응용공학. 대한민국: 대전. 2015.