Journal of Industrial Convergence (산업융합연구)

DAEHAN Society of Industrial Management (대한산업경영학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Interactive Hologram Education System based on Speech Recognition - Live Map

음성인식 기반 대화형 홀로그램 교육 시스템의 개발 및 평가에 관한 연구 - 라이브맵(Live Map)

  • 권종산 (동서대학교 컴퓨터공학부) ;
  • 이동헌 (동서대학교 컴퓨터공학부) ;
  • 문미경 (동서대학교 컴퓨터공학부)
  • Received : 2019.11.29
  • Accepted : 2019.12.20
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we developed a world map learning system for elementary education that uses Google Cloud platform STT, Dialog Flow, and fan holograms to recognize the voices of learners and to show and explain three-dimensional images of suitable results as holograms. As a result of the experiments and interviews, it is expected to be helpful for improving the learning effect by inducing students' interest and immersion and is expected to be effectively used for collaborative learning and education for students with disabilities.

이 연구에서는 홀로그램과 음성인식을 이용한 실감형 학습시스템의 가능성을 검증하는 것을 목표로 한다. 이를 위해 '구글 클라우드 플랫폼 STT', 다이얼로그 플로우, 팬홀로그램을 이용하여 학습자가 질문하는 음성을 인식하여 적합한 결과의 입체 영상을 홀로그램으로 보여주며 설명해주는 초등교육용 세계지도 학습시스템을 개발하였다. 실험 및 인터뷰 결과 학생들의 흥미와 몰입을 유발하여 학습효과 향상에 도움이 될 것으로 판단되며, 협업학습과 장애 학생을 위한 교육에 효과적으로 활용될 수 있을 것으로 예상된다.

Keywords

References

  1. C. S. Kwon. (2017). Study on Development and Evaluation of Experiential Learning Game Contents Using Authentic Virtual Reality (Doctoral dissertation, Ph. D. Dissertation, Seoul National University).
  2. M. K. Kim, S. H. Kim & W. S. Lee. (2019). Effects of a Virtual Reality Simulation and a Blended Simulation of Care for Pediatric Patient with Asthma. Child Health Nursing Research, 25(4), 496-506. https://doi.org/10.4094/chnr.2019.25.4.496
  3. J. E. Kim, W. H. Park, H. W. Kim, J. E. Roh & J. E. Lee. (2019). VR Korean Language Learning System for Foreigners. KOREA Computer Graphics Society 2019 Conference, 72-73.
  4. Su. H. Choi & J. S. Won. (2018). The Effects of Device on Virtual Reality based Education: Focused on Immersion, Social Consciousness, and Learning Motivation. Korea Contents Association, 18(1), 487-492.
  5. C. S. Kwon. (2019). Verification of the possibility and effectiveness of experiential learning using HMD-based immersive VR technologies. Virtual Reality, 23(1), 101-118. https://doi.org/10.1007/s10055-018-0364-1
  6. W. Barfield & C. Hendrix. (1995). The effect of update rate on the sense of presence within virtual environments. Virtual Reality, 1(1), 3-15. https://doi.org/10.1007/BF02009709
  7. C. Heeter. (1992). Being there: The subjective experience of presence. Presence: Teleoperators & Virtual Environments, 1(2), 262-271. https://doi.org/10.1162/pres.1992.1.2.262
  8. M. Slater & M. Usoh. (1993). Representations systems, perceptual position, and presence in immersive virtual environments. Presence: Teleoperators & Virtual Environments, 2(3), 221-233. https://doi.org/10.1162/pres.1993.2.3.221
  9. B. K. Kye. (2007). Investigation on the relationships among media characteristics, presence, flow, and learning effects in augmented reality based learning (Doctoral dissertation, Ph. D. Dissertation, Ewha Womans University).
  10. H. J. Seo. (2008). Relationships among Presence, Learning Flow, Attitude toward Usability, and Learning Achievement in an Augmented Reality Interactive Learning Environment. Korean Association for Education Information and Media, 14(3).
  11. D. Gabor. (1948). A new microscopic principle. Nature, 161, 777-778. https://doi.org/10.1038/161777a0
  12. D. Gabor. (1949). Microscopy by reconstructed wave-fronts. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 197(1051), 454-487.
  13. H. J. Kang, S. H. Hong, J. S. Hong, Y. M. Kim, L. H. Hwang & M. K. Lim. (2019). Hologram Industry Policy and Technology Trend. The Journal of The Korean Institute of Communication Sciences, 36(2), 16-22.
  14. W. G. Kim. (2010). A Training Method for Emotionally Robust Speech Recognition using Frequency Warping. Journal of The Korean Institute of Intelligent Systems, 20(4), 528-533. https://doi.org/10.5391/JKIIS.2010.20.4.528
  15. J. I Lee, Y. K. Kim & G. J. Kim. (2017). A Study on Improving English Pronunciation and Intonation utilizing Fluency Improvement system. Korea Convergence Society, 8(11), 1-6.
  16. S. Y. Choi & S. S. Shin. (2009). A Study on the Development of the English Language Instructor Embedding an English Speech Recognition Engine. The Journal of the KICS, 34(4), 75-82.