International Journal of Advanced Culture Technology

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Three Dimensional(3D) Education Game Development for Treatment Assistance with High-Functioning Autism

  • Tae-In Jang (Dept. Software and Communications Engineering, Hongik University) ;
  • Hyung-Joon Baek (Dept. Software and Communications Engineering, Hongik University) ;
  • Sojeong Lee (School of Design Convergence, Hongik University) ;
  • Hayoon Jo (School of Design Convergence, Hongik University) ;
  • Yuri Yoon (School of Games, Hongik University) ;
  • Janghwan Kim (Dept. Software and Communications Engineering, Hongik University) ;
  • R. Young Chul Kim (Dept. Software and Communications Engineering, Hongik University) ;
  • Chaeyun Seo (Dept. Software and Communications Engineering, Hongik University)
  • Received : 2024.07.13
  • Accepted : 2024.09.05
  • Published : 2024.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Due to rapid socio-economic development and environmental changes, particularly autism spectrum disorder (ASD) in the context of Attention Deficit Hyperactivity Disorder (ADHD) and high-functioning autism, has become a significant social issue. This issue is increasingly recognized from a societal perspective rather than just an individual or family problem. But there remains a lack of information in frontline education. Traditionally, treatment for ASD has been conducted in specialized institutions, or by professional doctors, therapists, and counselors. There are still several challenges such as 1) accessibility to hospitals and transportation for children with ASD, 2) the maturity and competence of therapists, and 3) the lack of appropriate educational content. To solve these problems, we propose a supplementary 3D educational game process for children with high-functioning autism that utilize speech recognition technology and games designed for continuous and repetitive learning. Our proposed game content can be used at home, which incorporates Speech-To-Text (STT) technology and mini-games to help children indirectly experience and learn to handle unexpected real-life situations. With this approach, we will expect that the children can develop social skills and enhance the efficiency of their treatment.

Keywords

Acknowledgement

This research was supported by the Ministry of Culture, Sports, and Tourism in 2024 through the Korea Creative Content Agency (Project Name: Development of AI-based User-Interactive Multimodal Storytelling 3D Scene Authoring Technology, Project No.: RS-2023-00227917, Contribution Rate: 100%) and by the Brain Korea 21 (BK21) program of the National Research Foundation of Korea (Project Name: Research Team for Hyper-Distributed Autonomous Computing Service Technology, Project No.: 202003520005).

References

  1. J. Kim, and J. Chung, "A Study on the Utilization of Virtual Educational Training Contents. International Journal of Internet, Broadcasting and Communication, 16(3), 45-60. DOI: https://doi.org/10.1234/abcd5678
  2. H. Lee, "Analysis of Storytelling Patterns in High-Functioning Autistic Children Using Intelligent Robots", master's thesis, Ewha Women's University, 2012.
  3. S. Min, K. Lee, D. Lee, and D. Ryu, "A Quantitative Evaluation Method for STT Engine Accuracy Based on Korean Language Characteristics", Journal of the Korean Society of Computer and Information, 2020, 21(7), 699-707. DOI: https://doi.org/10.5762/KAIS.2020.21.7.699
  4. I. Lee, "The Impact of Context-Based Social Communication Programs Provided at the Workplace on Pragmatic Language Use in High-Functioning Autistic Individuals", master's thesis, Ewha Women's University, 2023.
  5. Samsung Electronics Newsroom. Application 'Look at Me' for Training Communication Skills.
  6. Ewha Women's University Newspaper, Game Team. Connecting the World for Children with Developmental Disabilities through Games. Retrieved from https://inews.ewha.ac.kr/news/articleView.html?idxno=32906
  7. M. Lee, S. Park, and M. Kim, "Basic Study for Development of Reading Comprehension Program for Students with High- Functioning Autism Spectrum Disorder", The Journal of the Korean Association on Developmental Disabilities Academic journal, Vol.25 No.1, 1-27, 2021. DOI: https://doi.org/10.34262/kadd.2021.25.1.27
  8. H. Kang and S. Han, "The Impact of Speech-To-Text-based Class on Learners' Cognitive Abilities", Journal of the Korea Society of Computer and Information Academic journal, Vol.29 No.1(Wn.238), 287-293. 2024.01. DOI: https://doi.org/10.9708/jksci.2024.29.01.287
  9. J. Park and Y. Jung, "A Prototype for Emotional Text-to-Speech for ChatGPT based AI Interview System", The Proceedings of the 2023 KIIT Summer Conference, 06 411 - 413m, 2023.06.
  10. J. Lee, "The Abilities of Understanding Nonverbal Communication in Adolescents with High Functioning Autism Spectrum Disorder through Advertisement Image Media", Doctor's Thesis, Daegu University, 2020.