Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

An AI Service to support communication and language learning for people with developmental disability

발달장애인을 위한 커뮤니케이션과 언어 학습 증진을 위한 인공지능 서비스

  • Park, Chan-Jun (Department of Computer Science and Engineering, Korea University) ;
  • Kim, Yang-Hee (Department of Computer Science and Engineering, Korea University) ;
  • Jang, Yoonna (Department of Computer Science and Engineering, Korea University) ;
  • Umadevi, G.R (Department of Computer Science and Engineering, Korea University) ;
  • Lim, Heui-Seok (Department of Computer Science and Engineering, Korea University)
  • 박찬준 (고려대학교 컴퓨터학과) ;
  • 김양희 (고려대학교 컴퓨터학과) ;
  • 장윤나 (고려대학교 컴퓨터학과) ;
  • ;
  • 임희석 (고려대학교 컴퓨터학과)
  • Received : 2020.03.26
  • Accepted : 2020.06.20
  • Published : 2020.06.28
Download PDF
⟨ Previous Next ⟩

Abstract

Children with language developmental disabilities often struggle through their lives from a lot of challenges in everyday life and social activities. They're often easily deprived of the opportunity to engage in social activities, because they find difficulty in understanding or using language, a core means of communication. With regard to this issue, AAC(Augmentative and Alternative Communication) can be an effective communication tool for children who are suffering from language disabilities. In this paper, we propose a deep learning-based AI service to make full use of the pictogram as an AAC tool for children with language developmental disabilities to improve not only the ability to interact with others but the capacity to understand language. Using this service, we strive to help these children to more effectively communicate their intention or desire and enhance the quality of life.

언어발달 장애를 가진 아동들은 일상생활 및 사회생활에서 많은 어려움을 겪으며 이는 생애 전반을 걸쳐 지속된다. 언어발달 장애 아동들은 의사소통 수단인 언어를 이해하거나 사용하는 데에 어려움을 겪기 때문에 종종 사회적 활동에 참여할 기회를 박탈당하곤 한다. 이와 관련해서 Augmentative and Alternative Communication(AAC, 보완대체 의사소통)는 언어장애를 앓는 이들에게 실직적인 의사소통 수단으로 사용될 수 있다. 본 논문은 픽토그램을 AAC의 수단으로써 최대한 활용하여 언어발달 장애 아동이 타인과 의사소통하고 언어 이해 능력을 향상시킬 수 있도록 돕는 딥러닝 기반 인공지능 서비스를 제안한다. 본 서비스를 통해 언어 문제를 겪고 있는 이들이 자신의 의도 혹은 욕구를 보다 수월하게 표현하여 삶의 질이 향상 될 수 있을 것으로 기대한다.

Keywords

References

  1. B. W. Yi. (2012). Communication Disorders and Healing. The Journal of humanities, 21, 55-81.
  2. G. Y. Lee, G. J. Jung, H. W. Park, Y. J. Lim, E. N. Kim & G. J. Lee. (2018). Survey on the Employment Status of the Disabled in Business. Survey on the Employment Status of the Disabled in Business (2018), 1-362.
  3. Beukelman, D. R. & Mirenda, P. (1998). Augmentative and alternative communication. Baltimore: Paul H. Brookes.
  4. Glennen, S. & DeCoste, D. C. (1997). The handbook of augmentative and alternative communication. Cengage Learning.
  5. Mirenda, P. (2003). Toward functional augmentative and alternative communication for students with autism. Language, speech, and hearing services in schools.
  6. W. S. Kim, J. W. Lee, H. N. Kim, S. J. Park, J. O. Lee & Y. J. Choi. (2018). A Comparative Study on the Understanding and Expression of Pictograms by Mentally Disabled Adults. Journal of Speech-Language & Hearing Disorders, 27(4), 9-18. https://doi.org/10.15724/jslhd.2018.27.4.009
  7. Y. S. Park & E. S. Park. (2015). The effect of intervention using pictograms on the ability to recognize symbols of school-aged children with intellectual disabilities. Journal of Speech-Language & Hearing Disorders, 24(4), 71-81. https://doi.org/10.15724/jslhd.2015.24.4.007
  8. Y. S. Park & E. S. Park. (2012). Pictogram intervention on symbol-comprehension abilities of children with intellectual disabilities. Korean speech-languag & hearing association, 165-170.
  9. Calculator, S. & Luchko, C. D. A. (1983). Evaluating the effectiveness of a communication board training program. Journal of speech and Hearing Disorders, 48(2), 185-191. https://doi.org/10.1044/jshd.4802.185
  10. Vaswani, A. et al. (2017). Attention is all you need. In Advances in neural information processing systems (pp. 5998-6008).
  11. Maragos, P., Potamianos, A. & Gros, P. (Eds.). (2008). Multimodal processing and interaction: audio, video, text (Vol. 33). Springer Science & Business Media.
  12. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S. & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111-3119).
  13. Miller, G. A. (1995). WordNet: a lexical database for English. Communications of the ACM, 38(11), 39-41. https://doi.org/10.1145/219717.219748
  14. Broomfield, J. & Dodd, B. (2004). Children with speech and language disability: Caseload characteristics. International Journal of Language & Communication Disorders, 39(3), 303-324. https://doi.org/10.1080/13682820310001625589
  15. Schwarz, S. M., Corredor, J., Fisher-Medina, J., Cohen, J. & Rabinowitz, S. (2001). Diagnosis and treatment of feeding disorders in children with developmental disabilities. Pediatrics, 108(3), 671-676. https://doi.org/10.1542/peds.108.3.671