The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Facial Expression Training Digital Therapeutics for Autistic Children

자폐아를 위한 표정 훈련 디지털 치료제

  • 박지연 (서울여자대학교 소프트웨어융합과 ) ;
  • 이경원 (서울여자대학교 아동학과 ) ;
  • 엄성용 (서울여자대학교 소프트웨어융합학과 )
  • Received : 2022.11.30
  • Accepted : 2023.01.09
  • Published : 2023.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently a drama that features a lawyer with autism spectrum disorder has attracted a lot of attention, raising interest in the difficulties faced by people with autism spectrum disorders. If the Autism spectrum gets detected early and proper education and treatment, the prognosis can be improved, so the development of the treatment is urgently needed. Drugs currently used to treat autism spectrum often have side effects, so Digital Therapeutics that have no side effects and can be supplied in large quantities are drawing attention. In this paper, we introduce 'AEmotion', an application and a Digital Therapeutic that provides emotion and facial expression learning for toddlers with an autism spectrum disorder. This system is developed as an application for smartphones to increase interest in training autistic children and to test easily. Using machine learning, this system consists of three main stages: an 'emotion learning' step to learn emotions with facial expression cards, an 'emotion identification' step to check if the user understood emotions and facial expressions properly, and an 'expression training' step to make appropriate facial expressions. Through this system, it is expected that it will help autistic toddlers who have difficulties with social interactions by having problems recognizing facial expressions and emotions.

최근 자폐 스펙트럼 장애가 있는 변호사를 주인공으로 하는 TV 드라마가 많은 화제를 불러일으키면서 그 영향으로 자폐 스펙트럼 장애인이 겪는 어려움에 관한 관심도 높아졌다. 자폐 스펙트럼은 조기에 발견해 교육과 치료를 제대로 받으면 예후를 좋게 할 수 있어 그 치료제 개발이 절실히 요구되고 있다. 현재 자폐 스펙트럼 치료에 사용되는 약물은 부작용이 있는 경우가 많아, 그에 비해 부작용이 없고 대량 공급이 가능한 디지털 치료제가 주목받고 있다. 본 논문에서는 자폐 스펙트럼을 가진 영유아를 위한 감정 및 표정 학습을 제공하는 애플리케이션이자 디지털 치료제인 '아이모션(AEmotion)'을 소개한다. 본 시스템은 훈련에 대한 흥미를 높이고 손쉬운 적용 테스트를 위해, 스마트폰용 애플리케이션으로 개발되었다. 머신 러닝 기법을 활용하는 본 시스템은 표정 카드를 통해 감정을 학습하는 '감정 학습' 단계, 감정과 표정을 잘 이해했는지 확인하는 '감정 식별' 단계, 그리고 감정과 알맞은 표정을 짓는 '표정 훈련' 단계 등 총 3단계로 이루어져 있다. 이 시스템을 통해, 표정 인식과 감정처리가 익숙하지 않아 사회적 상호작용이 어려운 자폐 스펙트럼 장애 아동들의 표정 훈련 및 치료에 효과가 있을 것으로 기대한다.

Keywords

Acknowledgement

본 논문은 2022학년도 서울여자대학교 교내 연구비의 지원을 받았음(2022-0115).

References

  1. Y.G. Seo, "NYT 'WooYoungWoo Syndrome Raises Interest in Autism in Korean Society'". Chosun Ilbo, Sep. 2022. https://www.chosun.com/international/2022/09/05/UKCDILLSYNEIVETVQHW2HMBHZM/ 
  2. Autism, National Institute of Korean Language, https://stdict.korean.go.kr/search/searchView.do?word_no=513291&searchKeywordTo=3 
  3. S.Y. Yoon, "Early diagnosis is important for developmental disorders. It can improve some of your brain function", Dong-A Science, Nov. 2018. https://www.dongascience.com/news.php?idx=24818 
  4. Y.H. Yoo, "Children who take drugs for autism have discovered why they become obese", Seoul News, June 2021. https://www.seoul.co.kr/news/newsView.php?id=20210517500087 
  5. K.M. Kim, Choi, S.B. Lee, K.K. Lee, K.C. Paik, J.Y. Lee, M.H. Lim, "Use of Various Treatment Modalities for Autism Spectrum Disorder and Mental Retardation", Department of Psychology, College of Public Service, Dankook University, Cheonan, Korea, Vol. 25, No. 2, pp. 73-81, 2014. https://doi.org/10.5765/jkacap.2014.25.2.73 
  6. C.Y. Park, "Autism Spectrum Disorder Without Medicine ...Is there no hope for 'Extraordinary Attorney Woo'", Mediasobizanews, July 2022. http://www.medisobizanews.com/news/articleView.html?idxno=89384 
  7. M. Lee, "A Design of Cooperative Game Matching Model for Autistic Children Based on Fuzzy Comprehensive Evaluation Method", Graduate School of Techno Design, Kookmin University, Seoul. http://www.riss.kr/search/detail/DetailView.do?p_mat_type=be54d9b8bc7cdb09&control_no=03548cf2ff79f332ffe0bdc3ef48d419 
  8. "An interactive robot that teaches 'expression' to children with autism", BRIC, July 2007. https://www.ibric.org/myboard/read.php?Board=news&id=128842 
  9. H.J. Min, "Looking at the story of Samsung's 'Look at Me', an app for autistic children", I-News24, Dec. 2014. https://www.inews24.com/view/872338 
  10. H.J. Cho, "Seoul National University Hospital has begun developing a 'digital treatment' for autism spectrum disorder", BKT News, July 2022. https://bktimes.net/detail.php?number=90181&thread=06r01 
  11. J.Y. Yong, S.G. Lee, "An Object Tracking Method for Studio Cameras by OpenCV-based Python Program", The Journal of the Convergence on Culture Technology (JCCT), Vol. 4, No. 1, pp. 291-297, February 2018. http://dx.doi.org/10.17703/JCCT.2018.4.1.291 
  12. S.G. Hwang, 「Computer Vision and Machine Learning with OpenCV 4」, Gilbut 
  13. S.M. Lee, S.J. Jeon, "The effect of artificial intelligence experience programs using teachable machines on artificial intelligence perception of elementary school students", JOURNAL OF The Korean Association of information Education (JKAIE), Vol. 25, No. 4, pp.611-619, Aug. 2021.  https://doi.org/10.14352/jkaie.2021.25.4.611
  14. "Meet Android Studio", developers, https://developer.android.com/studio/intro. 
  15. H.G. Jo, E.K Kang, Y.J. Yoon, Y.S. Choi, "Body Food: Touch Mat for Emotional and Physical Development of Children", International Journal of Advanced Culture Technology (IJACT), Vol. 7, No. 1, pp.162-173, July 2019. DOI 10.17703/IJACT.2019.7.1.162 
  16. Yonsei University Industry-Academic Cooperation Foundation, "Development of app-based skills program for children with high functioning autism R&D Report", The Ministry of Health and Welfare of Korea Health Industry Promotion Agency, Seoul, October 2017.