DOI QR코드

DOI QR Code

Quantitative image processing analysis for handwriting legibility evaluation

글씨쓰기 명료도 평가의 정량적 영상처리 분석

  • Kim, Eun-Bin (Department of Medical IT Engineering, Soonchunhyang University) ;
  • Lee, Cho-Hee (Department of Occupational Therapy, Soonchunhyang University) ;
  • Kim, Eun-Young (Department of Occupational Therapy, Soonchunhyang University) ;
  • Lee, OnSeok (Department of Medical IT Engineering, Soonchunhyang University)
  • 김은빈 (순천향대학교 의료IT공학과) ;
  • 이초희 (순천향대학교 작업치료학과) ;
  • 김은영 (순천향대학교 작업치료학과) ;
  • 이언석 (순천향대학교 의료IT공학과)
  • Received : 2019.04.23
  • Accepted : 2019.07.05
  • Published : 2019.07.31

Abstract

Although evaluation of writing disabilities identification and timely intervention are required, clinicians adopt a manual scoring method and there is a possibility of error due to subjective evaluation. In this study, the size ratio and position of letters are digitized and quantified through image processing of offline handwritten characters. We tried to evaluate objectively and accurately the performance of writing through comparison with existing methods. From November 12th to 16th, 2018, 20 adults without neurological injury were selected. They used a pencil to follow the 10 words, 2 sentence stimuli after keeping the usual habit, and we collected the writing test data. The results showed that the height of the word was 1.2 times larger than the width and it tilted to the lower left. The spacing interval was 9mm on average. In the Paired T test, a high correlation was showed between our system and existing methods in the word and sentence 2. This demonstrated the possibility as a testing tool. This study evaluated objectively and precisely writing performance of offline handwritten characters through image processing and provided preliminary data for performance standards. In the future, it can be suggested as a basic data on writing diagnosis of various ages.

선수능력의 발달 미흡과 신경학적 손상으로 인해 나타나는 쓰기 장애는 의미전달의 혼동을 줄 수 있고 가독성이 떨어지며 학습, 사회정서 문제 유발 가능성이 높다. 이에 문제 파악과 적시 개입을 위한 평가가 요구되고 있지만 임상에서는 수기에 의한 채점 방식을 채택하며 주관적인 평가에 따른 오류 가능성이 발생한다. 본 연구는 성인의 오프라인 필기체 문자를 영상처리를 통해 글자의 크기비율, 위치를 데이터화 하고 정량화 하며 수기 채점방식과의 비교, 분석을 통해 보다 객관적이고 정확하게 쓰기 수행을 평가하고자 하였다. 2018년 11월 12일부터 16일까지 신경학적 손상이 없는 성인 20명을 채택하여 10단어, 2 문장 자극을 평소 쓰기 습관을 유지한 후 연필을 사용해 따라 쓰며 쓰기 검사 데이터를 수집하였다. 본 연구에서 개발한 글씨 측정 알고리즘 결과 단어의 높이가 폭에 비해 1.2배 정도 크고 왼쪽 아래로 치우치는 경향을 보였으며 평균 9mm의 간격을 두고 띄어 썼다. Paired T test를 통한 수기와 본 시스템의 분석결과, 단어 검사와 문장 2의 검사는 고도의 상관관계를 보여 추후 검사 도구로써의 가능성을 보였다. 본 연구는 성인의 오프라인 필기체 문자를 영상처리를 통해 보다 객관적이고 정확하게 쓰기 수행을 평가하였으며 수행 규준을 위한 예비자료를 제공하였다. 향후 다양한 연령대의 쓰기 진단의 기초 자료로 제시될 수 있으며 아동의 경우 쓰기 장애 개입에 깊이 있게 활용될 수 있을 것이다.

Keywords

SHGSCZ_2019_v20n7_158_f0001.png 이미지

Fig. 1. 6 different types of Han-gul combination

SHGSCZ_2019_v20n7_158_f0002.png 이미지

Fig. 2. Collected word write check sheet

SHGSCZ_2019_v20n7_158_f0003.png 이미지

Fig. 3. Result of binary word processing

SHGSCZ_2019_v20n7_158_f0004.png 이미지

Fig. 4. Collected sentence write check sheet

SHGSCZ_2019_v20n7_158_f0005.png 이미지

Fig. 5. Result of binary sentence processing

SHGSCZ_2019_v20n7_158_f0006.png 이미지

Fig. 6. Aspect ratio histogram

SHGSCZ_2019_v20n7_158_f0007.png 이미지

Fig. 7. Start position expressed by angle of direction

SHGSCZ_2019_v20n7_158_f0008.png 이미지

Fig. 8. X Position alignment

SHGSCZ_2019_v20n7_158_f0009.png 이미지

Fig. 9. Y Position alignment

SHGSCZ_2019_v20n7_158_f0010.png 이미지

Fig. 10. Coordinate System

SHGSCZ_2019_v20n7_158_f0011.png 이미지

Fig. 11. The spacing of sentences

Table 1. Size by type ratio

SHGSCZ_2019_v20n7_158_t0001.png 이미지

Table 2. Paired T test for word

SHGSCZ_2019_v20n7_158_t0002.png 이미지

Table 3. Paired T test for sentence

SHGSCZ_2019_v20n7_158_t0003.png 이미지

References

  1. J. E. Reisman, "Development and reliability of the research version of the Minnesota Handwriting Test," Physical & Occupational Therapy In Pediatrics, Vol.13, No.2, pp.41-55, 1993. DOI: https://doi.org/10.1080/J006v13n02_03
  2. S. L. Hammerschmidt, P. Sudsawad, "Teachers' survey on problems with handwriting: Referral, evaluation, and outcomes," American Journal of Occupational Therapy, Vol.58, No.2, pp.185-192, 2004. DOI: https://doi.org/10.5014/ajot.58.2.185
  3. S. W Shin, S. C Cho, "Comparative study upon the characteristics of writing between the patients with writing disabilities and normal elementary school students," Korean Academy of Child and Adolescent Psychiatry, Vol.12, No.1, pp51-70, 2001.
  4. R. Sassoon, "Dealing with adult handwriting problems," Handwriting Review, Vol.11, pp.69-74, 1997.
  5. J. K Kim, H. J. Kang, J. Y. Kim, "Type of learning difficulties for children at-risk for learning disabilities from low-income families and characteristics of cognitive ability and academic achievement among them," The Journal of Special Education: Theory and Practice, Vol.14, No.4, pp.57-80, 2013. DOI: http://dx.doi.org/10.19049/JSPED.14.4.03
  6. E. S. Choi, "Effect of Reading and Writing Abilities Improvement Program for Elementary School Children of Multicultural Families," The Korea Contents Association, Vol.14, No.10, pp.393-402, 2014. DOI: https://doi.org/10.5392/JKCA.2014.14.10.393
  7. K. S. Park, D. Y. Jung, I. S. Jung, Y. J. Song, K. O. Kim, "A Study on Reliability and Validity of KISE-Scales of Basic Academic Achievement Test(Writing)," The Educational Jounal for Physical and Multiple Disabilities, Vol.21, No.3, pp.1-23, 2005.
  8. J. d. C. Rodrigues, D. R. d. Fontoura, J. F. d.Salles, "Acquired dysgraphia in adults following right or left-hemisphere stroke," Dementia & Neuropsychologia, Vol.8, No.3, pp.236-242, 2014. DOI: http://dx.doi.org/10.1590/S1980-57642014DN83000007
  9. M.P. Caligiuri, H. L. Teulings, J. V. Filoteo, D. Song, J. B. Lohr, "Quantitative measurement of handwriting in the assessment of drug-induced parkinsonism," Human movement science, Vol.25, No.4-5, pp.510-522, 2006. DOI: https://doi.org/10.1016/j.humov.2006.02.004
  10. Poon, Christine, et al. "Derivation and Analysis of Dynamic Handwriting Features as Clinical Markers of Parkinson's Disease," Proceedings of the 52nd Hawaii International Conference on System Sciences, 2019. DOI: http://hdl.handle.net/10125/59808
  11. B. Croisile, "Agraphia in Alzheimer's disease," Dementia and geriatric cognitive disorders, Vol.10, No.3, pp.226-230, 1999. DOI: https://doi.org/10.1159/000017124
  12. R. H. Jebsen, N. Taylor, R. B. Trieschmann, M. J. Trotter, L. A. Howard, "An objective and standardized test of hand function," Archives of physical medicine and rehabilitation, Vol.50, No.6, pp.311-319, 1969.
  13. T. Y. Jang, B. R. Park, Y. E. Y, "Effects of Occupational Therapeutic Craft Activity on improvement cognitive function and hand function in acute patients with stroke," Journal of the Korea Academia-Industrial cooperation Society, Vol.18, No.5, pp.355-365, 2017. DOI: https://doi.org/10.5762/KAIS.2017.18.5.355
  14. E. K. Hong, The Stability of Errors and Characters in Korean Writing by Infants, Master's thesis, Chung-Ang University of Graduate school of Education, Seoul, Korea, pp.64-69, 1987.
  15. M. J. Cha, A Study on the Writing Pattern of Children, Master's thesis, Ewha Womans University of Graduate school of Education, Seoul, Korea, pp.49-51, 1992.
  16. K. M. Lim, E. Y. You, M. Y. Jung, J. S. Lee, J. R. Kim, H. Y. Park, "Development of the Evaluation Tool of School-aged Children's Handwriting," The Journal of Korean Society of Occupational Therapy, Vol.26, No.1, pp.103-118, 2018. DOI: https://doi.org/10.14519/jksot.2018.26.1.08
  17. T. Santangelo and S. Graham, "A comprehensice meta-analysis of handwriting instruction," Educational Psychology Review, Vol.2, No.28, pp.225-265, 2016 DOI: https://doi.org/10.1007/s10648-015-9335-1
  18. M. C. Jung, "Stroke Extraction in Phoneme for Off-Line Handwritten Hangul Recognition," Journal of the Korea Academia-Industrial cooperation Society, Vol.7, No.3, pp.385-392, 2006. UCII: G704-001653.2006.7.3.038
  19. Ministry of Culture, Sports and Tourism, "Spelling system of Hangul," Korea, pp.99-118, 2017.
  20. O. S. Kwon, "Handwriting Feature Analysis of Korean Alphabets," Journal of the Korean Association of Information Education, Vol.4, No.2, pp129-139, 2000.
  21. S. Y. Ko, Y. S. Paek, H. A. Kil, M. Kim, S. Yusuke, S. H. Son, "Meta-analysis of single subject researches for students with difficulty in writing: focusing on students with mild intellectual disabilities, learning disabilities, and low achievement," Journal of special education:theory and practicce, Vol.2, No.19, pp.123-148, 2018 DOI: http://dx.doi.org/10.19049/JSPED.2018.19.2.06
  22. H. S. Lee, S. H. Kim, N. R. Oh, "Effect of Visual Perception and Motor Ability on CognitiveExercise Therapy With Developmental Disorder," Riabilitazione Neurocognitiva, Vol.10, No.1, pp.25-31, 2018 DOI: http://doi.org/10.29144/KSCTE.2018.10.1.25