Dementia and Neurocognitive Disorders (대한치매학회지)

Korean Dementia Association (대한치매학회)
권호 표지
DOI QR코드

DOI QR Code

Development of the Diagnostic Matrix of the Seoul Cognitive Status Test, Compared to Traditional Paper-and-Pencil Neuropsychological Tests

  • Seunghee Na (Department of Neurology, Incheon St. Mary's Hospital, The Catholic University of Korea) ;
  • Young Ju Kim (Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine) ;
  • Si Eun Kim (Department of Neurology, Inje University College of Medicine, Haeundae Paik Hospital) ;
  • Na-Yeon Jung (Department of Neurology, Pusan National University Yangsan Hospital, Pusan National University School of Medicine) ;
  • Seung Joo Kim (Department of Neurology, Gyeongsang National University Changwon Hospital) ;
  • Hee Jin Kim (Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine) ;
  • Joon Soo Shin (Beaubrain Healthcare Co., Ltd.) ;
  • Duk L. Na (Beaubrain Healthcare Co., Ltd.) ;
  • Sang Won Seo (Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine) ;
  • Yeshin Kim (Department of Neurology, Kangwon National University Hospital, Kangwon National University College of Medicine) ;
  • Eek-Sung Lee (Department of Neurology, Soonchunhyang University Bucheon Hospital)
  • Received : 2024.09.02
  • Accepted : 2024.10.10
  • Published : 2024.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Background and Purpose: We aimed to develop the diagnostic matrix of the Seoul Cognitive Status Test (SCST) and compare its performance with traditional paper-and-pencil neuropsychological tests, including the Seoul Neuropsychological Screening Battery-II (SNSB-II) and the Korean version of the Consortium to Establish a Registry for Alzheimer's Disease (CERAD-K). Methods: We recruited 197 participants from the head-to-head SCST-SNSB cohort, and 204 participants from the head-to-head SCST-CERAD cohort. They underwent either SNSB-II or CERAD-K, in addition to SCST. The diagnostic matrix was developed by combining cognitive function, determined by neuropsychological tests, and activities of daily living (ADL), determined by Instrumental-ADL scales. Results: The diagnostic agreement between the SCST and the SNSB-II was 83.9% (weighted kappa=0.87). The agreement between the SCST and the CERAD-K was 84.3% (weighted kappa=0.88). In the SCST-SNSB cohort, all differences in SCST scores between the cognitively unimpaired (CU), mild cognitive impairment (MCI), and dementia diagnosed with the SNSB-II were significant in all cognitive domains (all p<0.01), except for the executive domain between CU and MCI (p=0.145). In the SCST-CERAD cohort, all differences in SCST scores between the 3 groups diagnosed with the CERAD-K were significant in all cognitive domains (all p<0.01), except for the language and visuospatial domains between MCI and dementia (p=0.169 and p=0.778, respectively). Conclusions: Our findings suggest that the tablet-based SCST may be another option to traditional paper-and-pencil neuropsychological tests, especially in situations where time and space are relatively limited, and neuropsychological testing specialists are not available.

Keywords

Acknowledgement

This study was supported by grants from the Korean Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HI19C1132); the Korea Dementia Research Project through the Korea Dementia Research Center (KDRC), funded by the Ministry of Health & Welfare and Ministry of Science and ICT, Republic of Korea (grant number: RS-2020-KH106434); the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare and the Ministry of Science and ICT, Republic of Korea (grant number: RS-2022-KH127756); the National Research Foundation of Korea (NRF), funded by the Korea government (MSIT) (NRF-2019R1A5A2027340); the Institute of Information & communications Technology Planning & Evaluation (IITP), funded by the Korea government (MSIT) (No. RS-2021-II212068, Artificial Intelligence Innovation Hub); the Future Medicine 20*30 Project of the Samsung Medical Center (#SMX1240561); and the "Korea National Institute of Health" research project (2024-ER1003-00).

References

  1. 2023 Alzheimer's disease facts and figures. Alzheimers Dement 2023;19:1598-1695.
  2. Leicht H, Heinrich S, Heider D, Bachmann C, Bickel H, van den Bussche H, et al. Net costs of dementia by disease stage. Acta Psychiatr Scand 2011;124:384-395.
  3. Waldemar G, Phung KT, Burns A, Georges J, Hansen FR, Iliffe S, et al. Access to diagnostic evaluation and treatment for dementia in Europe. Int J Geriatr Psychiatry 2007;22:47-54.
  4. Dubois B, Padovani A, Scheltens P, Rossi A, Dell'Agnello G. Timely diagnosis for Alzheimer's disease: a literature review on benefits and challenges. J Alzheimers Dis 2016;49:617-631.
  5. Then FS, Luck T, Luppa M, Konig HH, Angermeyer MC, Riedel-Heller SG. Differential effects of enriched environment at work on cognitive decline in old age. Neurology 2015;84:2169-2176.
  6. Tsoi KK, Chan JY, Hirai HW, Wong SY, Kwok TC. Cognitive tests to detect dementia: a systematic review and meta-analysis. JAMA Intern Med 2015;175:1450-1458.
  7. Breton A, Casey D, Arnaoutoglou NA. Cognitive tests for the detection of mild cognitive impairment (MCI), the prodromal stage of dementia: meta-analysis of diagnostic accuracy studies. Int J Geriatr Psychiatry 2019;34:233-242.
  8. Chan JY, Yau ST, Kwok TC, Tsoi KK. Diagnostic performance of digital cognitive tests for the identification of MCI and dementia: a systematic review. Ageing Res Rev 2021;72:101506.
  9. Sternin A, Burns A, Owen AM. Thirty-five years of computerized cognitive assessment of aging-where are we now? Diagnostics (Basel) 2019;9:114.
  10. Chin J, Kim DE, Lee H, Yun J, Lee BH, Park J, et al. A validation study of the Inbrain CST: a tablet computer-based cognitive screening test for elderly people with cognitive impairment. J Korean Med Sci 2020;35:e292.
  11. Na S, Lee ES, Lee TK. Diagnostic performance of a tablet computer-based cognitive screening test for identification of amnestic mild cognitive impairment. J Korean Med Sci 2023;38:e131.
  12. Na S, Seo SW, Kim YJ, Yoo H, Lee ES. Correlation analysis between subtest scores of CERAD-K and a newly developed tablet computer-based digital cognitive test (Inbrain CST). Front Aging Neurosci 2023;15:1178324.
  13. Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med 2004;256:183-194.
  14. Jack CR Jr, Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, et al. NIA-AA Research Framework: toward a biological definition of Alzheimer's disease. Alzheimers Dement 2018;14:535-562.
  15. Fazekas F, Kleinert R, Offenbacher H, Schmidt R, Kleinert G, Payer F, et al. Pathologic correlates of incidental MRI white matter signal hyperintensities. Neurology 1993;43:1683-1689.
  16. Kang Y, Jahng S, Na DL. Seoul Neuropsychological Screening Battery. Second Edition (SNSB-II): Professional Manual. Seoul: Human Brain Research & Consulting Co., 2012.
  17. Lee JH, Lee KU, Lee DY, Kim KW, Jhoo JH, Kim JH, et al. Development of the Korean version of the Consortium to Establish a Registry for Alzheimer's Disease Assessment Packet (CERAD-K): clinical and neuropsychological assessment batteries. J Gerontol B Psychol Sci Soc Sci 2002;57:47-53.
  18. Chin J, Park J, Yang SJ, Yeom J, Ahn Y, Baek MJ, et al. Re-standardization of the Korean-Instrumental Activities of Daily Living (K-IADL): clinical usefulness for various neurodegenerative diseases. Dement Neurocogn Disord 2018;17:11-22.
  19. Ku HM, Kim JH, Kwon EJ, Kim SH, Lee HS, Ko HJ, et al. A study on the reliability and validity of Seoul-Instrumental Activities of Daily Living (S-IADL). J Korean Neuropsychiatr Assoc 2004;43:189-199.
  20. Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther 2005;85:257-268.
  21. Sullivan GM, Feinn R. Using effect size-or why the P value is not enough. J Grad Med Educ 2012;4:279-282.
  22. Sawilowsky SS. New effect size rules of thumb. J Mod Appl Stat Methods 2009;8:597-599.
  23. Ahmed S, de Jager C, Wilcock G. A comparison of screening tools for the assessment of mild cognitive impairment: preliminary findings. Neurocase 2012;18:336-351.
  24. Dwolatzky T, Whitehead V, Doniger GM, Simon ES, Schweiger A, Jaffe D, et al. Validity of a novel computerized cognitive battery for mild cognitive impairment. BMC Geriatr 2003;3:4.
  25. Doniger GM, Zucker DM, Schweiger A, Dwolatzky T, Chertkow H, Crystal H, et al. Towards practical cognitive assessment for detection of early dementia: a 30-minute computerized battery discriminates as well as longer testing. Curr Alzheimer Res 2005;2:117-124.
  26. Mundt JC, Ferber KL, Rizzo M, Greist JH. Computer-automated dementia screening using a touch-tone telephone. Arch Intern Med 2001;161:2481-2487.