Korean Journal of Radiology

The Korean Society of Radiology (대한영상의학회)
권호 표지
DOI QR코드

DOI QR Code

Survey on Value Elements Provided by Artificial Intelligence and Their Eligibility for Insurance Coverage With an Emphasis on Patient-Centered Outcomes

  • Hoyol Jhang (Division of Healthcare Research, National Evidence-Based Healthcare Collaborating Agency) ;
  • So Jin Park (Division of Healthcare Research, National Evidence-Based Healthcare Collaborating Agency) ;
  • Ah-Ram Sul (Division of Healthcare Research, National Evidence-Based Healthcare Collaborating Agency) ;
  • Hye Young Jang (Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine) ;
  • Seong Ho Park (Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine)
  • Received : 2023.12.23
  • Accepted : 2024.02.04
  • Published : 2024.05.01
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: This study aims to explore the opinions on the insurance coverage of artificial intelligence (AI), as categorized based on the distinct value elements offered by AI, with a specific focus on patient-centered outcomes (PCOs). PCOs are distinguished from traditional clinical outcomes and focus on patient-reported experiences and values such as quality of life, functionality, well-being, physical or emotional status, and convenience. Materials and Methods: We classified the value elements provided by AI into four dimensions: clinical outcomes, economic aspects, organizational aspects, and non-clinical PCOs. The survey comprised three sections: 1) experiences with PCOs in evaluating AI, 2) opinions on the coverage of AI by the National Health Insurance of the Republic of Korea when AI demonstrated benefits across the four value elements, and 3) respondent characteristics. The opinions regarding AI insurance coverage were assessed dichotomously and semi-quantitatively: non-approval (0) vs. approval (on a 1-10 weight scale, with 10 indicating the strongest approval). The survey was conducted from July 4 to 26, 2023, using a web-based method. Responses to PCOs and other value elements were compared. Results: Among 200 respondents, 44 (22%) were patients/patient representatives, 64 (32%) were industry/developers, 60 (30%) were medical practitioners/doctors, and 32 (16%) were government health personnel. The level of experience with PCOs regarding AI was low, with only 7% (14/200) having direct experience and 10% (20/200) having any experience (either direct or indirect). The approval rate for insurance coverage for PCOs was 74% (148/200), significantly lower than the corresponding rates for other value elements (82.5%-93.5%; P ≤ 0.034). The approval strength was significantly lower for PCOs, with a mean weight ± standard deviation of 5.1 ± 3.5, compared to other value elements (P ≤ 0.036). Conclusion: There is currently limited demand for insurance coverage for AI that demonstrates benefits in terms of non-clinical PCOs.

Keywords

Acknowledgement

This research was supported by the National Evidence-based Healthcare Collaborating Agency in the Republic of Korea (grant no. NECA-A-23-002).

References

  1. American College of Radiology. ACR data science institute AI central database [accessed on December 23, 2023]. Available at: https://aicentral.acrdsi.org/ 
  2. U.S. Food and Drug Administration. Artificial intelligence and machine learning (AI/ML)-enabled medical devices [accessed on December 23, 2023]. Available at: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices 
  3. The Medical Futurist. FDA-approved A.I.-based algorithms [accessed on December 23, 2023]. Available at: https://medicalfuturist.com/fda-approved-ai-based-algorithms/ 
  4. Health AI Register. Products [accessed on December 23, 2023]. Available at: https://radiology.healthairegister.com/products/ 
  5. Muehlematter UJ, Daniore P, Vokinger KN. Approval of artificial intelligence and machine learning-based medical devices in the USA and Europe (2015-20): a comparative analysis. Lancet Digit Health 2021;3:e195-e203 
  6. Benjamens S, Dhunnoo P, Mesko B. The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ Digit Med 2020;3:118 
  7. Ministry of Food and Drug Safety. [2022 medical device approval report] [accessed on December 23, 2023]. Available at: https://www.mfds.go.kr/brd/m_218/view.do?seq=33531&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&it.
  8. U.S. Food and Drug Administration. Good machine learning practice for medical device development: guiding principles [accessed on December 23, 2023]. Available at: https://www.fda.gov/medical-devices/software-medical-device-samd/good-machine-learning-practice-medical-device-development-guiding-principles 
  9. Omoumi P, Ducarouge A, Tournier A, Harvey H, Kahn CE Jr, Louvet-de Verchere F, et al. To buy or not to buy-evaluating commercial AI solutions in radiology (the ECLAIR guidelines). Eur Radiol 2021;31:3786-3796 
  10. Recht MP, Dewey M, Dreyer K, Langlotz C, Niessen W, Prainsack B, et al. Integrating artificial intelligence into the clinical practice of radiology: challenges and recommendations. Eur Radiol 2020;30:3576-3584 
  11. Filice RW, Mongan J, Kohli MD. Evaluating artificial intelligence systems to guide purchasing decisions. J Am Coll Radiol 2020;17:1405-1409 
  12. Juluru K, Shih HH, Keshava Murthy KN, Elnajjar P, El-Rowmeim A, Roth C, et al. Integrating Al algorithms into the clinical workflow. Radiol Artif Intell 2021;3:e210013 
  13. Lee S, Shin HJ, Kim S, Kim EK. Successful implementation of an artificial intelligence-based computer-aided detection system for chest radiography in daily clinical practice. Korean J Radiol 2022;23:847-852 
  14. Choi H, Sunwoo L, Cho SJ, Baik SH, Bae YJ, Choi BS, et al. A nationwide web-based survey of neuroradiologists' perceptions of artificial intelligence software for neuro-applications in Korea. Korean J Radiol 2023;24:454-464 
  15. Wu K, Wu E, Theodorou B, Liang W, Mack C, Glass L, et al. Characterizing the clinical adoption of medical AI devices through U.S. insurance claims. NEJM AI 2024;1:AIoa2300030 
  16. Davenport TH, Glaser JP. Factors governing the adoption of artificial intelligence in healthcare providers. Discov Health Syst 2022;1:4 
  17. Rebitzer JB, Rebitzer RS. AI adoption in U.S. health care won't be easy [accessed on December 23, 2023]. Available at: https://hbr.org/2023/09/ai-adoption-in-u-s-health-care-wont-be-easy 
  18. Wu G, Segovis CS, Nicola LP, Chen MM. Current reimbursement landscape of artificial intelligence. J Am Coll Radiol 2023;20:957-961 
  19. Health Insurance Review and Assessment Service. [Guidelines for the evaluation of innovative medical technologies for coverage by national health insurance: artificial intelligence-based innovative medical technologies] [accessed on December 23, 2023]. Available at: https://www.hira.or.kr/bbs/157/2023/08/BZ202308259003306.pdf.
  20. Lobig F, Subramanian D, Blankenburg M, Sharma A, Variyar A, Butler O. To pay or not to pay for artificial intelligence applications in radiology. NPJ Digit Med 2023;6:117 
  21. Park SH, Park CM, Choi JI. Health insurance coverage for artificial intelligence-based medical technologies: focus on radiology. J Korean Med Assoc 2021;64:648-653 
  22. Parikh RB, Helmchen LA. Paying for artificial intelligence in medicine. NPJ Digit Med 2022;5:63 
  23. Park SH, Han K. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 2018;286:800-809 
  24. NEJM Catalyst. What is value-based healthcare? [accessed on December 23, 2023]. Available at: https://catalyst.nejm.org/doi/full/10.1056/CAT.17.0558 
  25. Caldonazzi N, Rizzo PC, Eccher A, Girolami I, Fanelli GN, Naccarato AG, et al. Value of artificial intelligence in evaluating lymph node metastases. Cancers (Basel) 2023;15:2491 
  26. Senior K. NHS embraces AI-assisted radiotherapy technology. Lancet Oncol 2023;24:e330 
  27. Schoppe K. Artificial intelligence: who pays and how? J Am Coll Radiol 2018;15:1240-1242 
  28. Kidanemariam M, Pieterse AH, van Staalduinen DJ, Bos WJW, Stiggelbout AM. Does value-based healthcare support patient-centred care? A scoping review of the evidence. BMJ Open 2023;13:e070193 
  29. Maruszczyk K, Aiyegbusi OL, Torlinska B, Collis P, Keeley T, Calvert MJ. Systematic review of guidance for the collection and use of patient-reported outcomes in real-world evidence generation to support regulation, reimbursement and health policy. J Patient Rep Outcomes 2022;6:57 
  30. Thompson MJ, Suchsland MZ, Hardy V, Lavallee DC, Lord S, Devine EB, et al. Patient-centred outcomes of imaging tests: recommendations for patients, clinicians and researchers. BMJ Qual Saf 2023;32:536-545 
  31. Jung KH. Uncover this tech term: foundation model. Korean J Radiol 2023;24:1038-1041 
  32. Hong GS, Jang M, Kyung S, Cho K, Jeong J, Lee GY, et al. Overcoming the challenges in the development and implementation of artificial intelligence in radiology: a comprehensive review of solutions beyond supervised learning. Korean J Radiol 2023;24:1061-1080 
  33. Hwang SI, Lim JS, Lee RW, Matsui Y, Iguchi T, Hiraki T, et al. Is ChatGPT a "fire of prometheus" for non-native English-speaking researchers in academic writing? Korean J Radiol 2023;24:952-959 
  34. Amin K, Khosla P, Doshi R, Chheang S, Forman HP. Artificial intelligence to improve patient understanding of radiology reports. Yale J Biol Med 2023;96:407-417 
  35. Giorgino R, Alessandri-Bonetti M, Luca A, Migliorini F, Rossi N, Peretti GM, et al. ChatGPT in orthopedics: a narrative review exploring the potential of artificial intelligence in orthopedic practice. Front Surg 2023;10:1284015 
  36. Park SH, Sul AR, Ko Y, Jang HY, Lee JG. Radiologist's guide to evaluating publications of clinical research on AI: how we do it. Radiology 2023;308:e230288 
  37. Fasterholdt I, Kjolhede T, Naghavi-Behzad M, Schmidt T, Rautalammi QTS, Hildebrandt MG, et al. Model for ASsessing the value of Artificial Intelligence in medical imaging (MAS-AI). Int J Technol Assess Health Care 2022;38:e74 
  38. Kocak B, Chepelev LL, Chu LC, Cuocolo R, Kelly BS, Seebock P, et al. Assessment of radiomics research (ARISE): a brief guide for authors, reviewers, and readers from the Scientific Editorial Board of European Radiology. Eur Radiol 2023;33:7556-7560 
  39. Park HY, Suh CH, Kim SO. Use of "diagnostic yield" in imaging research reports: results from articles published in two general radiology journals. Korean J Radiol 2022;23:1290-1300 
  40. Ahn Y, Lee SM, Noh HN, Kim W, Choe J, Do KH, et al. Use of a commercially available deep learning algorithm to measure the solid portions of lung cancer manifesting as subsolid lesions at CT: comparisons with radiologists and invasive component size at pathologic examination. Radiology 2021;299:202-210 
  41. Hong JH, Jung JY, Jo A, Nam Y, Pak S, Lee SY, et al. Development and validation of a radiomics model for differentiating bone islands and osteoblastic bone metastases at abdominal CT. Radiology 2021;299:626-632 
  42. Hwang EJ, Lee JS, Lee JH, Lim WH, Kim JH, Choi KS, et al. Deep learning for detection of pulmonary metastasis on chest radiographs. Radiology 2021;301:455-463 
  43. Kang NG, Suh YJ, Han K, Kim YJ, Choi BW. Performance of prediction models for diagnosing severe aortic stenosis based on aortic valve calcium on cardiac computed tomography: incorporation of radiomics and machine learning. Korean J Radiol 2021;22:334-343 
  44. Kim DW, Ha J, Lee SS, Kwon JH, Kim NY, Sung YS, et al. Population-based and personalized reference intervals for liver and spleen volumes in healthy individuals and those with viral hepatitis. Radiology 2021;301:339-347 
  45. Kim JH, Yoon HJ, Lee E, Kim I, Cha YK, Bak SH. Validation of deep-learning image reconstruction for low-dose chest computed tomography scan: emphasis on image quality and noise. Korean J Radiol 2021;22:131-138 
  46. Kim K, Kim S, Han K, Bae H, Shin J, Lim JS. Diagnostic performance of deep learning-based lesion detection algorithm in CT for detecting hepatic metastasis from colorectal cancer. Korean J Radiol 2021;22:912-921 
  47. Kim M, Kim HS, Kim HJ, Park JE, Park SY, Kim YH, et al. Thin-slice pituitary MRI with deep learning-based reconstruction: diagnostic performance in a postoperative setting. Radiology 2021;298:114-122 
  48. Kim UH, Kim MY, Park EA, Lee W, Lim WH, Kim HL, et al. Deep learning-based algorithm for the detection and characterization of MRI safety of cardiac implantable electronic devices on chest radiographs. Korean J Radiol 2021;22:1918-1928 
  49. Lee JG, Kim H, Kang H, Koo HJ, Kang JW, Kim YH, et al. Fully automatic coronary calcium score software empowered by artificial intelligence technology: validation study using three CT cohorts. Korean J Radiol 2021;22:1764-1776 
  50. Lee KC, Lee KH, Kang CH, Ahn KS, Chung LY, Lee JJ, et al. Clinical validation of a deep learning-based hybrid (Greulich-Pyle and modified Tanner-Whitehouse) method for bone age assessment. Korean J Radiol 2021;22:2017-2025 
  51. Lee S, Yim JJ, Kwak N, Lee YJ, Lee JK, Lee JY, et al. Deep learning to determine the activity of pulmonary tuberculosis on chest radiographs. Radiology 2021;301:435-442 
  52. Park HS, Jeon K, Cho YJ, Kim SW, Lee SB, Choi G, et al. Diagnostic performance of a new convolutional neural network algorithm for detecting developmental dysplasia of the hip on anteroposterior radiographs. Korean J Radiol 2021;22:612-623 
  53. Shin NY, Bang M, Yoo SW, Kim JS, Yun E, Yoon U, et al. Cortical thickness from MRI to predict conversion from mild cognitive impairment to dementia in Parkinson disease: a machine learning-based model. Radiology 2021;300:390-399 
  54. Sung J, Park S, Lee SM, Bae W, Park B, Jung E, et al. Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 2021;299:450-459 
  55. Yeoh H, Hong SH, Ahn C, Choi JY, Chae HD, Yoo HJ, et al. Deep learning algorithm for simultaneous noise reduction and edge sharpening in low-dose CT images: a pilot study using lumbar spine CT. Korean J Radiol 2021;22:1850-1857 
  56. Yoo SJ, Yoon SH, Lee JH, Kim KH, Choi HI, Park SJ, et al. Automated lung segmentation on chest computed tomography images with extensive lung parenchymal abnormalities using a deep neural network. Korean J Radiol 2021;22:476-488 
  57. Bae K, Oh DY, Yun ID, Jeon KN. Bone suppression on chest radiographs for pulmonary nodule detection: comparison between a generative adversarial network and dual-energy subtraction. Korean J Radiol 2022;23:139-149 
  58. Chang S, Han K, Lee S, Yang YJ, Kim PK, Choi BW, et al. Automated measurement of native T1 and extracellular volume fraction in cardiac magnetic resonance imaging using a commercially available deep learning algorithm. Korean J Radiol 2022;23:1251-1259 
  59. Choe J, Hwang HJ, Seo JB, Lee SM, Yun J, Kim MJ, et al. Content-based image retrieval by using deep learning for interstitial lung disease diagnosis with chest CT. Radiology 2022;302:187-197 
  60. Choi JW, Cho YJ, Ha JY, Lee YY, Koh SY, Seo JY, et al. Deep learning-assisted diagnosis of pediatric skull fractures on plain radiographs. Korean J Radiol 2022;23:343-354 
  61. Heo S, Lee SS, Kim SY, Lim YS, Park HJ, Yoon JS, et al. Prediction of decompensation and death in advanced chronic liver disease using deep learning analysis of gadoxetic acid-enhanced MRI. Korean J Radiol 2022;23:1269-1280 
  62. Hong W, Hwang EJ, Lee JH, Park J, Goo JM, Park CM. Deep learning for detecting pneumothorax on chest radiographs after needle biopsy: clinical implementation. Radiology 2022;303:433-441 
  63. Kim YS, Jang MJ, Lee SH, Kim SY, Ha SM, Kwon BR, et al. Use of artificial intelligence for reducing unnecessary recalls at screening mammography: a simulation study. Korean J Radiol 2022;23:1241-1250 
  64. Lee JH, Kim KH, Lee EH, Ahn JS, Ryu JK, Park YM, et al. Improving the performance of radiologists using artificial intelligence-based detection support software for mammography: a multi-reader study. Korean J Radiol 2022;23:505-516 
  65. Lee JH, Lee D, Lu MT, Raghu VK, Park CM, Goo JM, et al. Deep learning to optimize candidate selection for lung cancer CT screening: advancing the 2021 USPSTF recommendations. Radiology 2022;305:209-218 
  66. Nam JG, Kang HR, Lee SM, Kim H, Rhee C, Goo JM, et al. Deep learning prediction of survival in patients with chronic obstructive pulmonary disease using chest radiographs. Radiology 2022;305:199-208 
  67. Nam JG, Park S, Park CM, Jeon YK, Chung DH, Goo JM, et al. Histopathologic basis for a chest CT deep learning survival prediction model in patients with lung adenocarcinoma. Radiology 2022;305:441-451 
  68. Otgonbaatar C, Ryu JK, Shin J, Woo JY, Seo JW, Shim H, et al. Improvement in image quality and visibility of coronary arteries, stents, and valve structures on CT angiography by deep learning reconstruction. Korean J Radiol 2022;23:1044-1054 
  69. Park HJ, Yoon JS, Lee SS, Suk HI, Park B, Sung YS, et al. Deep learning-based assessment of functional liver capacity using gadoxetic acid-enhanced hepatobiliary phase MRI. Korean J Radiol 2022;23:720-731 
  70. Park J, Shin J, Min IK, Bae H, Kim YE, Chung YE. Image quality and lesion detectability of lower-dose abdominopelvic CT obtained using deep learning image reconstruction. Korean J Radiol 2022;23:402-412 
  71. Park JH, Park I, Han K, Yoon J, Sim Y, Kim SJ, et al. Feasibility of deep learning-based analysis of auscultation for screening significant stenosis of native arteriovenous fistula for hemodialysis requiring angioplasty. Korean J Radiol 2022;23:949-958 
  72. Son W, Kim M, Hwang JY, Kim YW, Park C, Choo KS, et al. Comparison of a deep learning-based reconstruction algorithm with filtered back projection and iterative reconstruction algorithms for pediatric abdominopelvic CT. Korean J Radiol 2022;23:752-762 
  73. Yoo H, Kim EY, Kim H, Choi YR, Kim MY, Hwang SH, et al. Artificial intelligence-based identification of normal chest radiographs: a simulation study in a multicenter health screening cohort. Korean J Radiol 2022;23:1009-1018 
  74. Chae KJ, Lim S, Seo JB, Hwang HJ, Choi H, Lynch D, et al. Interstitial lung abnormalities at CT in the Korean National Lung Cancer Screening Program: prevalence and deep learning-based texture analysis. Radiology 2023;307:e222828 
  75. Hwang EJ, Goo JM, Nam JG, Park CM, Hong KJ, Kim KH. Conventional versus artificial intelligence-assisted interpretation of chest radiographs in patients with acute respiratory symptoms in emergency department: a pragmatic randomized clinical trial. Korean J Radiol 2023;24:259-270 
  76. Hwang HJ, Kim H, Seo JB, Ye JC, Oh G, Lee SM, et al. Generative adversarial network-based image conversion among different computed tomography protocols and vendors: effects on accuracy and variability in quantifying regional disease patterns of interstitial lung disease. Korean J Radiol 2023;24:807-820 
  77. Jeon SK, Lee JM, Joo I, Yoon JH, Lee G. Two-dimensional convolutional neural network using quantitative US for noninvasive assessment of hepatic steatosis in NAFLD. Radiology 2023;307:e221510 
  78. Kim H, Jin KN, Yoo SJ, Lee CH, Lee SM, Hong H, et al. Deep learning for estimating lung capacity on chest radiographs predicts survival in idiopathic pulmonary fibrosis. Radiology 2023;306:e220292 
  79. Kim M, Lee SM, Son IT, Park T, Oh BY. Prognostic value of artificial intelligence-driven, computed tomography-based, volumetric assessment of the volume and density of muscle in patients with colon cancer. Korean J Radiol 2023;24:849-859 
  80. Kim PH, Yoon HM, Kim JR, Hwang JY, Choi JH, Hwang J, et al. Bone age assessment using artificial intelligence in Korean pediatric population: a comparison of deep-learning models trained with healthy chronological and Greulich-Pyle ages as labels. Korean J Radiol 2023;24:1151-1163 
  81. Lee JH, Hong H, Nam G, Hwang EJ, Park CM. Effect of human-AI interaction on detection of malignant lung nodules on chest radiographs. Radiology 2023;307:e222976 
  82. Nam JG, Hwang EJ, Kim J, Park N, Lee EH, Kim HJ, et al. AI improves nodule detection on chest radiographs in a health screening population: a randomized controlled trial. Radiology 2023;307:e221894 
  83. Park H, Yun J, Lee SM, Hwang HJ, Seo JB, Jung YJ, et al. Deep learning-based approach to predict pulmonary function at chest CT. Radiology 2023;307:e221488 
  84. Park HJ, Shin K, You MW, Kyung SG, Kim SY, Park SH, et al. Deep learning-based detection of solid and cystic pancreatic neoplasms at contrast-enhanced CT. Radiology 2023;306:140-149 
  85. Park S, Ye JC, Lee ES, Cho G, Yoon JW, Choi JH, et al. Deep learning-enabled detection of pneumoperitoneum in supine and erect abdominal radiography: modeling using transfer learning and semi-supervised learning. Korean J Radiol 2023;24:541-552 
  86. Woo C, Jo KH, Sohn B, Park K, Cho H, Kang WJ, et al. Development and testing of a machine learning model using 18F-fluorodeoxyglucose PET/CT-derived metabolic parameters to classify human papillomavirus status in oropharyngeal squamous carcinoma. Korean J Radiol 2023;24:51-61 
  87. Yun J, Ahn Y, Cho K, Oh SY, Lee SM, Kim N, et al. Deep learning for automated triaging of stable chest radiographs in a follow-up setting. Radiology 2023;309:e230606 
  88. Pearce FJ, Cruz Rivera S, Liu X, Manna E, Denniston AK, Calvert MJ. The role of patient-reported outcome measures in trials of artificial intelligence health technologies: a systematic evaluation of ClinicalTrials.gov records (1997-2022). Lancet Digit Health 2023;5:e160-e167 
  89. Vodicka E, Kim K, Devine EB, Gnanasakthy A, Scoggins JF, Patrick DL. Inclusion of patient-reported outcome measures in registered clinical trials: evidence from ClinicalTrials.gov (2007-2013). Contemp Clin Trials 2015;43:1-9 
  90. Park SH, Choi JI, Fournier L, Vasey B. Randomized clinical trials of artificial intelligence in medicine: why, when, and how? Korean J Radiol 2022;23:1119-1125 
  91. Park SH, Sul AR, Han K, Sung YS. How to determine if one diagnostic method, such as an artificial intelligence model, is superior to another: Beyond performance metrics. Korean J Radiol 2023;24:601-605 
  92. Park SH, Choi J, Byeon JS. Key principles of clinical validation, device approval, and insurance coverage decisions of artificial intelligence. Korean J Radiol 2021;22:442-453 
  93. Bold B, Lkhagvajav Z, Dorjsuren B. Role of artificial intelligence in achieving universal health coverage: a Mongolian perspective. Korean J Radiol 2023;24:821-824 
  94. Dagvasumberel G, Bold B, Dagvasumberel M. The growing problem of radiologist shortage: Mongolia's perspective. Korean J Radiol 2023;24:938-940 
  95. Goh CXY, Ho FCH. The growing problem of radiologist shortages: perspectives from Singapore. Korean J Radiol 2023;24:1176-1178 
  96. Lai AYT. The growing problem of radiologist shortage: Hong Kong's perspective. Korean J Radiol 2023;24:931-932 
  97. Meng F, Zhan L, Liu S, Zhang H. The growing problem of radiologist shortage: China's perspective. Korean J Radiol 2023;24:1046-1048 
  98. Shen SH, Chiou HJ. The growing problem of radiologist shortage: Taiwan's perspective. Korean J Radiol 2023;24:1049-1051 
  99. Vu LD, Nguyen HTT, Nguyen TN, Pham TM. The growing problem of radiologist shortage: Vietnam's perspectives. Korean J Radiol 2023;24:1054-1056