DOI QR코드

DOI QR Code

Clinical Application of Artificial IntelligenceBased Detection Assistance Devices for Chest X-Ray Interpretation: Current Status and Practical Considerations

흉부 X선 인공지능 검출 보조 의료기기의 임상 적용: 현황 및 현실적 고려 사항

  • Eui Jin Hwang (Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine)
  • 황의진 (서울대학교 의과대학 서울대학교병원 영상의학과)
  • Received : 2024.04.12
  • Accepted : 2024.07.04
  • Published : 2024.07.01

Abstract

Artificial intelligence (AI) technology is actively being applied for the interpretation of medical imaging, such as chest X-rays. AI-based software medical devices, which automatically detect various types of abnormal findings in chest X-ray images to assist physicians in their interpretation, are actively being commercialized and clinically implemented in Korea. Several important issues need to be considered for AI-based detection assistant tools to be applied in clinical practice: the evaluation of performance and efficacy prior to implementation; the determination of the target application, range, and method of delivering results; and monitoring after implementation and legal liability issues. Appropriate decision making regarding these devices based on the situation in each institution is necessary. Radiologists must be engaged as medical assessment experts using the software for these devices as well as in medical image interpretation to ensure the safe and efficient implementation and operation of AI-based detection assistant tools.

흉부 X선은 인공지능 기술이 활발히 적용되고 있는 대표적인 영상 검사이다. 흉부 X선 영상에서 다양한 이상 소견을 자동으로 검출하여 의사의 판독을 보조하는 인공지능 기반 소프트웨어 의료기기들이 국내에서 시판되고 있고, 임상 적용이 활발히 이루어지고 있다. 이러한 흉부 X선 인공지능 검출 보조 의료기기의 임상 도입에 있어, 도입 전 성능 및 유효성 평가, 적용 대상, 분석 결과 제공의 대상 및 방식, 도입 후 모니터링, 법적 책임 문제 등 다양한 현실적인 사항에 대한 고려가 필요하고, 각 의료기관의 상황에 따른 적절한 의사결정이 필요하다. 인공지능 검출 보조 의료기기의 안전하고 효율적인 도입 및 운영을 위해서는 전문 지식을 갖춘 영상의학과 전문의의 적극적인 역할이 필수적이다.

Keywords

References

  1. Ehteshami Bejnordi B, Veta M, Johannes van Diest P, van Ginneken B, Karssemeijer N, Litjens G, et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 2017;318:2199-2210
  2. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017;542:115-118
  3. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402-2410
  4. Hwang EJ, Park S, Jin KN, Kim JI, Choi SY, Lee JH, et al. Development and validation of a deep learningbased automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Netw Open 2019;2:e191095
  5. Nam JG, Park S, Hwang EJ, Lee JH, Jin KN, Lim KY, et al. Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 2019;290:218-228
  6. Hwang EJ, Goo JM, Yoon SH, Beck KS, Seo JB, Choi BW, et al. Use of artificial intelligence-based software as medical devices for chest radiography: a position paper from the Korean Society of Thoracic Radiology. Korean J Radiol 2021;22:1743-1748
  7. Hwang EJ, Park CM. Clinical implementation of deep learning in thoracic radiology: potential applications and challenges. Korean J Radiol 2020;21:511-525
  8. Ministry of Food and Drug Safety. Medical device safety library. Available at. https://emedi.mfds.go.kr/search/data/MNU20237. Accessed June 14, 2024
  9. Hwang EJ, Park JE, Song KD, Yang DH, Kim KW, Lee JG, et al. 2023 survey on user experience of artificial intelligence software in radiology by the Korean Society of Radiology. Korean J Radiol 2024;25:613-622
  10. Allen B, Agarwal S, Coombs L, Wald C, Dreyer K. 2020 ACR data science institute artificial intelligence survey. J Am Coll Radiol 2021;18:1153-1159
  11. European Society of Radiology (ESR). Current practical experience with artificial intelligence in clinical radiology: a survey of the European Society of Radiology. Insights Imaging 2022;13:107
  12. Health Insurance Review and Assessment Service. Release of guideline for health insurance registration of digital treatment devices and artificial intelligence (AI). Available at. https://www.hira.or.kr/bbsDummy.do?pgmid=HIRAA020041000100&brdScnBltNo=4&brdBltNo=10957&pageIndex=1&pageIndex2=1. Published 2023. Accessed April 12, 2024
  13. Lunit Inc. Lunit INSIGHT CXR cleared approval as innovative medical technology. Available at. https://innovativecxr.lunit.io. Published 2023. Accessed April 12, 2024
  14. Hwang EJ, Park S, Jin KN, Kim JI, Choi SY, Lee JH, et al. Development and validation of a deep learning-based automatic detection algorithm for active pulmonary tuberculosis on chest radiographs. Clin Infect Dis 2019;69:739-747
  15. Nam JG, Kim M, Park J, Hwang EJ, Lee JH, Hong JH, et al. Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs. Eur Respir J 2021;57:2003061
  16. Lee JH, Sun HY, Park S, Kim H, Hwang EJ, Goo JM, et al. Performance of a deep learning algorithm compared with radiologic interpretation for lung cancer detection on chest radiographs in a health screening population. Radiology 2020;297:687-696
  17. Yoo H, Kim KH, Singh R, Digumarthy SR, Kalra MK. Validation of a deep learning algorithm for the detection of malignant pulmonary nodules in chest radiographs. JAMA Netw Open 2020;3:e2017135
  18. Hwang EJ, Nam JG, Lim WH, Park SJ, Jeong YS, Kang JH, et al. Deep learning for chest radiograph diagnosis in the emergency department. Radiology 2019;293:573-580
  19. Gelaw SM, Kik SV, Ruhwald M, Ongarello S, Egzertegegne TS, Gorbacheva O, et al. Diagnostic accuracy of three computer-aided detection systems for detecting pulmonary tuberculosis on chest radiography when used for screening: analysis of an international, multicenter migrants screening study. PLOS Glob Public Health 2023;3:e0000402
  20. Kagujje M, Kerkhoff AD, Nteeni M, Dunn I, Mateyo K, Muyoyeta M. The performance of computer-aided detection digital chest X-ray reading technologies for triage of active tuberculosis among persons with a history of previous tuberculosis. Clin Infect Dis 2023;76:e894-e901
  21. Qin ZZ, Ahmed S, Sarker MS, Paul K, Adel ASS, Naheyan T, et al. Tuberculosis detection from chest X-rays for triaging in a high tuberculosis-burden setting: an evaluation of five artificial intelligence algorithms. Lancet Digit Health 2021;3:e543-e554
  22. Nam JG, Hwang EJ, Kim J, Park N, Lee EH, Kim HJ, et al. AI improves nodule detection on chest radiographs in a health screening population: a randomized controlled trial. Radiology 2023;307:e221894
  23. Hong W, Hwang EJ, Lee JH, Park J, Goo JM, Park CM. Deep learning for detecting pneumothorax on chest radiographs after needle biopsy: clinical implementation. Radiology 2022;303:433-441
  24. Hwang EJ, Lee JS, Lee JH, Lim WH, Kim JH, Choi KS, et al. Deep learning for detection of pulmonary metastasis on chest radiographs. Radiology 2021;301:455-463
  25. Mongan J, Moy L, Kahn CE Jr. Checklist for artificial intelligence in medical imaging (CLAIM): a guide for authors and reviewers. Radiol Artif Intell 2020;2:e200029
  26. Hwang EJ, Goo JM, Nam JG, Park CM, Hong KJ, Kim KH. Conventional versus artificial intelligence-assisted interpretation of chest radiographs in patients with acute respiratory symptoms in emergency department: a pragmatic randomized clinical trial. Korean J Radiol 2023;24:259-270
  27. Hong S, Hwang EJ, Kim S, Song J, Lee T, Jo GD, et al. Methods of visualizing the results of an artificial-intelligence-based computer-aided detection system for chest radiographs: effect on the diagnostic performance of radiologists. Diagnostics (Basel) 2023;13:1089
  28. Allen B, Dreyer K, Stibolt R Jr, Agarwal S, Coombs L, Treml C, et al. Evaluation and real-world performance monitoring of artificial intelligence models in clinical practice: try it, buy it, check it. J Am Coll Radiol 2021;18:1489-1496
  29. Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, et al. Developing, purchasing, implementing and monitoring AI tools in radiology: practical considerations. A multi-society statement from the ACR, CAR, ESR, RANZCR & RSNA. J Am Coll Radiol 2024 Jan 23 [Epub]. https://doi.org/10.1016/j.jacr.2023.12.005
  30. Mello MM, Guha N. Understanding liability risk from using health care artificial intelligence tools. N Engl J Med 2024;390:271-278
  31. Jaremko JL, Azar M, Bromwich R, Lum A, Alicia Cheong LH, Gibert M, et al. Canadian Association of Radiologists white paper on ethical and legal issues related to artificial intelligence in radiology. Can Assoc Radiol J 2019;70:107-118
  32. Mezrich JL. Is artificial intelligence (AI) a pipe dream? Why legal issues present significant hurdles to AI autonomy. AJR Am J Roentgenol 2022;219:152-156
  33. O'Neill TJ, Xi Y, Stehel E, Browning T, Ng YS, Baker C, et al. Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head CT with intracranial hemorrhage. Radiol Artif Intell 2020;3:e200024
  34. An JY, Hwang EJ, Nam G, Lee SH, Park CM, Goo JM, et al. Artificial intelligence for assessment of endotracheal tube position on chest radiographs: validation in patients from two institutions. AJR Am J Roentgenol 2024;222:e2329769
  35. Baltruschat I, Steinmeister L, Nickisch H, Saalbach A, Grass M, Adam G, et al. Smart chest X-ray worklist prioritization using artificial intelligence: a clinical workflow simulation. Eur Radiol 2021;31:3837-3845
  36. Koo HJ, Do KH. The staffing crisis and burnout in academic radiology: insights from a survey study in Korea. J Am Coll Radiol 2024;21:505-514
  37. Plesner LL, Muller FC, Nybing JD, Laustrup LC, Rasmussen F, Nielsen OW, et al. Autonomous chest radiograph reporting using AI: estimation of clinical impact. Radiology 2023;307:e222268
  38. Yoo H, Kim EY, Kim H, Choi YR, Kim MY, Hwang SH, et al. Artificial intelligence-based identification of normal chest radiographs: a simulation study in a multicenter health screening cohort. Korean J Radiol 2022;23:1009-1018
  39. Jung KH. Uncover this tech term: foundation model. Korean J Radiol 2023;24:1038-1041
  40. Fei N, Lu Z, Gao Y, Yang G, Huo Y, Wen J, et al. Towards artificial general intelligence via a multimodal foundation model. Nat Commun 2022;13:3094
  41. Huang J, Neill L, Wittbrodt M, Melnick D, Klug M, Thompson M, et al. Generative artificial intelligence for chest radiograph interpretation in the emergency department. JAMA Netw Open 2023;6:e2336100
  42. Yun J, Ahn Y, Cho K, Oh SY, Lee SM, Kim N, et al. Deep learning for automated triaging of stable chest radiographs in a follow-up setting. Radiology 2023;309:e230606