DOI QR코드

DOI QR Code

Development of Deep Learning-based Clinical Decision Supporting Technique for Laryngeal Disease using Endoscopic Images

딥러닝 기반 후두부 질환 내시경 영상판독 보조기술 개발

  • Jung, In Ho (Interdisciplinary Program in Biomedical Engineering, College of Medicine, Pusan National University) ;
  • Hwang, Young Jun (Interdisciplinary Program in Biomedical Engineering, College of Medicine, Pusan National University) ;
  • Sung, Eui-Suk (Department of Otolaryngology-Head and Neck Surgery, College of Medicine, Pusan National University) ;
  • Nam, Kyoung Won (Interdisciplinary Program in Biomedical Engineering, College of Medicine, Pusan National University)
  • 정인호 (부산대학교 의과대학 의공학협동과정) ;
  • 황영준 (부산대학교 의과대학 의공학협동과정) ;
  • 성의숙 (부산대학교 의과대학 이비인후과학교실) ;
  • 남경원 (부산대학교 의과대학 의공학협동과정)
  • Received : 2021.12.23
  • Accepted : 2022.04.11
  • Published : 2022.04.30

Abstract

Purpose: To propose a deep learning-based clinical decision support technique for laryngeal disease on epiglottis, tongue and vocal cords. Materials and Methods: A total of 873 laryngeal endoscopic images were acquired from the PACS database of Pusan N ational University Yangsan Hospital. and VGG16 model was applied with transfer learning and fine-tuning. Results: The values of precision, recall, accuracy and F1-score for test dataset were 0.94, 0.97, 0.95 and 0.95 for epiglottis images, 0.91, 1.00, 0.95 and 0.95 for tongue images, and 0.90, 0.64, 0.73 and 0.75 for vocal cord images, respectively. Conclusion: Experimental results demonstrated that the proposed model have a potential as a tool for decision-supporting of otolaryngologist during manual inspection of laryngeal endoscopic images.

Keywords

Acknowledgement

This study was supported by a 2021 research grant from Pusan National University Yangsan Hospital.

References

  1. https://www.nhis.or.kr/nhis/together/wbhaea01600m01.do?mode=view&articleNo=13 8272 (Accessed on Dec 22, 2021)
  2. Jung YS. Human papillomavirus in head and neck cancer: several questions. Korean J Otorhinolaryngol-Head Neck Surg 2014;57(3):143-150. https://doi.org/10.3342/kjorl-hns.2014.57.3.143
  3. https://www.amc.seoul.kr/asan/healthinfo/disease/disease-Detail.do?contentId=33914 (Accessed on Dec 22, 2021)
  4. Sung J, Park S, Lee SM, Bae W, Park B, Jung E, et al. Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 2021;299:450-459. https://doi.org/10.1148/radiol.2021202818
  5. Han SM, Hwang SI, Lee HJ. The classification of renal cancer in 3-phase CT images using a deep learning method. J Digit Imaging 2019;32(4):638-643. https://doi.org/10.1007/s10278-019-00230-2
  6. Suh CH, Shim WH, Kim SJ, Roh JH, Lee JH, Kim MJ, et al. Development and validation of a deep learning-based automatic brain segmentation and classification algorithm for Alzheimer disease using 3D T1-weighted volumetric images. Am J Neuroradiol 2020;41(12):2227-2234. https://doi.org/10.3174/ajnr.a6848
  7. Yoon HJ, Kim S, Kim JH, Keum JS, Oh SI, Jo J, et al. A lesion-based convolutional neural network improves endoscopic detection and depth prediction of early gastric cancer. J Clin Med 2019;8(9):1310. https://doi.org/10.3390/jcm8091310
  8. Jin EH. Lee D, Bae JH, Kang HY, Kwak MS, Seo JY, et al. Improved accuracy in optical diagnosis of colorectal polyps using convolutional neural networks with visual explanations. Gastroenterology, 2020;158(8):2169-2179.e8. https://doi.org/10.1053/j.gastro.2020.02.036
  9. https://scienceon.kisti.re.kr/srch/selectPORSrchReport.do?cn=TRKO202000004396 (Acc essed on Dec 22, 2021)
  10. Amina B, Nadjia B, Azeddine B. Gastrointestinal image classification based on VGG16 and transfer learning. 2021 International Conference on Information Systems and Advanced Technologies (ICISAT). pp. 1-5.
  11. Kim GH, Sung ES, Nam KW. Automated laryngeal mass detection algorithm for home-based self-screening test based on convolutional neural network. Biomed Eng Online 2021;20(51):1-10. https://doi.org/10.1186/s12938-020-00840-w
  12. Yoo TK, Choi JY, Jang YI, Oh I, Ryu IH. Toward automated severe pharyngitis detection with smartphone camera using deep learning networks. Comput Biol Med 2020;125(103980):1-9.
  13. Cho WK, Choi SH. Comparison of convolutional neural network models for determination of vocal fold normality in laryngoscopic images. J voice 2020;S0892-1997(20):30292-30297.
  14. Cho WK, Lee YJ, Joo HA, Jeong IS, Choi Y, Nam SY, et al. Diagnostic accuracies of laryngeal disease using a convolutional neural network-based image classification system. Laryngoscope 2021;131(11):2558-2566. https://doi.org/10.1002/lary.29595
  15. https://towardsdatascience.com/transfer-learning-from-pretrained-models-f2393f124751 (Accessed on Dec 22, 2021)