DOI QR코드

DOI QR Code

Diagnosis and prediction of periodontally compromised teeth using a deep learning-based convolutional neural network algorithm

  • Lee, Jae-Hong (Department of Periodontology, Daejeon Dental Hospital, Institute of Wonkwang Dental Research, Wonkwang University College of Dentistry) ;
  • Kim, Do-hyung (Department of Periodontology, Daejeon Dental Hospital, Institute of Wonkwang Dental Research, Wonkwang University College of Dentistry) ;
  • Jeong, Seong-Nyum (Department of Periodontology, Daejeon Dental Hospital, Institute of Wonkwang Dental Research, Wonkwang University College of Dentistry) ;
  • Choi, Seong-Ho (Department of Periodontology, Research Institute for Periodontal Regeneration, Yonsei University College of Dentistry)
  • 투고 : 2018.03.19
  • 심사 : 2018.04.23
  • 발행 : 2018.04.30

초록

Purpose: The aim of the current study was to develop a computer-assisted detection system based on a deep convolutional neural network (CNN) algorithm and to evaluate the potential usefulness and accuracy of this system for the diagnosis and prediction of periodontally compromised teeth (PCT). Methods: Combining pretrained deep CNN architecture and a self-trained network, periapical radiographic images were used to determine the optimal CNN algorithm and weights. The diagnostic and predictive accuracy, sensitivity, specificity, positive predictive value, negative predictive value, receiver operating characteristic (ROC) curve, area under the ROC curve, confusion matrix, and 95% confidence intervals (CIs) were calculated using our deep CNN algorithm, based on a Keras framework in Python. Results: The periapical radiographic dataset was split into training (n=1,044), validation (n=348), and test (n=348) datasets. With the deep learning algorithm, the diagnostic accuracy for PCT was 81.0% for premolars and 76.7% for molars. Using 64 premolars and 64 molars that were clinically diagnosed as severe PCT, the accuracy of predicting extraction was 82.8% (95% CI, 70.1%-91.2%) for premolars and 73.4% (95% CI, 59.9%-84.0%) for molars. Conclusions: We demonstrated that the deep CNN algorithm was useful for assessing the diagnosis and predictability of PCT. Therefore, with further optimization of the PCT dataset and improvements in the algorithm, a computer-aided detection system can be expected to become an effective and efficient method of diagnosing and predicting PCT.

키워드

참고문헌

  1. Tonetti MS, Jepsen S, Jin L, Otomo-Corgel J. Impact of the global burden of periodontal diseases on health, nutrition and wellbeing of mankind: a call for global action. J Clin Periodontol 2017;44:456-62. https://doi.org/10.1111/jcpe.12732
  2. Lee JH, Lee JS, Choi JK, Kweon HI, Kim YT, Choi SH. National dental policies and socio-demographic factors affecting changes in the incidence of periodontal treatments in Korean: A nationwide populationbased retrospective cohort study from 2002-2013. BMC Oral Health 2016;16:118. https://doi.org/10.1186/s12903-016-0310-0
  3. Lee JH, Oh JY, Choi JK, Kim YT, Park YS, Jeong SN, et al. Trends in the incidence of tooth extraction due to periodontal disease: results of a 12-year longitudinal cohort study in South Korea. J Periodontal Implant Sci 2017;47:264-72. https://doi.org/10.5051/jpis.2017.47.5.264
  4. Lee JH, Lee JS, Park JY, Choi JK, Kim DW, Kim YT, et al. Association of lifestyle-related comorbidities with periodontitis: a nationwide cohort study in Korea. Medicine (Baltimore) 2015;94:e1567. https://doi.org/10.1097/MD.0000000000001567
  5. Lee JH, Choi JK, Kim SH, Cho KH, Kim YT, Choi SH, et al. Association between periodontal flap surgery for periodontitis and vasculogenic erectile dysfunction in Koreans. J Periodontal Implant Sci 2017;47:96-105. https://doi.org/10.5051/jpis.2017.47.2.96
  6. Lee JH, Oh JY, Youk TM, Jeong SN, Kim YT, Choi SH. Association between periodontal disease and noncommunicable diseases: A 12-year longitudinal health-examinee cohort study in South Korea. Medicine (Baltimore) 2017;96:e7398. https://doi.org/10.1097/MD.0000000000007398
  7. Choi JK, Kim YT, Kweon HI, Park EC, Choi SH, Lee JH. Effect of periodontitis on the development of osteoporosis: results from a nationwide population-based cohort study (2003-2013). BMC Womens Health 2017;17:77. https://doi.org/10.1186/s12905-017-0440-9
  8. Lee JH, Kweon HH, Choi JK, Kim YT, Choi SH. Association between periodontal disease and prostate cancer: results of a 12-year longitudinal cohort study in South Korea. J Cancer 2017;8:2959-65. https://doi.org/10.7150/jca.20532
  9. Graziani F, Karapetsa D, Alonso B, Herrera D. Nonsurgical and surgical treatment of periodontitis: how many options for one disease? Periodontol 2000 2017;75:152-88. https://doi.org/10.1111/prd.12201
  10. Martins SH, Novaes AB Jr, Taba M Jr, Palioto DB, Messora MR, Reino DM, et al. Effect of surgical periodontal treatment associated to antimicrobial photodynamic therapy on chronic periodontitis: A randomized controlled clinical trial. J Clin Periodontol 2017;44:717-28. https://doi.org/10.1111/jcpe.12744
  11. Ainamo J, Barmes D, Beagrie G, Cutress T, Martin J, Sardo-Infirri J. Development of the World Health Organization (WHO) community periodontal index of treatment needs (CPITN). Int Dent J 1982;32:281-91.
  12. Sklan JE, Plassard AJ, Fabbri D, Landman BA. Toward content based image retrieval with deep convolutional neural networks. Proc SPIE Int Soc Opt Eng 2015;9417.
  13. Rajpurkar P, Irvin J, Zhu K, Yang B, Mehta H, Duan T, et al. CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv e-print 2017;arXiv:1711.05225.
  14. Rajpurkar P, Hannun AY, Haghpanahi M, Bourn C, Ng AY. Cardiologist-level arrhythmia detection with convolutional neural networks. arXiv e-print 2017:arXiv:1707.01836.
  15. Garcia-Hernandez JJ, Gomez-Flores W, Rubio-Loyola J. Analysis of the impact of digital watermarking on computer-aided diagnosis in medical imaging. Comput Biol Med 2016;68:37-48. https://doi.org/10.1016/j.compbiomed.2015.10.014
  16. Litjens G, Kooi T, Bejnordi BE, Setio AA, Ciompi F, Ghafoorian M, et al. A survey on deep learning in medical image analysis. Med Image Anal 2017;42:60-88. https://doi.org/10.1016/j.media.2017.07.005
  17. Kim TS, Obst C, Zehaczek S, Geenen C. Detection of bone loss with different X-ray techniques in periodontal patients. J Periodontol 2008;79:1141-9. https://doi.org/10.1902/jop.2008.070578
  18. Armitage GC. Periodontal diagnoses and classification of periodontal diseases. Periodontol 2000 2004;34:9-21. https://doi.org/10.1046/j.0906-6713.2002.003421.x
  19. Page RC, Eke PI. Case definitions for use in population-based surveillance of periodontitis. J Periodontol 2007;78 (7 Suppl):1387-99. https://doi.org/10.1902/jop.2007.060264
  20. Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computeraided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 2016;35:1285-98. https://doi.org/10.1109/TMI.2016.2528162
  21. Ohsugi H, Tabuchi H, Enno H, Ishitobi N. Accuracy of deep learning, a machine-learning technology, using ultra-wide-field fundus ophthalmoscopy for detecting rhegmatogenous retinal detachment. Sci Rep 2017;7:9425. https://doi.org/10.1038/s41598-017-09891-x
  22. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv e-print 2014:arXiv:1409.556.
  23. Nair V, Hinton GE. Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on International Conference on Machine Learning; 2010 Jun 21-24; Haifa. Madison (WI): Omnipress; 2010. p.807-14.
  24. Chollet F. Keras [Internet]. San Francisco (CA): GitHub, Inc.; 2017 [cited 2018 Mar 19]. Available from: https://github.com/keras-team/keras.
  25. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv e-print 2016:arXiv:1603.04467.
  26. Lehman CD, Wellman RD, Buist DS, Kerlikowske K, Tosteson AN, Miglioretti DL. Diagnostic accuracy of digital screening mammography with and without computer-aided detection. JAMA Intern Med 2015;175:1828-37. https://doi.org/10.1001/jamainternmed.2015.5231
  27. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402-10. https://doi.org/10.1001/jama.2016.17216
  28. Lakhani P, Sundaram B. Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 2017;284:574-82. https://doi.org/10.1148/radiol.2017162326
  29. Wang R. Edge detection using convolutional neural network. In: Cheng L, Liu Q, Ronzhin A, editors. Advances in neural networks - ISNN 2016. 13th International Symposium on Neural Networks, ISNN 2016; 2016 Jul 6-8; Saint Petersburg. Cham: Springer International Publishing; 2016. p.12-20.
  30. Ouyang W, Wang X. Joint deep learning for pedestrian detection. 2013 IEEE International Conference on Computer Vision (ICCV); 2013 Dec 1-8; Sydney. Piscataway (NJ): IEEE; 2013. p.2056-63.
  31. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016 Jun 26-Jul 1; Las Vegas Valley (NV). Piscataway (NJ): IEEE; 2016. p.2818-26.
  32. Keskar NS, Mudigere D, Nocedal J, Smelyanskiy M, Tang PT. On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. arXiv e-print 2017;arXiv:1609.0483.
  33. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017;542:115-8. https://doi.org/10.1038/nature21056
  34. Peng X, Sun B, Ali K, Saenko K. Learning deep object detectors from 3D models. 2015 IEEE International Conference on Computer Vision (ICCV); 2015 Dec 7-13; Santiago. Piscataway (NJ): IEEE; 2015. p.1278-86

피인용 문헌

  1. The importance of basic and engineering sciences for next generation research in the field of oral and maxillofacial surgery vol.44, pp.4, 2018, https://doi.org/10.5125/jkaoms.2018.44.4.141
  2. Deep Learning for the Radiographic Detection of Periodontal Bone Loss vol.9, pp.None, 2018, https://doi.org/10.1038/s41598-019-44839-3
  3. The Use of Deep Convolutional Neural Networks in Biomedical Imaging: A Review vol.11, pp.1, 2018, https://doi.org/10.4103/jofs.jofs_55_19
  4. An overview of deep learning in the field of dentistry vol.49, pp.1, 2019, https://doi.org/10.5624/isd.2019.49.1.1
  5. Low Complexity Adaptive Nonlinear Models for the Diagnosis of Periodontal Disease vol.9, pp.None, 2018, https://doi.org/10.2174/2210327909666191211125358
  6. Predicting the Debonding of CAD/CAM Composite Resin Crowns with AI vol.98, pp.11, 2018, https://doi.org/10.1177/0022034519867641
  7. Future of periodontics lies in artificial intelligence: Myth or reality? vol.10, pp.4, 2019, https://doi.org/10.1111/jicd.12423
  8. Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics vol.46, pp.13, 2018, https://doi.org/10.1007/s00259-019-04372-x
  9. Effectiveness of Artificial Intelligence Applications Designed for Endodontic Diagnosis, Decision-making, and Prediction of Prognosis: A Systematic Review vol.21, pp.8, 2018, https://doi.org/10.5005/jp-journals-10024-2894
  10. Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network vol.26, pp.1, 2018, https://doi.org/10.1111/odi.13223
  11. The use and performance of artificial intelligence applications in dental and maxillofacial radiology: A systematic review vol.49, pp.1, 2018, https://doi.org/10.1259/dmfr.20190107
  12. Neural Network Detection and Segmentation of Mental Foramen in Panoramic Imaging vol.44, pp.3, 2020, https://doi.org/10.17796/1053-4625-44.3.6
  13. Develop and Evaluate a New and Effective Approach for Predicting Dyslipidemia in Steel Workers vol.8, pp.None, 2018, https://doi.org/10.3389/fbioe.2020.00839
  14. Dental Images Recognition Technology and Applications: A Literature Review vol.10, pp.8, 2020, https://doi.org/10.3390/app10082856
  15. A preliminary application of intraoral Doppler ultrasound images to deep learning techniques for predicting late cervical lymph node metastasis in early tongue cancers vol.17, pp.2, 2018, https://doi.org/10.1002/osi2.1039
  16. Radiomics and Machine Learning in Oral Healthcare vol.14, pp.3, 2018, https://doi.org/10.1002/prca.201900040
  17. Implementing Artificial Intelligence and Digital Health in Resource-Limited Settings? Top 10 Lessons We Learned in Congenital Heart Defects and Cardiology vol.24, pp.5, 2020, https://doi.org/10.1089/omi.2019.0142
  18. Artificial Intelligence (AI)-Driven Molar Angulation Measurements to Predict Third Molar Eruption on Panoramic Radiographs vol.17, pp.10, 2018, https://doi.org/10.3390/ijerph17103716
  19. Applications of Machine Learning Predictive Models in the Chronic Disease Diagnosis vol.10, pp.2, 2020, https://doi.org/10.3390/jpm10020021
  20. Clinical applications and performance of intelligent systems in dental and maxillofacial radiology: A review vol.50, pp.2, 2020, https://doi.org/10.5624/isd.2020.50.2.81
  21. Deep Neural Networks for Dental Implant System Classification vol.10, pp.7, 2018, https://doi.org/10.3390/biom10070984
  22. A Performance Comparison between Automated Deep Learning and Dental Professionals in Classification of Dental Implant Systems from Dental Imaging: A Multi-Center Study vol.10, pp.11, 2018, https://doi.org/10.3390/diagnostics10110910
  23. A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks vol.17, pp.22, 2018, https://doi.org/10.3390/ijerph17228447
  24. Deep Learning Hybrid Method to Automatically Diagnose Periodontal Bone Loss and Stage Periodontitis vol.10, pp.None, 2020, https://doi.org/10.1038/s41598-020-64509-z
  25. Automatic diagnosis for cysts and tumors of both jaws on panoramic radiographs using a deep convolution neural network vol.49, pp.8, 2020, https://doi.org/10.1259/dmfr.20200185
  26. Demystifying artificial intelligence and deep learning in dentistry vol.35, pp.None, 2018, https://doi.org/10.1590/1807-3107bor-2021.vol35.0094
  27. Periapical Lesion Diagnosis Support System Based on X-ray Images Using Machine Learning Technique vol.12, pp.3, 2021, https://doi.org/10.5005/jp-journals-10015-1820
  28. Attitudes and perceptions of dental students towards artificial intelligence vol.85, pp.1, 2021, https://doi.org/10.1002/jdd.12385
  29. Developments, application, and performance of artificial intelligence in dentistry – A systematic review vol.16, pp.1, 2018, https://doi.org/10.1016/j.jds.2020.06.019
  30. Machine learning in dental, oral and craniofacial imaging: a review of recent progress vol.9, pp.None, 2021, https://doi.org/10.7717/peerj.11451
  31. Full Convolutional Network Algorithm Improves the Accuracy of the Boundary of Orthographic Composite Images vol.1744, pp.4, 2021, https://doi.org/10.1088/1742-6596/1744/4/042235
  32. Artificial Intelligence in Fractured Dental Implant Detection and Classification: Evaluation Using Dataset from Two Dental Hospitals vol.11, pp.2, 2018, https://doi.org/10.3390/diagnostics11020233
  33. Data mining artificial intelligence technology for college english test framework and performance analysis system vol.40, pp.2, 2018, https://doi.org/10.3233/jifs-189386
  34. Application of Artificial Intelligence in Dentistry vol.100, pp.3, 2021, https://doi.org/10.1177/0022034520969115
  35. Do Radiographic Assessments of Periodontal Bone Loss Improve with Deep Learning Methods for Enhanced Image Resolution? vol.21, pp.6, 2018, https://doi.org/10.3390/s21062013
  36. An artificial intelligence proposal to automatic teeth detection and numbering in dental bite-wing radiographs vol.79, pp.4, 2018, https://doi.org/10.1080/00016357.2020.1840624
  37. Promises and perils of artificial intelligence in dentistry vol.66, pp.2, 2018, https://doi.org/10.1111/adj.12812
  38. The Chairside Periodontal Diagnostic Toolkit: Past, Present, and Future vol.11, pp.6, 2018, https://doi.org/10.3390/diagnostics11060932
  39. Accurate age classification using manual method and deep convolutional neural network based on orthopantomogram images vol.135, pp.4, 2018, https://doi.org/10.1007/s00414-021-02542-x
  40. Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence vol.11, pp.9, 2021, https://doi.org/10.3390/diagnostics11091608
  41. Artificial intelligence system for automatic deciduous tooth detection and numbering in panoramic radiographs vol.50, pp.6, 2018, https://doi.org/10.1259/dmfr.20200172
  42. Refined tooth and pulp segmentation using U-Net in CBCT image vol.50, pp.6, 2018, https://doi.org/10.1259/dmfr.20200251
  43. Clinical, histological, and deep learning-based assessments and treatment of oral verruciform xanthoma: a case report vol.45, pp.3, 2018, https://doi.org/10.21851/obr.45.03.202109.150
  44. The Use and Performance of Artificial Intelligence in Prosthodontics: A Systematic Review vol.21, pp.19, 2018, https://doi.org/10.3390/s21196628
  45. Primary clinical study of radiomics for diagnosing simple bone cyst of the jaw vol.50, pp.7, 2021, https://doi.org/10.1259/dmfr.20200384
  46. Computer tomographic differential diagnosis of ameloblastoma and odontogenic keratocyst: classification using a convolutional neural network vol.50, pp.7, 2018, https://doi.org/10.1259/dmfr.20210002
  47. Performance analysis of classification and segmentation of cysts in panoramic dental images using convolutional neural network architecture vol.31, pp.4, 2021, https://doi.org/10.1002/ima.22625
  48. A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos vol.11, pp.1, 2018, https://doi.org/10.1038/s41598-021-96091-3
  49. Deep learning for early dental caries detection in bitewing radiographs vol.11, pp.1, 2018, https://doi.org/10.1038/s41598-021-96368-7
  50. A deep learning approach for dental implant planning in cone-beam computed tomography images vol.21, pp.1, 2018, https://doi.org/10.1186/s12880-021-00618-z
  51. Artificial intelligence in periodontics: A dip in the future vol.7, pp.2, 2018, https://doi.org/10.3233/jcb-210041
  52. A relation-based framework for effective teeth recognition on dental periapical X-rays vol.95, pp.None, 2018, https://doi.org/10.1016/j.compmedimag.2021.102022
  53. Current applications and development of artificial intelligence for digital dental radiography vol.51, pp.1, 2022, https://doi.org/10.1259/dmfr.20210197