Imaging Science in Dentistry

Korean Academy of Oral and Maxillofacial Radiology (대한영상치의학회)
권호 표지
DOI QR코드

DOI QR Code

Evaluation of the clinical efficacy of a TW3-based fully automated bone age assessment system using deep neural networks

  • Shin, Nan-Young (Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University) ;
  • Lee, Byoung-Dai (Center for Artificial Intelligence in Medicine and Imaging) ;
  • Kang, Ju-Hee (Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University) ;
  • Kim, Hye-Rin (Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University) ;
  • Oh, Dong Hyo (Center for Artificial Intelligence in Medicine and Imaging) ;
  • Lee, Byung Il (Center for Artificial Intelligence in Medicine and Imaging) ;
  • Kim, Sung Hyun (Center for Artificial Intelligence in Medicine and Imaging) ;
  • Lee, Mu Sook (Department of Radiology, Keimyung University, Dongsan Hospital) ;
  • Heo, Min-Suk (Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University)
  • Received : 2020.03.25
  • Accepted : 2020.05.21
  • Published : 2020.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The aim of this study was to evaluate the clinical efficacy of a Tanner-Whitehouse 3 (TW3)-based fully automated bone age assessment system on hand-wrist radiographs of Korean children and adolescents. Materials and Methods: Hand-wrist radiographs of 80 subjects (40 boys and 40 girls, 7-15 years of age) were collected. The clinical efficacy was evaluated by comparing the bone ages that were determined using the system with those from the reference standard produced by 2 oral and maxillofacial radiologists. Comparisons were conducted using the paired t-test and simple regression analysis. Results: The bone ages estimated with this bone age assessment system were not significantly different from those obtained with the reference standard (P>0.05) and satisfied the equivalence criterion of 0.6 years within the 95% confidence interval (-0.07 to 0.22), demonstrating excellent performance of the system. Similarly, in the comparisons of gender subgroups, no significant difference in bone age between the values produced by the system and the reference standard was observed (P>0.05 for both boys and girls). The determination coefficients obtained via regression analysis were 0.962, 0.945, and 0.952 for boys, girls, and overall, respectively (P=0.000); hence, the radiologist-determined bone ages and the system-determined bone ages were strongly correlated. Conclusion: This TW3-based system can be effectively used for bone age assessment based on hand-wrist radiographs of Korean children and adolescents.

Keywords

References

  1. Benjavongkulchai S, Pittayapat P. Age estimation methods using hand and wrist radiographs in a group of contemporary Thais. Forensic Sci Int 2018; 287: 218.e1-8. https://doi.org/10.1016/j.forsciint.2018.03.045
  2. Spampinato C, Palazzo S, Giordano D, Aldinucci M, Leonardi R. Deep learning for automated skeletal bone age assessment in X-ray images. Med Image Anal 2017; 36: 41-51. https://doi.org/10.1016/j.media.2016.10.010
  3. Gilsanz V, Ratib O. Hand bone age: A digital atlas of skeletal maturity. Berlin: Springer; 2005.
  4. Tanner JM, Healy MJR, Cameron N, Goldstein H. Assessment of skeletal maturity and prediction of adult height (TW3 method). Philadelphia: W. B. Saunders; 2001.
  5. Fishman LS. Radiographic evaluation of skeletal maturation. A clinically oriented method based on hand-wrist films. Angle Orthod 1982; 52: 88-112.
  6. Tristan-Vega A, Arribas JI. A radius and ulna TW3 bone age assessment. IEEE Trans Biomed Eng 2008; 55: 1463-76. https://doi.org/10.1109/TBME.2008.918554
  7. Thodberg HH, Kreiborg S, Juul A, Pedersen KD. The BoneXpert method for automated determination of skeletal maturity. IEEE Trans Med Imaging 2009; 28: 52-66. https://doi.org/10.1109/TMI.2008.926067
  8. Liu J, Qi J, Liu Z, Ning Q, Luo X. Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method. Comput Med Imaging Graph 2008; 32: 678-84. https://doi.org/10.1016/j.compmedimag.2008.08.005
  9. Gulshan, V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016; 316: 2402-10. https://doi.org/10.1001/jama.2016.17216
  10. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542: 115-8. https://doi.org/10.1038/nature21056
  11. Ardila D, Kiraly AP, Bharadwaj S, Choi B, Reicher JJ, Peng L, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med 2019; 25: 954-61. https://doi.org/10.1038/s41591-019-0447-x
  12. McKinney SM, Sieniek M, Godbole V, Godwin J, Antropova N, Ashrafian H, et al. International evaluation of an AI system for breast cancer screening. Nature 2020; 577: 89-94. https://doi.org/10.1038/s41586-019-1799-6
  13. Lee H, Tajmir S, Lee J, Zissen M, Yeshiwas BA, Alkasab TK, et al. Fully automated deep learning system for bone age assessment. J Digit Imaging 2017; 30: 427-41. https://doi.org/10.1007/s10278-017-9955-8
  14. Kim JR, Shim WH, Yoon HM, Hong SH, Lee JS, Cho YA, et al. Computerized bone age estimation using deep learning based program: evaluation of the accuracy and efficiency. AJR Am J Roentgenol 2017; 209: 1374-80. https://doi.org/10.2214/AJR.17.18224
  15. Ren X, Li T, Yang X, Wang S, Ahmad S, Xiang L, et al. Regression convolutional neural network for automated pediatric bone age assessment from hand radiograph. IEEE J Biomed Health Inform 2019; 23: 2030-8. https://doi.org/10.1109/JBHI.2018.2876916
  16. Son SJ, Song Y, Kim N, Do Y, Kwak N, Lee MS, et al. TW3-based fully automated bone age assessment system using deep neural networks. IEEE Access 2019; 7: 33346-58. https://doi.org/10.1109/ACCESS.2019.2903131
  17. Iglovikov VI, Rakhlin A, Kalinin AA, Shvets AA. Paediatric bone age assessment using deep convolutional neural networks. In: Stoyanov D, Taylor Z, Carneiro G, Syeda-Mahmood T, Martel A, Maier-Hein L, et al. Deep learning in medical image analysis and multimodal learning for clinical decision support. Cham: Springer; 2018. p. 300-8.