Journal of dental hygiene science (치위생과학회지)

The Korean Society of Dental Hygiene Science (한국치위생과학회)
권호 표지
DOI QR코드

DOI QR Code

Feasibility Study of Google's Teachable Machine in Diagnosis of Tooth-Marked Tongue

  • Received : 2020.10.06
  • Accepted : 2020.11.05
  • Published : 2020.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Background: A Teachable Machine is a kind of machine learning web-based tool for general persons. In this paper, the feasibility of Google's Teachable Machine (ver. 2.0) was studied in the diagnosis of the tooth-marked tongue. Methods: For machine learning of tooth-marked tongue diagnosis, a total of 1,250 tongue images were used on Kaggle's web site. Ninety percent of the images were used for the training data set, and the remaining 10% were used for the test data set. Using Google's Teachable Machine (ver. 2.0), machine learning was performed using separated images. To optimize the machine learning parameters, I measured the diagnosis accuracies according to the value of epoch, batch size, and learning rate. After hyper-parameter tuning, the ROC (receiver operating characteristic) analysis method determined the sensitivity (true positive rate, TPR) and specificity (false positive rate, FPR) of the machine learning model to diagnose the tooth-marked tongue. Results: To evaluate the usefulness of the Teachable Machine in clinical application, I used 634 tooth-marked tongue images and 491 no-marked tongue images for machine learning. When the epoch, batch size, and learning rate as hyper-parameters were 75, 0.0001, and 128, respectively, the accuracy of the tooth-marked tongue's diagnosis was best. The accuracies for the tooth-marked tongue and the no-marked tongue were 92.1% and 72.6%, respectively. And, the sensitivity (TPR) and specificity (FPR) were 0.92 and 0.28, respectively. Conclusion: These results are more accurate than Li's experimental results calculated with convolution neural network. Google's Teachable Machines show good performance by hyper-parameters tuning in the diagnosis of the tooth-marked tongue. We confirmed that the tool is useful for several clinical applications.

Keywords

References

  1. Lopez-Ubeda P, Diaz-Galiano MC, Martin-Noguerol T, Urena-Lopez A, Martin-Valdivia MT, Luna A: Detection of unexpected findings in radiology reports: a comparative study of machine learning approaches. Expert Syst Appl 160: 113647, 2020. https://doi.org/10.1016/j.eswa.2020.113647
  2. Chamunyonga C, Edwards C, Caldwell P, Rutledge P, Burbery J: The impact of artificial intelligence and machine learning in radiation therapy: considerations for future curriculum enhancement. J Med Imaging Radiat Sci 51: 214-220, 2020. https://doi.org/10.1016/j.jmir.2020.01.008
  3. Abdalla-Aslan R, Yeshua T, Kabla D, Leichter I, Nadler C: An artificial intelligence system using machine-learning for automatic detection and classification of dental restorations in panoramic radiography. Oral Surg Oral Med Oral Pathol Oral Radiol 130: 593-602, 2020. https://doi.org/10.1016/j.oooo.2020.05.012
  4. Lee JH, Kim DH, Jeong SN, Choi SH: Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent 77: 106-111, 2018. https://doi.org/10.1016/j.jdent.2018.07.015
  5. Teachable machine: Train a computer to recognize your own images, sounds, & poses. Retrieved September 30, 2020, from https://teachablemachine.withgoogle.com# Google(2019, November 1).
  6. Jang KH, Jeong HJ: Oral anatomy. Komoonsa, Seoul, pp.47-142, 2005.
  7. Slavkin HC, Baum BJ: Relationship of dental and oral pathology to systemic illness. JAMA 284: 1215-1217, 2000. https://doi.org/10.1001/jama.284.10.1215
  8. Shi D, Tang C, Blackley SV, et al.: An annotated dataset of tongue images supporting geriatric disease diagnosis. Data Brief 32: 106153, 2020. https://doi.org/10.1016/j.dib.2020.106153
  9. Solos I, Liang Y: A historical evaluation of Chinese tongue diagnosis in the treatment of septicemic plague in the pre-antibiotic era, and as a new direction for revolutionary clinical research applications. J Integr Med 16: 141-146, 2018. https://doi.org/10.1016/j.joim.2018.04.001
  10. Hong SS: Diagnosis of oriental medicines. Koonja, Seoul, pp.54-55, 2009.
  11. Li X, Zhang Y, Cui Q, Yi X, Zhang Y: Tooth-marked tongue recognition using multiple instance learning and CNN features. IEEE Trans Cybern 49: 380-387, 2019. https://doi.org/10.1109/TCYB.2017.2772289
  12. Tooth-marked-tongue: Dataset. Retrieved September 30, 2020, from https://www.kaggle.com/clearhanhui/biyesheji#Kaggle(2020, March 11).
  13. Kaggle: Tour machine learning and data science community. etrieved September 30, 2020, from https://www.kaggle.com#Google(2010, April 1).
  14. Omar L, Ivrissimtzis I: Using theoretical ROC curves for analysing machine learning binary classifiers. Pattern Recognit Lett 128: 447-451, 2019. https://doi.org/10.1016/j.patrec.2019.10.004
  15. Cho KH, Kim JS, Hong JP, Eo GS: Tongue diagnosis for clinicians: integrating oriental and western medicines. Koonja, Seoul, pp.4-49, 2007.
  16. Im YG: Atlas of clinical diagnosis 2: tongue diagnosis. Jungdam, Seoul, pp.74-76, 2003.
  17. Ma J, Wen G, Wang C, Jiang L: Complexity perception classification method for tongue constitution recognition. Artif Intell Med 96: 123-133, 2019. https://doi.org/10.1016/j.artmed.2019.03.008
  18. Tania MH, Lwin K, Hossain MA: Advances in automated tongue diagnosis techniques. Integr Med Res 8: 42-56, 2019. https://doi.org/10.1016/j.imr.2018.03.001