The Journal of Korean Medicine (대한한의학회지)

The Society of Korean Medicine (대한한의학회)
권호 표지
DOI QR코드

DOI QR Code

Cold sensitivity classification using facial image based on convolutional neural network

  • lkoo Ahn (Korean Medicine Data Division, Korea Institute of Oriental Medicine ) ;
  • Younghwa Baek (Korean Medicine Data Division, Korea Institute of Oriental Medicine ) ;
  • Kwang-Ho Bae (Korean Medicine Data Division, Korea Institute of Oriental Medicine ) ;
  • Bok-Nam Seo (Clinical Medicine Division, Korea Institute of Oriental Medicine) ;
  • Kyoungsik Jung (Korean Medicine Data Division, Korea Institute of Oriental Medicine ) ;
  • Siwoo Lee (Korean Medicine Data Division, Korea Institute of Oriental Medicine )
  • Received : 2023.10.20
  • Accepted : 2023.08.26
  • Published : 2023.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives: Facial diagnosis is an important part of clinical diagnosis in traditional East Asian Medicine. In this paper, we proposed a model to quantitatively classify cold sensitivity using a fully automated facial image analysis system. Methods: We investigated cold sensitivity in 452 subjects. Cold sensitivity was determined using a questionnaire and the Cold Pattern Score (CPS) was used for analysis. Subjects with a CPS score below the first quartile (low CPS group) belonged to the cold non-sensitivity group, and subjects with a CPS score above the third quartile (high CPS group) belonged to the cold sensitivity group. After splitting the facial images into train/validation/test sets, the train and validation set were input into a convolutional neural network to learn the model, and then the classification accuracy was calculated for the test set. Results: The classification accuracy of the low CPS group and high CPS group using facial images in all subjects was 76.17%. The classification accuracy by sex was 69.91% for female and 62.86% for male. It is presumed that the deep learning model used facial color or facial shape to classify the low CPS group and the high CPS group, but it is difficult to specifically determine which feature was more important. Conclusions: The experimental results of this study showed that the low CPS group and the high CPS group can be classified with a modest level of accuracy using only facial images. There was a need to develop more advanced models to increase classification accuracy.

Keywords

Acknowledgement

This work was supported by the "Development of Korean Medicine Original Technology for Preventive Treatment Based on Integrative Big Data" grant from the Korea Institute of Oriental Medicine (KSN1731121).

References

  1. Ferreira AS, Lopes AJ. Chinese medicine pattern differentiation and its implications for clinical practice. Chin J Integr Med. 2011;17:818-23  https://doi.org/10.1007/s11655-011-0892-y
  2. World Health Organization. WHO international standard terminologies on traditional medicine in the western pacific region. Geneva: World Health Organization; 2007. 
  3. Bae KH, Jang ES, Park KH, Lee Y. Development on the Questionnaire of Cold-Heat Pattern Identification Based on Usual Symptoms: Reliability and validation Study. J Physiol & Pathol Korean Med. 2018;32:341-6.  https://doi.org/10.15188/kjopp.2018.10.32.5.341
  4. Park YJ, Nam JH, Yim MH, Kim H, Kim JY. A Study on the Diagnostic Elements of Cold-Heat Pattern Identification by Korean Medicine Doctors: Association with Objective and Subjective Body Temperature. Evid Based Complement Alternat Med. 2017:7593056. 
  5. Mun S, Kim S, Bae KH, Lee S. Cold and Spleen-Qi Deficiency Patterns in Korean Medicine Are Associated with Low Resting Metabolic Rate. Evid Based Complement Alternat Med. 2017;2017:9532073. 
  6. Nagashima K, Yoda T, Yagishita T, Taniguchi A, Hosono T, Kanosue K. Thermal regulation and comfort during a mild-cold exposure in young Japanese women complaining of unusual coldness. J Appl Physiol. 2002;92:1029-35.  https://doi.org/10.1152/japplphysiol.00399.2001
  7. Park YJ, Lee JM, Park YB. Relationships between oriental medical pattern diagnosis and cardiovascular autonomic function. Eur J Integr Med. 2013;5:506-13.  https://doi.org/10.1016/j.eujim.2013.07.007
  8. Kim SJ, Lee S, Lee Y. A Study on the Difference of Cold-heat Patterns between Health and Mibyeong Group. J Soc Prev Korean Med. 2017;21:49-56.  https://doi.org/10.25153/spkom.2017.21.1.006
  9. Bae KH, Lee JA, Park KH, Yoo JH, Lee Y, Lee S. Cold Hypersensitivity in the Hands and Feet May Be Associated with Functional Dyspepsia: Results of a Multicenter Survey Study. Evid Based Complement Alternat Med. 2016;2016:8948690. 
  10. Bae KH, Go HY, Park KH, Ahn I, Yoon Y, Lee S. The association between cold hypersensitivity in the hands and feet and chronic disease: results of a multicentre study. BMC Complement Altern Med. 2018;18:40. 
  11. Yoshino T, Katayama K, Munakata K, Horiba Y, Yamaguchi R, Imoto S, et al. Statistical analysis of hie (cold sensation) and hiesho (cold disorder) in kampo clinic. Evid Based Complement Alternat Med. 2013;2013:398458. 
  12. Bubnov R, Polivka J, Jr., Zubor P, Konieczka K, Golubnitschaja O. "Pre-metastatic niches" in breast cancer: are they created by or prior to the tumour onset? "Flammer Syndrome" relevance to address the question. EPMA J. 2017;8:141-57.  https://doi.org/10.1007/s13167-017-0092-8
  13. Li X., Li F., Wang Y., Qian P., Zheng X. Computer-aided disease diagnosis system in TCM based on facial image analysis. International Journal of Functional Informatics and Personalised Medicine. 2009;2(3):303-314. doi: 10.1504/ijfipm.2009.030829. 
  14. Wang X., Zhang B., Guo Z., Zhang D. Facial image medical analysis system using quantitative chromatic feature. Expert Systems with Applications. 2013;40(9):3738-3746. doi: 10.1016/j.eswa.2012.12.079. 
  15. Liu M., Guo Z. Medical Biometrics. Vol. 4901. Berlin, Germany: Springer; 2007. Hepatitis diagnosis using facial color image; pp. 160-167. (Lecture Notes in Computer Science). 
  16. Zhao C., Li G., Li F., Wang Z., Liu C. Qualitative and quantitative analysis for facial complexion in traditional chinese medicine. BioMed Research International. 2014;2014:17. doi: 10.1155/2014/207589.207589 
  17. Yanya C., Fufeng L., Yiqin W. Analysis on Facial Color Diagnosis for CHD Patients. Chinese Arch. Tradit. Chinese Med. 2013;31(9):1-2. 
  18. Zhang B., Kumar B. V. K. V., Zhang D. Noninvasive diabetes mellitus detection using facial block color with a sparse representation classifier. IEEE Transactions on Biomedical Engineering. 2014;61(4):1027-1033. doi: 10.1109/tbme.2013.2292936. 
  19. Xu J., Wu H., Lu L., et al. Analysis of different health status based on characteristics of the facial spectrum photometric color. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2012;29(6):1062-1067. 
  20. Wu H.-J., Xu J.-T., Lu L.-M., Chen X., Tu L.-P., Zhang Z.-F. Facial spectrum and color characteristics of five viscera reflecting on the face in sub-health status. Journal of Chinese Integrative Medicine. 2012;10(1):59-66. doi: 10.3736/jcim20120110. 
  21. Fu-feng L., Xiao-yan Z., Wang Y. Studies on the Relationship Between the Facial Complexion Characters and Kidney Function in TCM Clinical Syndrome of Chronic Renal failure. Chinese Arch. Tradit. Chinese Med. 2011;29(9):7-10. 
  22. Seo JH, Park YB, Park YJ. Reliable facial color analysis using a digital camera and its relationship with pathological patterns: A pilot study. European Journal of Integrative Medicine. 2014 Jun 1;6(3):322-7.  https://doi.org/10.1016/j.eujim.2014.02.002
  23. Mun S, Ahn I, Lee S. The Association of Quantitative Facial Color Features with Cold Pattern in Traditional East Asian Medicine. Evidence-Based Complement Altern Med. 2017;2017. 
  24. Ahn I, Bae KH, Jin HJ, Lee S, Ahn I, Bae KH, Jin HJ, Lee S. The Association between Facial Morphology and Cold Pattern. Journal of Korean Medicine. 2021 Dec 1;42(4):102-19.  https://doi.org/10.13048/jkm.21040
  25. Jin H-J, Baek Y, Kim H-S, Ryu J, Lee S. Constitutional multicenter bank linked to Sasang constitutional phenotypic data. BMC Complement Altern Med. 2015;15:46. doi:10.1186/s12906-015-0553-3 
  26. Bae KH, Yoon Y, Yeo M, Kim HS, Lee Y, Lee S. Development on the questionnaire of cold-heat pattern identification based on usual symptoms for health promotion-focused on agreement study. J Soc Prev Korean Med. 2016;20(2):17-26. 
  27. King DE. Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research. 2009;1;10:1755-8. 
  28. Gonzalez RC, Woods RE. Digital image processing, prentice hall. Upper Saddle River, NJ. 2008. 
  29. D. S. Ma, J. Correll, and B. Wittenbrink, "The Chicago face database: A free stimulus set of faces and norming data.," Behav. Res. Methods, vol. 47, pp. 1122-1135, 2015.  https://doi.org/10.3758/s13428-014-0532-5
  30. Weiss K, Khoshgoftaar TM, Wang D. A survey of transfer learning. Journal of Big data. 2016 Dec;3(1):1-40. DOI: 10.1186/s40537-016-0043-6 
  31. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 2014 Sep 4. DOI: 10.48550/arXiv.1409.1556 
  32. Yoo HJ, Jun KK. Data Augmentation for Image based Parking Space Classification Deep Model. Journal of KIISE (JOK). 2022 Feb;49(2):126-36. DOI: 10.5626/JOK.2022.49.2.126 
  33. Goodfellow I, Bengio Y, Courville A. Deep learning. MIT press; 2016 Nov 10.