DOI QR코드

DOI QR Code

Inter-rater Reliability Study on Pattern Identification Using Nasal Endoscopy for Rhinitis

비내시경 활용 비염 변증 지표의 평가자 간 신뢰도 연구

  • Min, Kyung-Jin (Dept. of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Woosuk University) ;
  • Son, Mi-Ju (Clinical Research Division, Korea Institute of Oriental Medicine) ;
  • Kim, Young-Eun (Mibyeong Research Center, Korea Institute of Oriental Medicine) ;
  • Kim, Jeong-Hun (Evidence-based Healthcare Research Collaborating Center, Woosuk University) ;
  • Lee, Dong-Hyo (Dept. of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Woosuk University)
  • 민경진 (우석대학교 한의과대학 한방안이비인후피부과학교실) ;
  • 손미주 (한국한의학연구원, 임상연구부) ;
  • 김영은 (한국한의학연구원, 미병연구단) ;
  • 김정훈 (우석대학교 근거중심보건의료연구협력센터) ;
  • 이동효 (우석대학교 한의과대학 한방안이비인후피부과학교실)
  • Received : 2017.10.16
  • Accepted : 2017.11.07
  • Published : 2017.11.25

Abstract

Objectives : To identify whether pattern identification using nasal endoscopy for rhinitis can be applied as a tool for evaluating rhinitis in routine care setting, we performed a inter-rater reliability study on this pattern identification. Methods : Two Korean medicine doctors assessed 290 left/right nasal endoscopy photograph cases of rhinitis patients with pattern identification using nasal endoscopy. This pattern identification consist of four assessment items, nasal membrane color(pale/hyperemia), nasal membrane humidity(dryness/dampness), rhinorrhea(watery/yellow), and turbinate membrane edema(atrophic/edematous). Cohen's kappa statistic and Percentage agreement were used to evaluate the inter-rater reliability. Results : Inter-rater percentage agreement and Kappa coefficient for left nasal endoscopy photograph cases was from 'slight' to 'moderate'(% agreement: 40.00-67.59%/Kappa: 0.06-0.407). Only the agreement of 'rhinorrhea (watery/yellow)' item was moderate(% agreement: 67.59%/Kappa: 0.407). Inter-rater percentage agreement and Kappa coefficient for right nasal endoscopy photograph cases was also from 'slight' to 'moderate'(% agreement: 42.41-68.97%/Kappa: 0.109-0.465). Only the agreement of 'rhinorrhea(watery/yellow)' item was moderate(% agreement: 68.97%/Kappa: 0.465). Conclusions : It is necessary to resolve problems such as cut-off value setting, bipolar evaluation values(pale/hyperemia, dryness/dampness, watery/yellow, atrophic/edematous) and weighting items. Further rigorous studies that overcome the limitations of the current research are warranted.

Keywords

References

  1. Korean Rhinologic Society. Clinical Rhinology. 1st ed. Gyeonggi:koonja publishing company. 2017:85, 231.
  2. The Society of Korean Medicine Ophthalmology, Otolaryngology & Dermatology Textbook Compilation Committee. Korean Medicine Otorhinolaryngology. 1st ed. Busan: Sunwoo publishing company. 2015:223.
  3. Lee HB, Park EK, Baek HJ, Lee BJ, Jung SK, Jung HJ. Clinical Values of Cold-Heat Pattern Diagnosis by the Nasal Endoscopy for Patients with Cough. J Int Korean Med. 2014;35(3):274-87.
  4. Bae NS, Park YJ, Oh HS, Park YB. Preceding Studies for Questionnaires on Han-Yol Patternization. The Journal of the Korea Institute of Oriental Medical Diagnostics. 2005;9(1):98-111.
  5. Yun YH, Park JS, Kim KS, Kim NK, Kim KJ, Kim HT, et al. A Study on the Development of Guideline for Assessing Anterior Nasal Cavity Using Nasal Endoscopy on Allergic Rhinitis Patients. Kor J Oriental Preventive Med Soc. 2013;17(1):199-207.
  6. Kim KS, Yun YH, Park JS, Kim NK, Kim KJ, Kim HT, et al. Inter- and Intra-rater Reliability of Pattern Identification Using Nasal Endoscopy for Allergic Rhinitis. J Korean Med Ophthalmol Otolaryngol Dermatol. 2013;26(2):10-8. https://doi.org/10.6114/jkood.2013.26.2.010
  7. Kim KS, Yun YH, Nam HJ, Choi IH, Ko SG. Inter- and Intra-rater Reliability of a Nasal Endoscopy Index for Pattern Identification in Patients with Allergic Rhinitis. Orient Pharm Exp Med. 2015;15(3):167-71. https://doi.org/10.1007/s13596-015-0191-9
  8. Park CU, Kim HJ. Measurement of Inter-Rater Reliability in Systematic Review. Hanyang Med Rev. 2015;35(1):44-9. https://doi.org/10.7599/hmr.2015.35.1.44
  9. Landis JR, Koch GG. The Measurement of Observer Agreement for Categorical Data. Biometrics. 1977;33(1):159-74. https://doi.org/10.2307/2529310