• Title/Summary/Keyword: Intra-rater reliability

Search Result 111, Processing Time 0.027 seconds

The Reliability and Validity of the Passive Lumbar Extension Test and the Prone Instability Test (수동적 요추 신전 검사와 엎드린 상태에서 요추 불안정성 검사의 신뢰도와 타당도)

  • Sa, Jae-Min;Kim, Sun-Yeop
    • Physical Therapy Korea
    • /
    • v.18 no.3
    • /
    • pp.85-93
    • /
    • 2011
  • The purpose of this study was to establish the reliability and validity of the passive lumbar extension (PLE) test and prone instability test (PIT). Thirty-three subjects (14 males, 19 females) with lower back pain enrolled in the study and the subjects were divided into 2 groups (positive and negative instability groups) on the basis of radiographies of flexion and extension. Reliability was determined by the kappa coefficient and validity was examined using calculated sensitivity, specificity, and the likelihood ratio. The results showed that the reliability of the PLE test was higher than the PIT (intra-rater reliability: k=.86 and k=.81, interrater reliability: k=.65 and k=.62) and the validity of the PLE test was also higher than the PIT (sensitivity: 91% and 62%, specificity: 95% and 85% positive likelihood ratio: 20.00 and 4.10, negative likelihood ratio: .10 and .45). In conclusion, we think that the PLE test was a more reliable and valid method for lumbar instability than the PIT.

Reliability and Data Integration of Duplicated Test Results Using Two Bioelectrical Impedence Analysis Machines in the Korean Genome and Epidemiology Study

  • Park, Bo-Young;Yang, Jae-Jeong;Yang, Ji-Hyun;Kim, Ji-Min;Cho, Lisa-Y.;Kang, Dae-Hee;Shin, Chol;Hong, Young-Seoub;Choi, Bo-Youl;Kim, Sung-Soo;Park, Man-Suck;Park, Sue-K.
    • Journal of Preventive Medicine and Public Health
    • /
    • v.43 no.6
    • /
    • pp.479-485
    • /
    • 2010
  • Objectives: The Korean Genome and Epidemiology Study (KoGES), a multicenter-based multi-cohort study, has collected information on body composition using two different bioelectrical impedence analysis (BIA) machines. The aim of the study was to evaluate the possibility of whether the test values measured from different BIA machines can be integrated through statistical adjustment algorithm under excellent inter-rater reliability. Methods: We selected two centers to measure inter-rater reliability of the two BIA machines. We set up the two machines side by side and measured subjects' body compositions between October and December 2007. Duplicated test values of 848 subjects were collected. Pearson and intra-class correlation coefficients for inter-rater reliability were estimated using results from the two machines. To detect the feasibility for data integration, we constructed statistical compensation models using linear regression models with residual analysis and R-square values. Results: All correlation coefficients indicated excellent reliability except mineral mass. However, models using only duplicated body composition values for data integration were not feasible due to relatively low $R^2$ values of 0.8 for mineral mass and target weight. To integrate body composition data, models adjusted for four empirical variables that were age, sex, weight and height were most ideal (all $R^2$ > 0.9). Conclusions: The test values measured with the two BIA machines in the KoGES have excellent reliability for the nine body composition values. Based on reliability, values can be integrated through algorithmic statistical adjustment using regression equations that includes age, sex, weight, and height.

An Analysis on Reliabilities of Scoring Methods and Rubric Ratings Number for Performance Assessments of Middle School Students' Science Investigation Activities (중학생 과학탐구활동 수행평가 시 채점 방식 및 척도의 수에 따른 신뢰도 분석)

  • Kim, Hyung-Jun;Yoo, June-Hee
    • Journal of The Korean Association For Science Education
    • /
    • v.30 no.2
    • /
    • pp.275-290
    • /
    • 2010
  • In this study, reliabilities of holistic scoring method and analytic scoring method were analyzed in performance assessments of middle school students' science investigation activity. Reliabilities of 2, 3, and 4~7-level rubric ratings for analytic scoring methods were compared to figure out optimized numbers of rubric ratings. Two trained raters rated four activity sheets of 60 students by two rating methods and three kinds of rubric ratings. Internal consistency reliabilities of holistic scoring methods were higher than those of analytic scoring methods, while intrarater reliabilities of analytic scoring were higher than those of holistic scoring methods. Internal consistency reliabilities and intra-rater reliabilities of 3-level rubric rating showed similar patterns of 4~7-level rubric ratings. But students' discriminations, item difficulties and item-response curves showed that the 3-level rubric ratings was reliable. These results suggest that holistic scoring method could be adapted to increase internal consistency reliabilities with improvement in intra-rater reliabilities by rater's conferences. Also, the 3-level rubric rating would be enough for good reliability in case of adapting analytic scoring methods.

Korean Cultural Adaptation of WHODAS 2.0 (36-Item Version): Reliability and Linking to ICF

  • Song, Ju Min;Lee, Hae Jung
    • The Journal of Korean Physical Therapy
    • /
    • v.30 no.6
    • /
    • pp.246-255
    • /
    • 2018
  • Purpose: This study was to conduct a Korean cultural adaptation of the WHO disability assessment schedule (WHODAS) 2.0: 36-item version. Methods: An internationally standardized process of translation and cultural adaptation of an instrument was used to develop a Korean version of WHODAS 2.0: 36-item version. Linking each item into the International Classification of Functioning, Disability and Health (ICF) was also conducted in order to ensure the concepts in the translated instrument were compatible with ICF. All translated versions of the instrument, linking results and feedback from participants were used for the final adaptation of the Korean version of the instrument. The Korean version of the instrument was assessed twice on different occasions to examine Inter- and intra-rater reliability, and the intra-class correlation coefficient (ICC) was calculated. Results: Twelve participants were involved in the translation and linking process. Ninety-five volunteers were invited to participate to examine the reliability of the instrument. Fifty participants completed the self-rated version of the instrument and 45 finished the interviewer version. The Korean WHODAS 2.0: 36-item version was found to have excellent reliability: self-rated version and interviewer version reliability coefficients were ICC=0.92 and ICC=0.94, respectively. Thirty-four items of the translated instrument were to be linked to ICF categories. Some adaptation was made; details and a familiar example were added to help respondents answer the questions. Conclusion: The study results show that the adaptation of the 36-item version of WHODAS 2.0 to Korean was successful and the instrument is ready for use in testing its psychometric properties.

The Validity and Reliability of Reflux Symptom(RSI) Index and Reflux Finding Score(RFS) (역류증상지수와 역류소견점수의 타당성과 신뢰도)

  • Lee, Byung-Joo;Wang, Soo-Geun;Lee, Jin-Choon
    • Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
    • /
    • v.18 no.2
    • /
    • pp.96-101
    • /
    • 2007
  • Laryngopharyngeal reflux (LPR) is the retrograde movement of gastric contents into the larynx, pharynx, and upper aero-digestive tract. LPR differs from gastroesophageal reflux in that it is often not associated with heartburn and regurgitation symptoms. Otolaryngological manifestations of acid reflux include a wide range of pharyngeal and laryngeal symptoms. Belafsky et al. developed a useful self-administered tool, the reflux symptom index (RSI), for assessing the degree of LPR symptoms. Patients are asked to use a 0 to 5 point scale to grade the following symptoms: 1) hoarseness or voice problems; 2) throat clearing; 3) excess throat mucus or postnasal drip ; 4) difficulty swallowing; 5) coughing after eating or lying down; 6) breathing difficulties ; 7) troublesome or annoying cough; 8) sensation of something sticking or a lump in the throat; 9) heartburn, chest pain, indigestion or stomach acid coming up. A RSI score greater than 13 is considered abnormal. As there is no validated instrument to document the physical findings and severity of LPR, Belafsky et al. developed an eight-item clinical severity scale for judging laryngoscopic finding, the reflux finding score (RFS). They rated eight LPR-associated findings on a scale from 0 to 4 : subglottic edema, ventricular obliteration, erythema/hyperemia, vocal-fold edema, diffuse laryngeal edema, posterior commissure hypertrophy, granuloma/granulation tissue, and thick endolaryngeal mucus. A RFS score of greater than 7 was found to suggest LPR-associated laryngitis. Although both indices (RSI and RFS) are widely used, there is some controversy about their validity (sensitivity and specificity) and reliability (intra-rater and inter-rater) in LPR diagnosis and treatment. We discuss the validity and reliability of RSI and RFS with literature review.

  • PDF

Analysis of Accuracy and Reliability for OWAS, RULA, and REBA to Assess Risk Factors of Work-related Musculoskeletal Disorders (근골격계질환 유해요인 정밀조사를 위한 OWAS, RULA, REBA의 평가 정확도 및 신뢰도 분석)

  • Cheon, Woohyun;Jung, Kihyo
    • Journal of the Korea Safety Management & Science
    • /
    • v.22 no.2
    • /
    • pp.31-38
    • /
    • 2020
  • The study evaluated the accuracy and intra-rater reliability for OWAS (Ovako Working posture Analysing System), RULA (Rapid Upper Limb Assessment), REBA (Rapid Entire Body Assessment) to improve their evaluation accuracy and reliability. Participants (n = 163) with undergraduate degree were recruited in this study and trained for 6 hours about the ergonomic assessment methods. Ergonomic assessments were conducted using OWAS, RULA, and REBA for a representative work with dynamic posture found in manufacturing industries. The study compared action categories (overall level) and detailed evaluation scores for individual body part. Action categories of the participants significantly differed from the golden reference defined by ergonomic experts. The participants underrated or omitted scores for truck (37.4% of the participants) and legs (52.8%) in OWAS. Similarly, the participants underrated or omitted additional scores for all body parts except the hand and wrist in RULA (53.5%) and REBA (54.8%). On the other hand, the participants overrated scores for the hand and wrist in RULA (55.2%) and REBA (39.9%). The results found in this study can help of selecting focus points and parts during assessment and education to improve accuracy and reliability of the ergonomic assessment methods.

Validity and Reliability of an Oral Health Assessment Tool for Elderly in Long-Term Care Facilities (요양시설 노인을 위한 구강건강 평가 도구의 타당도와 신뢰도)

  • Kim, Na-Yeon;Bae, Hyun-Sook
    • Journal of Korean Dental Hygiene Science
    • /
    • v.4 no.1
    • /
    • pp.53-64
    • /
    • 2021
  • Background: The elderly in long-term care facilities tend to have a diminished oral health status, with a high prevalence of dental caries and periodontal disease, as reduced cognitive function, joint mobility, and gait ability hinder the performance of oral hygiene. To improve the oral health of the elderly at long-term care facilities, it is necessary to have precise guidelines for oral health care and assessment; however, such guidelines are not readily available. Therefore, the present study aimed to develop an oral care assessment tool with verified reliability and validity. Methods: The participants in this study were 100 elderly patients at a care facilities and 10 clinical dental hygienists. Collected data were analyzed using the descriptive statistics, content validity index, and inter-rater reliability, as well as the analyses of intra-class correlation coefficient. Results: After a review of relevant literature, a preliminary questionnaire comprised of seven questions related to the evaluation of oral health was formed. After revising and supplementing the questions through a content validity test, a total of nine questions were selected. Conclusion: The novel assessment tool developed for the present study is anticipated to allow analyses of the level of problems related to oral health care before routine and professional care. Moreover, regular oral health status check-ups will enable the early diagnosis and treatment of diseases.

Clinical utility of auditory perceptual assessments in the discrimination of a diplophonic voice (이중음성 판별에 있어 청지각적 평가의 임상적 유용성)

  • Bae, Inho;Kwon, Soonbok
    • Phonetics and Speech Sciences
    • /
    • v.10 no.1
    • /
    • pp.75-81
    • /
    • 2018
  • Diplophonia is generally defined as the perception of more than one fundamental frequency component in a voice. Its perceptual aspect has traditionally been used to evaluate diplophonia because the perceptions can be easily evaluated, but there are limitations in the validity of the reliability of the intra- and inter-raters, examination situation, and variation of voice sample. Therefore, the purpose of this study is to confirm the reliability and accuracy of auditory perceptual evaluation by comparing non-invasive indirect assessment methods (sound waveform and EGG analysis), and to identify their usefulness with diplophonia. A total of 28 diplophonic voices and 39 non-periodic voices were assessed. Three raters assessed the diplophonia by performing an auditory perception evaluation and identifying the quasi-periodic perturbations of the acoustic waveform and EGG. Among the three discrimination methods, intra- and inter-rater reliability, sensitivity, specificity, accuracy, positive likelihood ratio, and negative likelihood ratio were examined, and the McNemar test was performed to compare the discriminant agreement. The accuracy of the auditory perceptual evaluation (86.57%) was not significantly different from that of sound waveform acoustic (88.06%), but it was significantly different from that of EGG (83.33%). The reading time (6.02 s) for the auditory perceptual evaluation was significantly different from that for sound waveform analysis (30.15 s) and EGG analysis (16.41 s). In the discrimination of diplophonia, auditory perceptual evaluation has sufficient reliability and accuracy as compared to sound waveform and EGG. Since immediate feedback is possible, auditory perceptual evaluation is more convenient. Therefore, it can continue to be used as a tool to discriminate diplophonia in clinical practice.

Reliability and Validity of the Manual Measurement Method for Patellar Height (무릎뼈 높이에 대한 도수측정방법의 신뢰도와 타당도)

  • Kim, Moon-Hwan;Yun, Sung-Joon;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.20 no.3
    • /
    • pp.54-61
    • /
    • 2013
  • This study was to determine the reliability and validity of manual measurements of patellar height to standard radiographic measurements in 30 knees of 15 subjects. Patellar height was measured using manual and radiographic methods. The manual measurements were performed by two examiners using digital vernier calipers with the subject sitting and the knees in $30^{\circ}$ of flexion. The radiographic measurements were performed in the same position. The reliability of the manual measurements was assessed by means of intraclass correlation coefficients [ICC(3,1)], and the validity was investigated using the Pearson's product-moment correlation coefficient and an independent t-test. The intra- and inter-rater reliabilities of the manual measurement of patellar height were excellent (ICC=.86 and .88 respectively). The validity of patellar height measured manually compared to the radiographic method was good (Pearson's r=.69). In conclusion, the manual method is an objective, qualitative measurement of patella height.

Objective evaluation of the color of tongue substance using L*a*b* color coordinates

  • Park, Young-Jae;Park, Young-Bae
    • Advances in Traditional Medicine
    • /
    • v.6 no.2
    • /
    • pp.112-120
    • /
    • 2006
  • The purpose of this study was to analyze whether quantitative evaluation of the color of the tongue substance using $L^*a^*b^*$ color coordinates system could minimize the problems arising from the different illuminating conditions or not. In controlled 4 different illuminating conditions (by natural light, flashlight, f-number, shutter speed),12 healthy subjects were photographed of their tongue substance through a digital camera (C-2100uz, Olympus Co.), both on the top surface and on the bottom surface of the tongue substance by two examiners, twice at 3 day intervals. Clinician evaluation was also performed grading the redness of the tongue substance in the form of 5-points scale by 6 clinicians. As a result, there was no significant difference in color differences between the color of the tongue substance and the reference red card in the 4 different illuminating conditions. Intra-rater reliability was satisfied and even though limitedly, inter-rater reliability was satisfied. Color differences were significantly correlated with the results by the clinicians, although they were applicable limitedly to specific illuminating conditions. Our results indicate that the application of the color differences in tongue diagnosis could not only evaluate the color information quantitatively, but also minimize the problems arising from the different illuminating conditions and that there was the significant difference in the visual evaluation of the red color of the tongue substance, both between the clinicians and between the illuminating conditions.