• Title/Summary/Keyword: Rater reliability

Search Result 227, Processing Time 0.028 seconds

Reliability of the Visual Discrimination Scale on Oral Mucosa Pressure Ulcer for Healthcare Providers (의료인을 위한 구강점막욕창 시각적 감별도구의 신뢰도)

  • Uhm, Ju-Yeon;Kim, Myoung Soo
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.11
    • /
    • pp.443-450
    • /
    • 2020
  • The purpose of this study was to examine the inter-rater and intra-rater reliability of the oral mucosa pressure ulcer classification system based on the photographs. The study consisted of two stages; development and evaluation. In the developmental stage, 9 photographs of 82 were selected. In the evaluation stage, a total of 49 participants were invited web-based survey by e-mail. Cohen's weighted kappa and Krippendorff's alpha were used to define the inter-rater reliability. Nine photographs consisted of two, three, three, and one in normal, stage 1, stage 2, and stomatitis, respectively. The inter-rater reliabilities of wound care nurse specialist, intensive care nurse specialist, and dentist groups were 0.75, 0.70, and 0.78, respectively. The intra-rater reliability was 0.73. The inter-rater and intra-rater reliabilities of the oral mucosa pressure ulcer classification system showed substantially good agreement.

Reliability of Scapular Downward Rotation Measurement in Subjects With Scapular Downward Rotation Syndrome

  • Choi, Woo-Jeong;Lee, Ji-Hyun;Jeong, Hyo-Jung;Yoon, Tae-Lim;Cynn, Heon-Seock
    • Physical Therapy Korea
    • /
    • v.21 no.3
    • /
    • pp.73-79
    • /
    • 2014
  • The purposes of the current study were to (1) estimate the inter-rater agreement for visual assessment of scapular downward rotation (SDR), (2) develop the scapular downward rotation index (SDRI) as a method to measure SDR objectively and quantitatively, and (3) analyze the intra- and inter-rater reliability of the SDRI. Twenty subjects with scapular downward rotation syndrome (SDRS) were recruited for this study. The visual assessment and the measurement for the SDRI were conducted by two examiners in two sessions each. The SDRI [$(a-b){\div}a{\times}100$] is calculated with the measurement of two linear distances: One is a perpendicular distance from the root of the scapular spine to the thoracic mid-line (a), and the other is a perpendicular distance from the inferior angle of the scapula to the thoracic mid-line (b). Cohen's kappa coefficient was calculated to estimate the inter-rater agreement for visual assessment. Intra-class correlation coefficients (ICCs) with a 95% confidence interval (CI), the standard error of measurement, and minimal detectable differences were calculated to assess intra- and inter-rater reliability of SDR measurement using the SDRI. The results indicated that the kappa coefficient of inter-rater agreement for visual assessment was fair (${\kappa}=.21$). The intra-rater reliability of SDR measurement using the SDRI was excellent for examiner 1 (ICC=.92, 95% CI=.78~.97) and good for examiner 2 (ICC=.82, 95% CI=.55~.93). The inter-rater reliability was moderate (ICC=.73, 95% CI=.32~.89). These findings showed that SDR measurement using the SDRI for subjects with SDRS may be considered reliable and better than the visual assessment.

Reliability of the Foot Posture Index (FPI-6) for Assessment of Stroke Patients

  • Lee, Jong Dae;Kim, Young Mi;Kim, Kyung;Koh, Da Hyun;Choi, Myeong Su;Lee, Ho Jung
    • The Journal of Korean Physical Therapy
    • /
    • v.27 no.5
    • /
    • pp.311-314
    • /
    • 2015
  • Purpose: This study attempted to determine intra-rater reliability and inter-rater reliability for measurement of foot form using the FPI-6 (Foot Posture Index) in patients with hemiplegia caused by stroke. Methods: Twenty two stroke patients were recruited into the research and their foot posture was evaluated using the FPI. Two raters assessed 6 items sequentially in accordance with the FPI-6 manual. This procedure involved asking the subject to take several steps in-place, prior to settling into a comfortable stance position with double limb support. Subjects were instructed to stand still with their arms by their sides and look straight ahead. FPI-6 values ranged from -2 to +2 for each of the six criteria and from -12 to +12 for the total score, indicating a position for each foot either along the supinated (negative score) to pronated (more than +6) continuum of foot posture. Results: The results showed that intra-rater reliability and inter-rater reliability for a total FPI-6 score was high: 0.807-0.888. An almost perfect agreement between the two raters was identified in the foot's morphological classification (Somer's D=0.712; p<0.05). Intra-percentage agreement was high (88.6%). Conclusion: The FPI-6 is a quick, simple, and reliable clinical tool with demonstrated good to excellent intra-rater reliability and good inter-rater reliability when used in assessment of the stroke patient's foot.

Reliability and Validity of Measurement Using Smart Phone-Based Goniometer on Pelvic Tilting Angle in Standing and Sitting Position

  • Ha, Sung-Min;Jeon, In-Cheol
    • The Journal of Korean Physical Therapy
    • /
    • v.31 no.1
    • /
    • pp.35-39
    • /
    • 2019
  • Purpose: The purpose of this study was to assess the intra-rater and inter-rater reliability and validity of pelvic tilting angle measurements using a smart phone-based inclinometer (Clino) compared to a palpation meter (PALM) in the standing and sitting position. This study used an interchangeable method with Clino to measure the pelvic tilting angle in the standing and sitting positions. Methods: Twenty healthy subjects were recruited. Measurements of the pelvic tilting angle in the standing and sitting positions were obtained by two examiners using the Clino and PALM. A resting session was conducted 10 minutes later to assess the intra and inter rater reliability. To assess validity of the measurement using Clino, a PALM was used as the gold standard. The intra-class correlation coefficient (ICC) was used to determine the intra and inter rater reliability of Clino and a PALM. To assess the validity, the Pearson correlation coefficients were used for two measurement techniques to measure the pelvic tilting angle in the standing and sitting positions. The statistical significance was set to ${\alpha}=0.05$. Results: Measurements of the pelvic tilt had high inter-rater reliability in the standing (ICC=0.82) and sitting (ICC=0.88) positions using Clino and intra-rater reliability in the standing (ICC=0.87) and sitting (ICC=0.91) positions using Clino. Measurements of the pelvic tilt had high validity by a comparison of PALM and Clino in the standing (r=0.83) and sitting (r=0.89) positions (p<0.05). Conclusion: The use of Clino can be recommended as a tool to replace the PALM and measure the pelvic tilt angle in the standing and sitting positions while maintaining the clinical reliability and validity.

Reliability of Visual Gait Analysis according to Clinical Experience Level of Physical Therapists (임상 물리치료사의 경험에 따른 시각적 보행 분석의 신뢰도 연구)

  • Lee, In-Hee
    • The Journal of Korean Physical Therapy
    • /
    • v.25 no.4
    • /
    • pp.174-179
    • /
    • 2013
  • Purpose: Visual gait analysis plays a pivotal role in determining the important gait problem of patients. A few studies have been published and have received little attention regarding visual gait analysis on patients with orthopedic problems. The purposes of this study were to investigate the difference of reliability levels according to experience of clinical physical therapists. Methods: Thirty-five clinical physical therapists, 5 high experienced, 15 experienced, and 15 inexperienced, were recruited and individually evaluated these videotaped gait patterns of the participants, and filled up the structured gait analysis form. The gait of nine participants was videotaped. Reliability levels were calculated by the Intraclass Correlation Coefficients (ICC). Results: The inter-rater reliability of high experienced group (ICC=0.56; 95% CI: 0.50-0.62) was comparable to that of the experienced raters (ICC=0.48; 95% CI: 0.43-0.53) and inexperienced group (ICC=0.42; 95% CI: 0.38-0.46). High experienced group reached a higher inter-rater reliability level. The average intra-rater reliability of the high experienced group was 0.70 (ICCs ranging from 0.54 to 0.82). The experienced group reached an average intra-rater reliability of 0.61 (ICCs ranging from 0.47 to 0.81). The inexperienced group attained average ICC values of 0.53 (ICCs ranging from 0.30 to 0.74). Conclusion: Use of a structured gait analysis form as described in this study was found to be moderately reliable. Clinical experience appears to increase the reliability of visual gait analysis.

Inter-Rater Reliability of Quantitative Knee Tendon Reflex Test for Healthy Subjects (정상 성인에 대한 정량적 무릎힘줄반사 검사의 측정자간 신뢰도)

  • Kim, Yong-Wook;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.14 no.3
    • /
    • pp.57-63
    • /
    • 2007
  • The purpose of this study was to evaluate inter-rater reliability of the amplitude and first knee extension angles in deep tendon reflex test by using an electrical hammer. Twenty-five healthy adults participated in the study. Compound muscle action potential is elicited by tapping the knee tendon with an electrical hammer in deep tendon reflex tests. The amplitude and knee extension angle were simultaneously measured. The mean value of the amplitude and the knee extension angles through three time trials for each tester, are used for determining the inter-rater and Intra-class Correlation Coefficients (ICCs) reliabilities. According to the results, the ICCs of the amplitude is .280 and that of the knee extension angle is .789. Pearson correlation coefficients of the amplitude of the action potential and the knee extension angles are .685, showing significant statistically moderate correlation. Inter-rater reliability in the amplitude was not significant. More objective and quantitative deep tendon reflex tests should be done to obtain higher reliability in further studies.

  • PDF

Inter- and Intra- Rater Reliability of Navicular Drop Tests Position

  • Kim, So-yeon;Yoo, Jung-eun;Woo, Da-hyun;Jung, Bo-young;Choi, Bo-ram
    • Journal of Korean Physical Therapy Science
    • /
    • v.26 no.1
    • /
    • pp.9-14
    • /
    • 2019
  • Background: Pes planus, or flat foot, causes lower limb malalignment and foot pain during walking or exercise. Therefore, a highly reliable evaluation method to accurately diagnose flat feet is necessary. This study investigated the intra-and inter-rater reliability of the navicular drop test in different postures. Design: Cross sectional study. Methods: Forty healthy volunteers performed the navicular drop test in three different combinations of non-weight-bearing and weight-bearing postures (standing/standing, sitting/sitting, and sitting/standing). Two examiners alternately performed the measurements five times in each subject, and in each posture. Significant differences in measurements were obtained among the three postures, with the highest navicular drop being observed in the sitting/standing posture. Results: Inter-rater reliability was high in the sitting/standing and sitting/sitting postures. Intra-rater reliability was high in all three postures. In the sitting/sitting and sitting/standing postures, large navicular drop values and high inter- and intra-rater reliability were observed. Conclusion: Therefore, the sitting/standing and sitting/sitting postures are recommended for use in navicular drop tests to diagnose flat feet.

A Comparison of Reliability and Anterior Glide Distance of Humerus Head of Passive Shoulder Internal Rotation Range of Motion Measurement Methods (어깨관절의 수동적 내회전 관절 가동범위의 측정 방법에 따른 신뢰도와 상완골두의 전방 활주 거리 비교)

  • Kim, Hyun-Sook;Lee, Won-Hwee;Choung, Sung-Dae
    • Physical Therapy Korea
    • /
    • v.17 no.3
    • /
    • pp.1-10
    • /
    • 2010
  • The purpose of this study was to measure intra-rater and inter-rater reliability and range of motion for measurement of passive shoulder internal rotation range of motion and to compare anterior glide distance of humeral head in three methods. Fifty healthy subjects and fifty patients with shoulder musculoskeletal pain were recruited for this study. The subjects' passive shoulder internal rotation range of motion was measured by visual estimation, manual stabilization, and pressure biofeedback unit methods. In two trials, measurements were performed on each subject by two examiners. Intraclass correlation coefficient (ICC(3,1)) was used to determine the reliability of each measurement. The intra-rater reliability of the three methods was excellent (ICC=.77~.93) in both groups. The inter-rater reliability of the visual estimation method was poor (ICC=.20, .29), the manual scapular stabilization method was poor and fair (ICC=.09, .50), and the pressure biofeedback unit method was excellent (ICC .86, .75) in the experimental and control groups. In the experimental group, the difference of examined range of motion by each examiner was significant in the visual estimation method and manual scapular stabilization method, but there was an insignificant difference between the groups is the pressure biofeedback unit method. This result suggests that the intra-rater and inter-rater reliability of a pressure biofeedback unit was better than the other methods. The difference in distance of the anterior glide of humeral head was insignificant among all the methods. The pressure biofeedback unit method was the most reliable method, so it is proposed to be a new and reliable method to measure internal rotation range of motion.

Inter-Rater Reliability of Chedoke-McMaster Stroke Assessment for Stroke Patients (뇌졸중환자 평가를 위한 Chedoke-McMaster Stroke Assessment의 측정자간 신뢰도)

  • Won, Jong-Hyuk;Kim, Yong-Wook
    • Physical Therapy Korea
    • /
    • v.4 no.3
    • /
    • pp.45-60
    • /
    • 1997
  • This study was performed to determine the inter-rater reliability of the Chedoke-McMaster Stroke Assessment translated in Korean. This measures the physical impairments and disabilities that impact on the lives of individuals with stroke. The purposes of this measure were 1) to stage motor recovery to classify individuals in terms of clinical characteristics, 2) to predict rehabilitation outcomes, and 3) to measure clinically important change in physical function. Twenty-two subjects from physical therapy unit were assessed by two physical therapists. The ratings were compared by Spearman's rank correlation The correlation between two raters ranged from 0.85 to 0.98. Inter-rater reliability coefficient for total scores ranged from 0.95 to 0.97. This study confirms that the Chedoke-McMaster Stroke Assessment yields reliable results.

  • PDF

Reliability of Three Methods for Measuring Length of Iliotibial Tract (엉덩정강근막띠의 길이 평가를 위한 세 가지 측정방법들의 신뢰도 비교)

  • Kim, Moon-Hwan;Yun, Sung-Joon;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.21 no.3
    • /
    • pp.20-27
    • /
    • 2014
  • The purpose of this study was to compare the intra-rater and inter-rater reliability of three methods for measuring iliotibial tract length in 40 knees of 20 subjects. The measurements were performed by two examiners and one assistant. The length of the iliotibial tract was measured using three methods: the first used a modified Ober test with an inclinometer, the second used a modified Ober test with a marker, and the third used active adduction test with a marker in the supine position. Each examiner used the three methods in two sessions. For the first method, the inclinometer value was recorded manually. For the second and third methods, Image J analysis software was used to analyze the photographs taken. The intra-rater and inter-rater reliability of the measured value was assessed by means of intra-class correlation coefficients [ICC (3,1)] and the standard error of measurement. The intra-rater reliabilities of the three methods were excellent (ICC=.97, .95, and .94, respectively), and the inter-rater reliabilities of the first and second methods were fair to good (ICC=.64 and .65, respectively). The inter-rater reliability of the third method was excellent (ICC=.88). Our results suggest that the active adduction test is an objective and qualitative measurement method for measuring iliotibial tract length. We recommend that the active adduction test be used for measuring iliotibial tract length in the clinical setting.