• Title/Summary/Keyword: Intra-rater reliability

Search Result 111, Processing Time 0.024 seconds

Reliability study of the Pectoralis Minor Muscle Thickness Measurement using Rehabilitative Ultrasound Imaging

  • Lim, Ji Young;Lee, Se-Yeong;Jung, Seung-Hwa;Park, Dae-Sung
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.16 no.2
    • /
    • pp.45-52
    • /
    • 2021
  • PURPOSE: This study examined the imaging procedure of pectoralis minor muscle thickness and assessed the intra- and inter-rater reliability of the muscle thickness measured by two raters using rehabilitative ultrasound imaging (RUSI) in healthy individuals. METHODS: Fifteen participants (aged 21 - 28, seven females, and eight males) were involved in the study. The primary rater palpated the coracoid process and the fourth rib, defined as the width of the index finger lateral to the sternum to avoid breast tissues, and lined the two landmarks. The second examiner checked 1 / 3 (1st point) and 1 / 2 (2nd point) of the line length as measurement points. The two raters obtained right side muscle images of the participants at a standardized sitting position using RUSI with a 7.5 MHz linear transducer at 40mm depth. For intra-rater reliability, the principal rater took three images per point and tried to take one more with an interval. For the inter-rater reliability, the other rater performed the same tasks as the principal rater on the same day. The reliability was analyzed using the intra-class correlation coefficient (ICC), the standard error of the measurement (SEM), and Bland and Altman plots. RESULTS: The reliability at all points was excellent for the same rater (ICC3,1 = .973 - .978, SEM = .042 - .046), and between raters (ICC2,1 = .939 - .959, SEM = .059 - .097). CONCLUSION: These findings show that the RUSI could be reliable for examining the pectoralis minor muscle thickness in healthy individuals at all measurement sites.

Reliability and Validity of Measurement Using Smartphone-Based Goniometer of Tibial External Rotation Angle in Standing Knee Flexion

  • Jeon, In-Cheol;Kwon, Oh-Yun;Weon, Jong-Hyuck;Ha, Sung-Min;Kim, Si-Hyun
    • Physical Therapy Korea
    • /
    • v.20 no.2
    • /
    • pp.60-68
    • /
    • 2013
  • The purpose of this study was to assess the intra-rater test-retest reliability of tibial external rotation angle measurement using a smartphone-based photographic goniometer, DrGoniometer (DrG) compared to a three-dimensional motion analysis system (Vicon). The current study showed an interchangeable method using DrG to measure the tibial external rotation angle in standing knee flexion at $90^{\circ}$. Twelve healthy subjects participated in this study. A rest session was conducted 30 minutes later for within-day reliability and five days later for between-day intra-rater test-retest reliability. To assess the validity of the measurement using DrG, we used a three dimensional motion analysis system as a gold standard to measure the angle of tibial external rotation. Intra-class correlation coefficient (ICC) and the standard error of measurement (SEM) values were used to determine the within- and between- day intra-rater test-retest reliability of using DrG and a three dimensional motion analysis system. To assess validity, Pearson correlation coefficients were used for two measurement techniques. The measurement for tibial external rotation had high intra-rater test-retest reliability of within-day (ICC=.88) and between-day (ICC=.83) reliability using DrG and of within-day (ICC=.93) and between-day (ICC=.77) reliability using a three-dimentional motion analysis system. Tibial external rotation angle measurement using DrG was highly correlated with those of the three-dimensional motion analysis system (r=.86). These results represented that the tibial external rotation angle measurement using DrG showed acceptable reliability and validity compared with the use of three-dimensional motion analysis system.

Reliability of the Modified Modified Ashworth Scale for the Muscle Tone of Poststroke Patients (뇌졸중 환자의 근긴장도 평가를 위한 개정된 개정된 Ashworth 척도의 신뢰도)

  • Kim, Tae-Ho;Kim, Yong-Wook
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.5 no.3
    • /
    • pp.477-485
    • /
    • 2010
  • Purpose : The clinical scale to assess spasticity of muscle was wildly used the modified Ashworth scale (MAS). But reliability of the MAS has been controverted for ambiguity among the grades. The purpose of this study was to establish the inter-rater reliability of the modified MAS (MMAS) translated into Korean in stroke patients. Methods : Twenty-five patients (sixteen men and nine women) with hemiplegia (ten right and fifteen left) were measured by two raters who were physical therapist in the rehabilitation hospital. The raters assessed spasticity of shoulder adductor, elbow flexor, wrist flexor, hip adductor, knee extensor, and ankle plantar flexor in the same patients according to ratings criteria of the MAS and the MMAS. Results : For the inter-rater reliability of the MAS, two raters agreed on 57.3% and the Kappa values were moderate ($\kappa$=0.41) between two rater. The inter-rater reliability of the MAS was fair for the wrist flexor and the hip adductor and moderate for the other muscles. The intra-rater reliability was good for the shoulder adductor and the knee extensor and moderate for the other muscles. For the inter-rater reliability of the MMAS, two raters agreed on 84.7% and the Kappa values were good ($\kappa$=0.78) between two rater. The inter-rater reliability of the MMAS was moderate for the hip adductor, and good for the shoulder adductor and the wrist flexor, and very good for the other muscles. The intra-rater reliability was good for the wrist flexor and the hip adductor and very good for the other muscles. Conclusion : This study suggests that the MMAS translated into Korean is reliable test scale for the spasticity with stroke patients in the clinical field.

The Reliability of a Pediatric Balance Scale Based on the Raters' Clinical Work Experience and Test Experience

  • Kim, Gi-Won;Ko, Joo-Yeon;Baek, Soon-Gi
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.6
    • /
    • pp.35-42
    • /
    • 2010
  • Purpose: To investigate the rater reliability of a Pediatric Balance Scale (PBS) for children with cerebral palsy, and to investigate possible differences among raters according to their clinical work experience and testing experience. Methods: Study participants included 18 children with spastic cerebral palsy who could walk. They were instructed by pediatric physical therapists, two of whom had ten years of clinical work experience and two who had less than one year of experience. The children's ability to achieve physical balance was videotaped for PBS items. The raters watched the tapes and evaluated each child twice. Rater reliability was analyzed using the intraclass correlation coefficient (ICC). Differences between experienced and novice raters were analyzed using a paired t-test. The statistical significance level was set to 0.05. Results: The total PBS scores averaged 45.78~48.00 and 45.72~47.67 for first and second tests. Intra-rater reliability was very high (ICC=0.89~0.99), and the repeated measurement coincidence was high (p>0.05). Inter-rater reliability was high (ICC=0.83~0.84), but there was a bit of a difference in the coincidence (p<0.05). The experienced raters' reliability and coincidence were higher than those of the novices, and there were differences in reliance and coincidence between experienced and novice raters (p<0.05). Conclusion: Inter-rater and intra-rater reliability is very high. However, rater reliability showed defferences depending on clinical work experience and testing experience. When testing pediatric patients with the PBS, the rater's clinical experience and test experience may affect the test results.

Reliability of the Tone Assessment Scale for Poststroke Spasticity (뇌졸중 후 강직(spasticity) 평가를 위한 Tone Assessment Scale의 신뢰도)

  • Kim, Tae-Ho;Chung, Ey-Jung
    • Physical Therapy Korea
    • /
    • v.9 no.2
    • /
    • pp.133-144
    • /
    • 2002
  • The purpose of this study was to establish reliability of the Tone Assessment Scale (TAS) translated into Korean in patients with stroke. The TAS consists of resting posture, response to passive movement, and associated reaction to active effort. Fifteen patients (14 males, 1 female) were examined by two raters. Surface electromyography (EMG) data at elbow flexor muscle and joint excursion were collected from 6 patients. To identify the correlation between muscle activity and angular changes of elbow muscle, Pearson product moment correlation was used. The inter-rater and intra-rater reliability of the TAS ranged from very good to good (K/Kw=.61~1.00 for intra-rater and K/Kw=.73~1.00 for intra-rater comparisons) in the sections of resting posture and associated reaction. However, in the section of response to passive movement, the reliability coefficients ranged from very good to fair (Kw=.29~1.00). In the 11th item, correlation between EMG ratio of elbow flexor and angular changes of elbow joint showed statistically strong positive relationship (r=.94, p<.05). These results indicate that the TAS is selectively reliable in the sections of resting posture and associated reaction.

  • PDF

A Comparison of Reliability and Anterior Glide Distance of Humerus Head of Passive Shoulder Internal Rotation Range of Motion Measurement Methods (어깨관절의 수동적 내회전 관절 가동범위의 측정 방법에 따른 신뢰도와 상완골두의 전방 활주 거리 비교)

  • Kim, Hyun-Sook;Lee, Won-Hwee;Choung, Sung-Dae
    • Physical Therapy Korea
    • /
    • v.17 no.3
    • /
    • pp.1-10
    • /
    • 2010
  • The purpose of this study was to measure intra-rater and inter-rater reliability and range of motion for measurement of passive shoulder internal rotation range of motion and to compare anterior glide distance of humeral head in three methods. Fifty healthy subjects and fifty patients with shoulder musculoskeletal pain were recruited for this study. The subjects' passive shoulder internal rotation range of motion was measured by visual estimation, manual stabilization, and pressure biofeedback unit methods. In two trials, measurements were performed on each subject by two examiners. Intraclass correlation coefficient (ICC(3,1)) was used to determine the reliability of each measurement. The intra-rater reliability of the three methods was excellent (ICC=.77~.93) in both groups. The inter-rater reliability of the visual estimation method was poor (ICC=.20, .29), the manual scapular stabilization method was poor and fair (ICC=.09, .50), and the pressure biofeedback unit method was excellent (ICC .86, .75) in the experimental and control groups. In the experimental group, the difference of examined range of motion by each examiner was significant in the visual estimation method and manual scapular stabilization method, but there was an insignificant difference between the groups is the pressure biofeedback unit method. This result suggests that the intra-rater and inter-rater reliability of a pressure biofeedback unit was better than the other methods. The difference in distance of the anterior glide of humeral head was insignificant among all the methods. The pressure biofeedback unit method was the most reliable method, so it is proposed to be a new and reliable method to measure internal rotation range of motion.

A Study of Measurement Methods for Subtalar Joint Motion (목말밑관절 가동범위 측정방법에 관한 연구)

  • Kim, Gi-Won;Hong, Wan-Sung
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.4
    • /
    • pp.57-64
    • /
    • 2010
  • Purpose: This study aimed to determine whether there are differences in subtalar joint range of motion (ROM) when using different measurement methods, and to determine inter- and intra-rater reliability of goniometry as used in clinical setting. Methods: Subjects were thirty-one healthy males and females (sixty-two ankles) living in Korea. Three raters with different clinical experiences measured inversion and eversion range of motion of the subtalar joint two times. Measurements were done with subjects prone (open kinetic chain) and standing (closed kinetic chain). Rater and measurement methods were based on analyzing differences in range of motion. Intra-class correlation coefficients (ICCs) were calculated to determine intra-rater and inter-rater reliability. Results: Mean subtalar jont range of motion for inversion ranged from $9.31^{\circ}$ to $11.94^{\circ}$ for eversion, it ranged from $6.73^{\circ}$ to $9.20^{\circ}$. The differences in ROM between raters and between measurement methods were significant (p<0.01). The ICCs for interrater reliability ranged from $0.02^{\circ}$ to $0.20^{\circ}$ for inversion and from $0.23^{\circ}$ to $0.39^{\circ}$ for eversion. Intrarater reliability ranged from $0.32^{\circ}$ to $0.78^{\circ}$ for inversion and from $0.45^{\circ}$ to $0.73^{\circ}$ for eversion. Conclusion: Subtalar joint inversion and eversion ROM show differences for measurement methods low reliability between different raters, and low to high intra-rater reliability within sessions.

Intra- and inter-rater reliability of muscle thickness measurement of the tibialis anterior using different inward pressures

  • Lee, Seong-Joo;Lim, Ji Young;Lee, Chang-Hyung;Park, Dae-Sung
    • Physical Therapy Rehabilitation Science
    • /
    • v.8 no.4
    • /
    • pp.218-224
    • /
    • 2019
  • Objective: This reliability study examined the effects of applying varying induced inward pressures using a transducer placed at 0° neutral ankle position (NEU) and 15° ankle dorsiflexion (DF) on tibialis anterior (TA) muscle thickness using a custom-made device with a force indicator during rehabilitative ultrasound imaging. Design: Cross-sectional study. Methods: Twenty-four healthy subjects were recruited in this study. Two examiners measured the muscle thickness of the TA at 0° NEU and 15° DF in 3 conditions of inward pressures (1.0 N, 2.0 N, and 4.0 N) using a custom-made holder. The muscle thickness was measured three times for each of the conditions arranged in random order. For intra- and inter-rater reliability, the intraclass correlation coefficients (ICCs) with 95% confidence intervals, standard error of measurement, minimal detectable change, and coefficient of variation were analyzed. One-way repeated measures analysis of variance was conducted for investigating changes of TA muscle thickness according to the inward pressures of the transducers. Results: The intra-rater reliability of TA muscle thickness measurement was excellent (ICC3,1: 0.92-0.96) for all conditions (at both ankle joint angles per varying inward pressure). Likewise, the inter-rater reliability of TA muscle thickness measurement was excellent (ICC2,1: 0.89-0.97) under same conditions. The mean of TA thickness showed the trend of decreasing significantly with increased inward pressures at all ankle joint angles (p<0.05). Conclusions: Use of this custom-made device with a force indicator is useful to accomplish the high intra- and inter-rater reliability of TA muscle thickness measurement at both ankle joint angles in reducing the measurement error.

Developing Scoring Rubric and the Reliability of Elementary Science Portfolio Assessment (초등 과학과 포트폴리오의 채점기준 개발과 신뢰도 검증)

  • Kim, Chan-Jong;Choi, Mi-Aee
    • Journal of The Korean Association For Science Education
    • /
    • v.22 no.1
    • /
    • pp.176-189
    • /
    • 2002
  • The purpose of the study is to develop major types of scoring rubrics of portfolio system, and estimate the reliability of the rubrics developed. The portfolio system was developed by Science Education Laboratory, Chongju National University of Education in summer, 2000. The portfolio is based on the Unit 2, The Layer and Fossil, and Unit 4, Heat and Change of Objects at fourth-grade level. Four types of scoring rubrics, holistic-general, holistic-specific, analytical-general, and analytical-specific, were developed. Students' portfolios were scored and inter-rater and intra-rater reliability were calculated. To estimate inter-rater reliability, 3 elementary teachers per each rubric(total 12) scored 12 students' portfolios. Teachers who used analytical-specific rubric scored only six portfolios because it took much more time than other rubrics. To estimate intra-rater reliability, second scoring was administered by two raters per rubric in two and half month. The results show that holistic-general rubric has high inter-rater and moderate intra-rater reliability. Holistic-specific rubric shows moderate inter- and intra-rater reliability. Analytical-general rubric has high inter-rater and moderate intra-rater reliability. Analytical-specific rubric shows high inter- and intra-rater reliability. The raters feel that general rubrics seems to be practical but not clear. Specific rubrics provide more clear guidelines for scoring but require more time and effort to develop the rubrics. Analytical-specific rubric requires more than two times of time to score each portfolio and is proved to be highly reliable but less practical.

Reliability of Lateral Deviation Measurement in the Hyoid Bone With Center Point and Lateral Motion Tests

  • Min, Hye-jin;Yoon, Tae-lim
    • Physical Therapy Korea
    • /
    • v.26 no.3
    • /
    • pp.76-83
    • /
    • 2019
  • Background: The hyoid bone is the only non-jointed structure among the skeletal tissues of the head and neck region, and its movement and posture depend on the attached muscle, ligament, and fascia. The location of the hyoid bone is important for airway maintenance, vocalization, chewing, swallowing, breathing, and head and scapular position. In general, the location of the hyoid bone is measured using radiographs and 3D computed tomography, and no studies have reported on clinical measurement methods. Objects: This study was performed to suggest clinical measurement methods for lateral deviation of the hyoid bone and to evaluate their reliability. Methods: In this study, 24 healthy volunteers (12 males, 12 females) in Cheongju-si participated. Two examiners performed the center point test and lateral motion test twice each to measure the lateral displacement of the hyoid bone. The reliability of the center point test was analyzed using intra-class correlation coefficients (ICC), and the reliability of the lateral motion test was analyzed using Cohen's kappa coefficient. Results: The intra-rater reliability of the center point test was good, and the inter-rater reliability was moderate. The intra- and inter-rater reliability of the lateral motion test showed substantial reliability. Conclusion: Based on these results, the center point test and the lateral motion test can be used as an alternative methods of the measurement of lateral deviation of the hyoid bone for people who have musculoskeletal disorders of the head, neck, and scapula.