• Title/Summary/Keyword: Intra-rater reliability

Search Result 111, Processing Time 0.022 seconds

Usefulness of Smart Phone Application to Measure Cervical Range of Motion (목 관절가동범위 측정을 위한 스마트폰 어플리케이션의 유용성)

  • Chun-Yeop, Lee;Hae-Yoon, Song;Jung-Min, Lee;Moon-Young, Chang
    • The Journal of Korean society of community based occupational therapy
    • /
    • v.7 no.1
    • /
    • pp.17-24
    • /
    • 2017
  • Objective : The purpose of this study was to estimate the reliability of cervical range of motion measurement in healthy adults using smart phone application and goniometer that can be easily applicated in clinical setting. Methods : The cervical range of motion was measured as the flexion, extension, right rotation, left rotation, right lateral flexion, and left lateral flexion. To measure the reliability of intra-rater and inter-rater reliability, the same examiner performed two measurements and the other examiner performed once, total measurement were performed three times. The order of tests was randomized and two examiners didn't know the results of measurements. Results : Thirty healthy adults were participated. The result of this study shows that there were are no significant differences in all movements except the right lateral flexion in comparison of average angle of smart phone application and goniometer. The intra-rater reliability of smart phone application and goniometer showed ICC as .841~.958 and the inter-rater reliability showed ICC as .720~.944 for all movements. Conclusion : These results suggest that smart phone application and goniometer have proven to be reliable in measuring the cervical range of motion. Smart phone application can be used as a useful tool in clinical setting due to fast and accurate measurements of cervical range of motion.

Inter-Rater Reliability of the Deep Tendon Reflex by using EMG Electric Reflex Hammer (근전도 전자 망치를 이용한 깊은힘줄반사의 측정자 간 신뢰도)

  • Lee, Jeong-Woo;Seo, Tae-Hwa
    • Journal of The Korean Society of Integrative Medicine
    • /
    • v.10 no.4
    • /
    • pp.137-143
    • /
    • 2022
  • Purpose : The purpose of this study was to evaluate the reliability analysis of the deep tendon reflex by using electromyography (EMG). Methods : The study was tested on 30 volunteers who are women in their 20s. Using an electronic reflective hammer of EMG, deep tendon reflex was measured on all subjects with the participation of three trained physical therapists as raters. First, the subjects were comfortably seated on a table with their knees bent at 90 °. The three raters tapped the electric hammer at intervals of 10 seconds to avoid habituation until a total of 10 compound muscle action potential records were collected. Intraclass correlation coefficients (ICCs) were calculated to assess the inter-rater reliability of the deep tendon reflex with the use of EMG. The items of analysis included amplitude (mV), latency (ms), duration (ms), and area (mV × ms) of the compound evoked potentials. Results : Based on the average records of 10 compound muscle action potential, excellent reliability (ICC: .912) was achieved in terms of area, and there was good reliability in terms of latency (ICC: .795) and duration (ICC: .800). In the shortest latency of the compound muscle action potential, good reliability was achieved in terms of amplitude (ICC: .865), duration (ICC: .781), and area (ICC: .832). In the amplitude of peak-to-peak of compound muscle action potential, excellent reliability was recorded in terms of amplitude (ICC: .924), and good reliability was recorded in terms of duration (ICC: .801) and area (ICC: .874). Conclusion : The findings in this study indicate that electromyography via an electric hammer is a reliable method of assessing and measuring deep tendon reflexes. Especially, it may be an excellent gauge in the area of average values of the compound muscle action potentials and the amplitude of peak-to-peak of compound muscle action potentials.

Reliability and Validity of Angle of Trunk Rotation Measurement Using Smartphone and 3D Printing Technology in Scoliosis

  • Geum-Dong Shin;Seong-gil Kim;Kyoung Kim
    • The Journal of Korean Physical Therapy
    • /
    • v.34 no.6
    • /
    • pp.283-291
    • /
    • 2022
  • Purpose: The purpose of this study was to compare and analyze the method of measuring the angle of the trunk rotation using a smartphone with 3D smartphone holder compared to a scoliometer, which is a measuring tool used as a method for diagnosing scoliosis in scoliosis patients. Methods: Angle of trunk rotation was measured in 21 subjects diagnosed with scoliosis. scoliometer measurement method, a smartphone measurement method with a 3D smartphone holder, a smartphone blind measurement method with a 3D smartphone holder, a smartphone measurement method without a smartphone holder, a smartphone blind measurement method without a smartphone holder, and a total of five measurement methods were repeated three times for comparison and analysis. Results: The smartphone measurement method with a 3D smartphone holder has excellent intra-rater reliability of angle of trunk rotation (Rater A; ICC3, 2≥0.993, Rater B; ICC3, 2≥0.992). The smartphone blind measurement method with a 3D smartphone holder has excellent inter-rater reliability of angle of trunk rotation (ICC2, 2≥0.968). The scoliometer measurement method had the highest validity (r=0.976) with the smartphone measurement method with a 3D smartphone holder, and the blind measurement method without a smartphone holder had the lowest validity (r=0.886). Conclusion: These findings, the angle of trunk rotation measured by the smartphone measurement method with a 3D smartphone holder in scoliosis patients showed high reliability and validity compared to the scoliometer measurement method.

Reliability and Validity of the Goniometer for Hallux Valgus Angle Measurement (엄지발가락휨각도 측정을 위한 각도계의 신뢰도와 타당도)

  • Choung, Sung-Dae;Kang, Sun-Young;Kim, Moon-Hwan;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.20 no.2
    • /
    • pp.46-51
    • /
    • 2013
  • The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

Reliability and Validity of the Korean Version of the Functional Movement Screen (한국판 기능적 동작 검사의 신뢰도와 타당도)

  • An, Seung-Heon;Lee, Je-Hoon
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.5
    • /
    • pp.83-93
    • /
    • 2010
  • Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

Development and Application of an Online Scoring System for Constructed Response Items (서답형 문항 온라인 채점 시스템의 개발과 적용)

  • Cho, Jimin;Kim, Kyunghoon
    • The Journal of Korean Association of Computer Education
    • /
    • v.17 no.2
    • /
    • pp.39-51
    • /
    • 2014
  • In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

  • PDF

Reliability and Validity of Gait Assessment Tools for Elderly Person (노인의 보행에 대한 평가 도구의 신뢰도와 타당도 조사 연구)

  • Kim, Jae-Hyun
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.1
    • /
    • pp.41-48
    • /
    • 2009
  • Purpose: The examine the Reliability and Validity of the modified Emory Functional Ambulation Profile (mEFAP), Tinetti. Gait (TG), Timed Up & Go Tes t (TUG), Comfortable Gait Speed (CGS), Berg Balance Scale (BBS) in assessing gait function and balance in elderly person. Methods: The 45 community-dwelling subjects were participated in this study. Reliability was determined by intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method (Standard Error of Measurement (SEM), Smallest Real Difference (SRD)). Results: Validity was examined by correlation the mEFAP, TG, TUG, CGS, BBS. The intra-rater reliability were High (ICC$_{3,1}$ : mEFAP=0.95, TG=0.96, TUG=0.94, CGS=0.96, BBS=0.92) and Absolute reliability were excellent (SEM: mEFAP=1.90, TG=0.21, TUG=0.28 CGS=0.25, BBS=0.52), (SRD: mEFAP=5.26, TG=0.58, TUG=0.77, CGS=0.69, BBS=1.44). There were significant correlations between assessment tool (r=.0.58$\sim$0.78, p<0.01) indicating good validity. Our results provide strong evidence that the assessment tool has good reliability, validity for assessing elderly person undergoing rehabilitation. Conclusion: The gait assessment tool is a useful scale for measuring walking function and recovery in elderly person.

  • PDF

Reliability of the Onset Time Determinations During Maximal Isometric Contraction in Surface EMG (최대 등척성 수축시 표면근전도에서 근 수축 개시점 결정을 위한 기법들의 신뢰도)

  • Chung, Yi-Jung;Cho, Sang-Hyun;Lee, Jung-Hoon;Lee, Sang-Heon
    • Physical Therapy Korea
    • /
    • v.10 no.1
    • /
    • pp.51-62
    • /
    • 2003
  • The purpose of this study was to compare the relative accuracy of a range of computer-based analysis with respect to EMG onset determined visually by an experienced examiner. Ten healthy students (6 male, 4 female) were recruited and three times randomly selected trials of isometric contraction of wrist flexion and extension were evaluated using four technique. These methods were compared which varied in terms of EMG processing, threshold value and the number of samples for which the mean must exceed the defined threshold, and beyond 7% of maximum amplitude. To identify determination of onset time, ICCs(Intraclass Correlation Coefficients) was used and inter-rater arid intra-rater reliability ranged good in visually derived onset values. The results of this study present that in wrist flexion and extension, the reliability of the inter and intra-examiner muscle contraction onset times through visual analysis showed beyond .971 with ICCs. The reliability of the muscle contraction onset time decision through visual reading, tested with computer analysis, showed a relationship of all the selected analysis methods with ICCs .859 and .871. The objective computer-based analysis comparing with visual reading at the same time is the effective and qualitative data analysis method, considering the specificity of each study method.

  • PDF

Reliability of Modified Ashworth Scale Using a Haptic Robot Finger Simulating Finger Spasticity (손가락 경직을 모사하는 로봇 시뮬레이터를 이용한 경직도 검진의 신뢰도 평가)

  • Ha, Dokyeong;Park, Hyung-Soon
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.41 no.2
    • /
    • pp.125-133
    • /
    • 2017
  • This paper presents the inter-rater reliability of finger spasticity assessment tested realized by using finger simulator that mimics finger spasticity of patients after a stroke. For controlling the simulator torque, finger spasticity was modeled, and the model parameters were obtained by measuring quantitative data while grading based on Modified Ashworth Scale (MAS). A robotic finger simulator was designed for mimicking finger spasticity. Evaluation of this simulator with the help of seven rehabilitation doctors showed that the simulator had a Cohen's kappa value of 0.619 for Metacarpophalangeal Joint and 0.514 for Proximal Interphalangeal Joint. Fleiss' kappa between raters is 0.513 for Metacarpophalangeal Joint and 0.486 for Proximal Interphalangeal Joint. Therefore, the spasticity assessment made by MAS grade system is not reliable owing to the subjectivity of the assessment. The proposed robotic simulator can be used as a training tool for improving the reliability of the spasticity assessment.

Reliability and Validity of the Postural Assessment Scale for Stroke in Chronic Stroke Patients (만성뇌졸중 환자의 Postural Assessment Scale for Stroke의 신뢰도와 타당도)

  • An, Seung-Heon;Lee, Je-Hoon
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.1
    • /
    • pp.9-17
    • /
    • 2009
  • Purpose: The purpose of this study was to determine reliability and validity of the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Methods: A total of 43 stroke patients, who had a stroke more than 6 months previously, participated in the study. Reliability was determined by the intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method and Cronbach's alpha by internal consistency. Validity was examined by correlation the PASS scores to the Berg Balance Scale (BBS), Trunk Control Test (TCT), and Fugl-Meyer Balance (FM-B) score. Results: The intra-rater reliability and the Absolute reliability of the PASS was good ICC$_{3,1}$=0.97 (95%CI 0.95$\sim$0.99) and excellent SEM=1.01 respectively. Cronbach's alpha value for PASS was found to be 0.94. There were significant correlations between the PASS and BBS, TCT, FM-B (r=0.65-0.96, p<0.01). Conclusion: The PASS provide reliable and valid instrument of the postural control assessment for chronic stroke patients.

  • PDF