• Title/Summary/Keyword: Intra-rater reliability

Search Result 112, Processing Time 0.023 seconds

Translation and Validation of the Korean Version Revised Nottingham Sensory Assessment (한국판 수정된 노팅엄 감각평가의 신뢰도 타당도 연구)

  • Ji, Eun-Kyu;Lee, Sang-Heon
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.9
    • /
    • pp.511-519
    • /
    • 2020
  • The aim of this study was to translate and validate the revised Nottingham Sensory Assessment(rNSA) in Republic of Korea. A cross-sectional study was conducted to translate the rNSA into Korean using a modified forward/backward translation procedure. Inter-rater and intra-rater reliability, internal consistency, and concurrent validity were investigated to validate the Korean version rNSA. The Korean version rNSA showed excellent inter-rater reliability (r=0.92-1.00) and intra-rater reliability (r=0.93-1.00). Significant correlations were found between sensory assessment results of the Korean version of the rNSA and the Korean Fugl Meyer Assessment Sensory subscales (r=0.96). The Cronbach α value of internal consistency of Korean version rNSA was ranged from 0.73 to 0.90, the value of K-FMA-S was ranged from 0.70 to 0.88. In these results, psychometric properties of the Korean version of the rNSA achieved the standard level and can be feasible in clinical practice to assess sensory function following stroke in Republic of Korea.

An Evaluation of the Reliability and Validity of the Automatic Pennation Angle Measuring Program (깃각 자동측정 프로그램의 신뢰도와 타당도 평가)

  • Kim, Jong-Soon
    • PNF and Movement
    • /
    • v.17 no.2
    • /
    • pp.329-337
    • /
    • 2019
  • Purpose: Ultrasound imaging is commonly used to measure the pennation angle of human skeletal muscles in vivo. However, manual assessment of the pennation angle using ultrasound images is subjective and time-consuming and requires a high level of examiner skill. The architectural analysis of human skeletal muscles is thus challenging. Automated approaches using image processing techniques are therefore required to estimate the pennation angle in ultrasound images. The purpose of this study was thus to assess the intra-tester and inter-tester reliability and validity of the pennation angle using an automatic measurement program. Methods: Twenty-two healthy young adults (mean age = 22.55 years) with no medical history of neurological or musculoskeletal disorders voluntarily participated in this study. Ultrasound imaging was used to measure the pennation angle of the gastrocnemius muscle at rest. One examiner acquired images from all the participants. The intra-tester and inter-tester reliability were evaluated using the intraclass correlation coefficient (ICC) to estimate reliability. Validity was measured using Pearson's correlation coefficient. Results: The intra-rater reliability was excellent for the automatic pennation angle measuring program and the manual pennation angle assessment method (ICC>0.95). The inter-rater reliability was also excellent for both methods (ICC>0.93). All the correlation coefficients for the automatic pennation angle measuring program and the manual pennation angle assessment method were 0.79, which indicated a significantly positive correlation (p<0.05). Conclusion: Pennation angle measurement using the automatic pennation angle measuring program showed acceptable reliability and validity. This study therefore demonstrated that the automatic measuring program was able to automatically measure the pennation angle of skeletal muscles using ultrasound images, and thus made it easy to investigate skeletal muscle architecture.

Construction of the Mobility to Participation Assessment Scale for Stroke (MPASS) and Testing Its Validity and Reliability in Persons With Stroke in Thailand

  • Nawarat, Jiraphat;Chaipinyo, Kanda
    • Journal of Preventive Medicine and Public Health
    • /
    • v.55 no.4
    • /
    • pp.334-341
    • /
    • 2022
  • Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

Influence of the Condition with and without External Support on the Strength of Hip Flexor in Supine in Subjects without Core Stabilization

  • Jeon, In-Cheol
    • The Journal of Korean Physical Therapy
    • /
    • v.32 no.6
    • /
    • pp.335-340
    • /
    • 2020
  • Purpose: This study was performed to investigate the influence of the condition with and without external support on the strength of hip flexor in supine position in subjects without core stabilization. Hip flexor muscles are very functional in the hip joint structures. Therefore, it is essential to evaluate the strength of hip flexor in a clinical and precise way. Methods: Twenty subjects participated in this study. The double bent leg-lower test was used to evaluate subjects without core stabilization. The strength of hip flexor muscles was evaluated in supine position, both with and without external support condition. The paired t-test was used to compare the strength of hip flexor muscles according to external support. The level of statistical significance was at α=0.05. The intra-rater reliability of the repeated measures of hip flexor strength was estimated by calculating the intra-class correlation coefficients (ICC). Results: In subjects without core stabilization, the strength of hip flexor in supine was greater with external support than that without external support (p<0.05). In addition, the intra-rater reliability with an ICC (3, 1) of the strength measurement of hip flexor with external support was higher than that without external support. Conclusion: In subjects without core stabilization, the condition with external support can contribute to the strength of hip flexor in supine position and the strength measurement of hip flexor should be considered with the condition with and without external support.

Intra- and Inter-rater Reliabilities of Infrasternal Angle Measurement

  • Kim, Moon-Hwan;Weon, Jong-Hyuck
    • The Journal of Korean Physical Therapy
    • /
    • v.27 no.3
    • /
    • pp.154-158
    • /
    • 2015
  • Purpose: The purpose of this study was to propose a new reference point for measurement of the infrasternal angle and to investigate the intra- and inter-rater reliabilities of infrasternal angle measurement using photographs. Methods: Twenty-four healthy male college students participated as subjects in this study. Photographs were taken of subjects in two postures, one standing with the shoulders relaxed and one standing with the shoulders at $150^{\circ}$ abduction. All photographs were analyzed using Image J software. Raters used the photographs to measure the infrasternal angle between the xiphoid process, the medial margin of rib and navel on the right and left sides. The reliability of the infrasternal angle measurement was assessed by means of intraclass correlation coefficients [ICC (3,1)]. The level of statistical significance was set at p<0.05. Results: The intra- and inter-rater reliabilities of the infrasternal angle measurement for the right side at rest were excellent (ICC=0.866 and 0.813, respectively), as were those for the left side at rest (ICC=0.919 and 0.846, respectively). At $150^{\circ}$ shoulder abduction, the intra- and inter-rater reliabilities for measurement of the infrasternal angle on the right side were excellent (ICC=0.972 and 0.778, respectively), as were those for the left side (ICC=0.914 and 0.826, respectively). Conclusion: These findings suggest that this technique can be successfully used to measure the infrasternal angle, thus suggesting a new reference point for determining the length of the internal oblique and external oblique muscles in clinical situations.

The inter-rater absolute reliability and validity of the Figure-of-8 Walk test in patients with chronic stroke (만성 뇌졸중 환자 8자 모양 경로 보행 검사의 측정자간·절대적 신뢰도와 타당도)

  • Park, Chang-Sik
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.18 no.5
    • /
    • pp.467-474
    • /
    • 2017
  • To investigate the intra-rater absolute reliabilities and validity of the Figure of-Eight Walk test (F8WT) in patients with chronic stroke. A total of 36 subjects with chronic stroke participated in this study. The inter-rater reliability of F8WT was calculated using intra-class correlation coefficients($ICC_{2,1}$). Moreover, we used the standard error measurement (SEM) and the small real difference (SRD) to examine the absolute reliability indices. The validity was demonstrated by a spearman correlation of F8WT with Postural Assessment Scale for Storke(PASS) and Trunk Impairment Scale(TIS). The inter-rater reliability of F8WT was excellent; ICC2,1=0.95(0.91~0.97), acceptable SEM=1.02, and SRD=2.82. F8WT were also found to be significantly associated with PASS(r=-0.82) and TIS(r=-0.85). Therefore, F8WT is a reliable measurement tool and is correlated well with stroke-impairments, such as postural and trunk control. F8WT will be a useful tool in evaluating the walking performance of subjects with chronic stroke.

Analysis of Visual Sensibility Evaluation of Naturally Colored Organic Cotton: Identification of Reliability and Proper Scouring Method

  • Park, Jang-Woon;Chang, Yoon;Hong, Won-Gi;Lee, Myung-Eun;Han, Ah-Reum;Chae, Young-Joo;Cho, Gil-Soo;You, Hee-Cheon
    • Journal of the Ergonomics Society of Korea
    • /
    • v.30 no.2
    • /
    • pp.311-317
    • /
    • 2011
  • Objective: The present study was intended to identify (1) the intra- and inter-rater reliabilities of a visual sensibility evaluation protocol and (2) the effects of NaCOC color and scouring method on the visual sensibility of NaCOC. Thirty female participants(20s & 30s) were participated in the visual sensibility evaluation of NaCOC. Background: Interests in naturally colored organic cotton(NaCOC) increase rapidly in parallel with the social trend of eco-friendly living and wellbeing. Method: Three color sets (ivory, green, and coyote-brown) of NaCOC specimens including one untreated and four treated specimens($Na_2CO_3$; NaOH; enzyme; boiling water) were examined in the study. The visual sensibility evaluation was conducted by the test-retest method using nine pairs of bipolar visual sensibility adjectives(bright-dark; clear-murky; heavy-light; vivid-subdued; warm-cool; fresh-stale; strong-weak; showy-plain; and luxurious-cheap). Results: As a result of reliability of a visual sensibility evaluation protocol, inter-rater variability(average SD=1.06) of visual sensibility evaluation was more than 1.4 times the intra-rater variability(average SD=0.74). However, both the sensibility evaluation reliabilities did not show any systematic pattern of changes. Lastly, ANOVA and post-hoc analysis showed that preferred scouring methods for a visual sensibility adjective pair significantly vary depending on NaCOC color. Application: Both the reliability of visual sensibility evaluation protocol and the analysis of proper scoring method of NaCOC in the study would be useful information to design the affective textile.

Inter- and Intra-rater Reliability of Pattern Identification Using Nasal Endoscopy for Allergic Rhinitis (비내시경을 활용한 알레르기 비염에 대한 한의학적 변증 지표의 관찰자간, 관찰자내 신뢰도 연구)

  • Kim, Kyu-Seok;Yun, Young-Hee;Park, Jeong-Su;Kim, Nam-Kwen;Kim, Kyung-Jun;Kim, Hee-Taek;Hong, Seung-Ug;Jang, Bo-Hyeong;Yoon, Hwa-Jung;Choi, In-Hwa;Ko, Seong-Gyu
    • The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
    • /
    • v.26 no.2
    • /
    • pp.10-18
    • /
    • 2013
  • Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

A Reliability Study on the Auditory-perceptual Evaluation of Parkinsonian Dysarthria (파킨슨증으로 인한 마비말장애의 청지각적 평가에 대한 신뢰도 연구)

  • Kim, Hyang-Hee;Lee, Mi-Sook;Kim, Sun-Woo;Lee, Won-Yong
    • Speech Sciences
    • /
    • v.11 no.4
    • /
    • pp.129-141
    • /
    • 2004
  • An auditory-perceptual evaluation has long been utilized in assessing dysarthric speech. The process involves subjective judgement and the results might vary depending on clinical experiences or training of listeners. This study aimed to investigate reliability of the auditory-perceptual evaluation of 22 multi -dimensional variables on 6 patients with Parkinsonian speech disorders. Listeners were divided into two groups: one consisted of 6 speech therapists with clinical experiences for three years or more, and the other 6 graduate students without any previous clinical background. The results showed that the former evaluated dysarthric speech with higher inter-rater and intra-rater reliabilities than the latter. Furthermore, such speech variables as 'precise consonant: 'speech intelligibility: and 'SMR regularity' were more influenced than others by clinical experiences. We, therefore, postulated that a reliable auditory-perceptual evaluation of dysarthric speech may require adequate amount of clinical training of listeners.

  • PDF

Agreement of Manual Muscle Testing and Test-Retest Reliability of Hand Held Dynamometer for the Posterior Gluteus Medius Muscle for Patients With Low Back Pain (요통 환자를 대상으로 후중둔근 도수근력검사의 일치도 및 휴대용 근력계 측정 방법의 신뢰도 검사)

  • Park, Kyue-Nam;Kim, Hyun-Sook;Choi, Houng-Sik;Lee, Won-Hwee;Ha, Sung-Min;Kim, Su-Jung
    • Physical Therapy Korea
    • /
    • v.18 no.3
    • /
    • pp.67-75
    • /
    • 2011
  • The purpose of this study was to assess the agreement of manual muscle testing (MMT) and test-retest reliability of a hand held dynamometer for the posterior gluteus medius muscle, with and without lumbar stabilization, using a pressure biofeedback unit for patients with low back pain. The pressure biofeedback unit was used to minimize the substitute motion of the lumbopelvic region during hip abduction in patients lying on their side. Fifteen patients with low back pain participated in this study. A tester determined the MMT grades of the posterior gluteus medius with and without the pressure biofeedback unit. Active hip abduction range of motion with an inclinometer and the strength of their posterior gluteus medius using a hand held dynamometer were measured with and without the pressure biofeedback unit in the MMT position. The agreement of the grade of muscle strength in the MMT, and intra-rater reliability of both the active hip abduction range of motion and the strength of posterior gluteus medius were analyzed using the weighted kappa and intraclass correlation coefficient (ICC), respectively. The agreement of MMT with the pressure biofeedback unit (weighted kappa=.92) was higher than the MMT (weighted kappa=.34)(p<.05). The inclinometer with pressure biofeedback unit measurement of the active hip abduction range of motion had an excellent intra-rater reliability (ICC=.90). Also, the hand held dynamometer with pressure biofeedback unit measure of strength of the posterior gluteus medius had a good intra-rater reliability (ICC=.85). Therefore, the test for muscle strength with pressure biofeedback unit will be a reliable method for the determination of the MMT grades or amount of posterior gluteus medius muscle strength and the measurement of the range of motion for hip abduction in patients with low back pain.