• Journal of Korean language education
• /
• v.29 no.1
• /
• pp.85-108
• /
• 2018

This study pointed out the reality that many novice Korean language teachers who lack rater training are scoring the learners' writing skill. The study performed and analyzed a case where pre-service teachers were educated in order to explore the possibility of promoting rater training in a Korean language teacher training course. The pre-service teachers majoring in Korean language education at the graduate school scored TOPIK compositions and were provided feedback by the FACETS program, which were further discussed at the rater meeting. In three scoring processes, the raters scored with conscious of own rating patterns and showed positive change or over correction due to excessive consciousness. Consequentially, ongoing training can improve rating ability, and considering the fact that professional rater training is hard to progress, the method composed of FACETS analysis and rater training revealed positive effects. On the other hand, the rater training including native Korean and non-native(Chinese) speakers together showed no significant difference by mother tongue but by individual difference. This can be interpreted as a positive implication to the rating reliability of non-native speakers possessing advanced Korean language abilities. However, this must be supplemented through extended research.

• The Journal of the Society of Korean Medicine Diagnostics
• /
• v.9 no.1
• /
• pp.125-130
• /
• 2005

Background and purpose: We evaluated the reliability of two electrodermal measurement devices on meridian skin areas; Electro Acupuncture according to Dr. Voll (EAV) method and newly developed MIR-1. Methods: Eighteen volunteers were tested repeatedly on the same condition with each device. To explore the intra-rater, inter-rater, and test-retest reliabilities, one rater tested each subject twice in succession, then the other rater tested the subject in a row. Finally, retests on the subjects with each device were performed 1 week later. The reliability was determined by Pearson correlation and intraclass correlation statistics. Results: EAV method showed poor reliability, while MIR-1 showed good reliability. Conclusion: It is suggested that further research on the reliability and useful device in both fields of clinical practice and biomedical research.

• The Journal of Korean Physical Therapy
• /
• v.32 no.2
• /
• pp.88-93
• /
• 2020

Purpose: This study examined the inter-rater reliability of cervical proprioception, dynamic balance ability, and ankle dorsiflexion range of motion using STARmat^®, which is a practical clinical tool that can provide practitioners and patients with quantitative and qualitative results. Methods: Thirty healthy young subjects were enrolled in this study, and two well-trained physical therapists participated as a tester. Two testers measured the cervical joint position error at the starting position after neck flexion, extension, side bending, and rotation; three dynamic balance tests, including anterior excursion, anterior reaching with single leg balance, and posterior diagonal excursion; and ankle dorsiflexion range of motion using STARmat^®. The intra-class correlation coefficient (ICC) was used to determine the inter-rater reliability of the tests. Results: The inter-rater reliability for the cervical proprioception ranged from moderate to good (0.66 to 0.83), particularly for flexion (0.82), extension (0.70), right side bending (0.73), left side bending (0.71), right rotation (0.83), and left rotation (0.66). For the dynamic balance, the inter-rater reliability ranged from good to excellent (0.87 to 0.91), particularly for anterior excursion (0.86), posterior diagonal excursion (0.87 to 0.89), and anterior reaching with a single leg balance (0.90 to 0.91). In addition, for the ankle dorsiflexion range of motion, the ICC for the inter-rater reliability ranged from 0.95 to 0.96. Conclusion: STARmat^® is a reliable tool for measuring cervical proprioception, dynamic balance tests, and ankle dorsiflexion range of motion in healthy young adults.

• Journal of the Korean Society of Physical Medicine
• /
• v.9 no.2
• /
• pp.201-211
• /
• 2014

PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

• Journal of The Korean Society of Integrative Medicine
• /
• v.9 no.1
• /
• pp.193-202
• /
• 2021

Purpose : The purpose of this study is to examine inter-and intra-rater reliabilities of myotonometric measurements of tone, elasticity and stiffness for the erector spinae muscles of the young and the elderly populations. Methods : A total of 102 (69 young adults from K university and 33 older adults from the D community center in Daejeon) were enrolled in this study. The two different raters measured each side of the erector spinae muscles at prone position. After each rater performed first measurement for a subject, 30 minutes of rest was given. The same rater then repeated the second myometric measurement on the subject. The collected data on the tone, elasticity, and stiffness of the erector spinae were analyzed using intraclass correlation coefficient (ICC) to determine inter- and intra- rater reliabilities. Results : The inter-and intra-rater reliabilities of the myotonometric measurement of the erector spinae for the total subjects were excellent (ICC > 0.9, p < 0.001). Within each of the elderly group and the young group, inter- and intra-rater reliabilities were also excellent (ICC > 0.8~0.9 / p < 0.001, ICC > 0.75~0.9 / p < 0.001, each). Conclusion : The measurement of muscle tone, elasticity, and stiffness for the erector spinae muscles using the myotonometer had excellent reliability. It was confirmed that a highly reliable myometric measurement on the erector spinae can be obtained regardless of whether it is from young or elderly people. This suggests that the myotonometer can be a useful tool to measure muscular properties of the erector spinae of the young and old as an evaluative instrument.

• Physical Therapy Korea
• /
• v.17 no.3
• /
• pp.48-58
• /
• 2010

The aim of this study was performed to determine the inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) translated in Korean. This was a new clinical measurement tool for evaluating the recovery of voluntary movement and basic mobility following stroke. A direct-observation reliability study was conducted on 20 patients who had strokes and were in a rehabilitation setting. Subjects were assessed by two physical therapists. The reliability of the STREAM scores was demonstrated by weighted kappa statistics for inter-rater agreement on scores for individual items ranged from .83 to 1.0, intraclass correlation coefficients for total score was .99, and for subscale scores was ranged from .96 to .99. The internal consistency of the STREAM scores was demonstrated by Cronbach alphas of greater than .99 on the subscales and overall. These high levels of reliability support the use of the STREAM translated in Korean instrument for the measurement of motor recovery following stroke.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.176-189
• /
• 2002

The purpose of the study is to develop major types of scoring rubrics of portfolio system, and estimate the reliability of the rubrics developed. The portfolio system was developed by Science Education Laboratory, Chongju National University of Education in summer, 2000. The portfolio is based on the Unit 2, The Layer and Fossil, and Unit 4, Heat and Change of Objects at fourth-grade level. Four types of scoring rubrics, holistic-general, holistic-specific, analytical-general, and analytical-specific, were developed. Students' portfolios were scored and inter-rater and intra-rater reliability were calculated. To estimate inter-rater reliability, 3 elementary teachers per each rubric(total 12) scored 12 students' portfolios. Teachers who used analytical-specific rubric scored only six portfolios because it took much more time than other rubrics. To estimate intra-rater reliability, second scoring was administered by two raters per rubric in two and half month. The results show that holistic-general rubric has high inter-rater and moderate intra-rater reliability. Holistic-specific rubric shows moderate inter- and intra-rater reliability. Analytical-general rubric has high inter-rater and moderate intra-rater reliability. Analytical-specific rubric shows high inter- and intra-rater reliability. The raters feel that general rubrics seems to be practical but not clear. Specific rubrics provide more clear guidelines for scoring but require more time and effort to develop the rubrics. Analytical-specific rubric requires more than two times of time to score each portfolio and is proved to be highly reliable but less practical.

• The Journal of Korean Physical Therapy
• /
• v.27 no.4
• /
• pp.183-189
• /
• 2015

Purpose: The aim of this study was to examine the test-retest and inter-rater reliability of the pediatric functional muscle testing (PFMT) when applied to children with developmental delay. Methods: Sixteen children with developmental delay (seven females, nine males) participated in this study. For the inter-rater reliability, each was scored on the PMFT by two pediatric physical therapists with more than 8 years of clinical experience on the same day. For assessment of the test-retest reliability, one therapist tested the children again within 10 days. The second measurement was performed by taking a first measurement in video. Intraclass correlation coefficient (ICC) was calculated to determine the test-retest and inter-rater reliability of the PFMT, and Chronbach's alpha was used to measure internal consistency. Results: The results of this study were as follows: 1) The test-retest ICC of the score of the infant action month and the right side of the PFMT was from 0.53 to 1.00 and from 0.63 to 0.99, respectively. 2) The inter-rater ICC of the score of the infant action month and the right side of the PFMT was from 0.66 to 1.00 and from 0.64 to 1.00, respectively. 3) Chronbach's alpha was 0.93. The internal consistency indicated excellent. Conclusion: In conclusion, this study showed that the test-retest and inter-rater reliability of the PFMT was relatively high, except for a few items. Therefore, it can be suggested that the PFMT will be a useful tool for measurement of muscle strength for children with developmental delay if it be some modifications.

• Journal of The Korean Society of Integrative Medicine
• /
• v.8 no.3
• /
• pp.173-180
• /
• 2020

Purpose : The aim of this study was to assess the intra- and inter-rater reliability and validity of measurements of head, neck, and pelvis posture using a mobile application in subjects with forward head posture. Methods : Forty-eight volunteers (22 men, 26 women) participated in this study. Two raters independently examined whole body picture images in a lateral standing posture with arms crossed using a CA-Smart Posture Reminder (CA-SPR), and a rater took and calculated posture images twice to assess reliability. We measured five parameters: craniovertebral angle 1 (CVA1), anterior shoulder translation (AST), pelvic tilt (PT), knee angle (KA), and ankle angle (AA) in the subject's sagittal plane using CA-SPR. We examined whole spine X-ray images in the same position to assess validity. We measured four variables in the subjects: CVA2, translation distance (AHT), anterior pelvic plane (APP), and sacral slope (SS). The intra- and inter-rater reliability were calculated using the intraclass correlation coefficient (ICC). Convergent validity was calculated using Pearson's correlation coefficient. Results : The intra-rater reliability (ICC=.889 -.989) and inter-rater reliability (ICC=.800 -.980) were excellent for all variables measured using CA-SPR. The variables measured using CA-SPR and X-ray were significantly positively correlated (r=.623, p<.01). However, the correlation of the variables in the pelvis was not statistically significant. Conclusion : This study shows that a mobile application (CA-SPR) is a useful tool for measuring head and neck posture in subjects with forward head posture. However, further study is needed to measure pelvic variables when using a mobile application.

• Physical Therapy Rehabilitation Science
• /
• v.11 no.4
• /
• pp.488-492
• /
• 2022

Objective: The purpose of this study is to find out the reliability and validity of the newly updated Balancia 2.5 program using Wii balance board through equipment that can measure center of pressure data with the precision. Design: Cross-sectional study Methods: Twenty-seven healthy adults participated in the study. The subjects were assessed for static balance ability by Accusway, and were assessed for static balance ability on Wii balance board connected to theBalancia 2.5 program.To limit postural fluctuations due to stare, the subjects were asked to look at a 15 cm dot drawn 3 m in front of them for 30 seconds with their eyes open. Static balance ability data such as path length and sway velocity were extracted from all measurement tools.Intra-rater and inter-rater reliability and validity were extracted through intraclass correlation coefficient (ICC) and 95% confidence interval (CI). Results: The intra-rater reliability that the same rater shows consistent results through test-retest was a high level at ICC=0.968 (0.926~0.986), and inter-rater reliability that the requires consistent results even when measured by different raters was a high level at ICC=0.943 (0.870~0.975). The validity was a high level at ICC=0.948 (0.881~0.977), which shows whether the measurement tool is properly measuring what it is intended to measure. Conclusions: The Balancia 2.5 program, newly updated through this study, proved to be a program with high reliability and validity in evaluating static balance ability like the existingBalancia 2.0 program.