• Journal of The Korean Society of Integrative Medicine
• /
• v.8 no.3
• /
• pp.173-180
• /
• 2020

Purpose : The aim of this study was to assess the intra- and inter-rater reliability and validity of measurements of head, neck, and pelvis posture using a mobile application in subjects with forward head posture. Methods : Forty-eight volunteers (22 men, 26 women) participated in this study. Two raters independently examined whole body picture images in a lateral standing posture with arms crossed using a CA-Smart Posture Reminder (CA-SPR), and a rater took and calculated posture images twice to assess reliability. We measured five parameters: craniovertebral angle 1 (CVA1), anterior shoulder translation (AST), pelvic tilt (PT), knee angle (KA), and ankle angle (AA) in the subject's sagittal plane using CA-SPR. We examined whole spine X-ray images in the same position to assess validity. We measured four variables in the subjects: CVA2, translation distance (AHT), anterior pelvic plane (APP), and sacral slope (SS). The intra- and inter-rater reliability were calculated using the intraclass correlation coefficient (ICC). Convergent validity was calculated using Pearson's correlation coefficient. Results : The intra-rater reliability (ICC=.889 -.989) and inter-rater reliability (ICC=.800 -.980) were excellent for all variables measured using CA-SPR. The variables measured using CA-SPR and X-ray were significantly positively correlated (r=.623, p<.01). However, the correlation of the variables in the pelvis was not statistically significant. Conclusion : This study shows that a mobile application (CA-SPR) is a useful tool for measuring head and neck posture in subjects with forward head posture. However, further study is needed to measure pelvic variables when using a mobile application.

• The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
• /
• v.30 no.4
• /
• pp.97-103
• /
• 2017

Objectives : To identify whether pattern identification using nasal endoscopy for rhinitis can be applied as a tool for evaluating rhinitis in routine care setting, we performed a inter-rater reliability study on this pattern identification. Methods : Two Korean medicine doctors assessed 290 left/right nasal endoscopy photograph cases of rhinitis patients with pattern identification using nasal endoscopy. This pattern identification consist of four assessment items, nasal membrane color(pale/hyperemia), nasal membrane humidity(dryness/dampness), rhinorrhea(watery/yellow), and turbinate membrane edema(atrophic/edematous). Cohen's kappa statistic and Percentage agreement were used to evaluate the inter-rater reliability. Results : Inter-rater percentage agreement and Kappa coefficient for left nasal endoscopy photograph cases was from 'slight' to 'moderate'(% agreement: 40.00-67.59%/Kappa: 0.06-0.407). Only the agreement of 'rhinorrhea (watery/yellow)' item was moderate(% agreement: 67.59%/Kappa: 0.407). Inter-rater percentage agreement and Kappa coefficient for right nasal endoscopy photograph cases was also from 'slight' to 'moderate'(% agreement: 42.41-68.97%/Kappa: 0.109-0.465). Only the agreement of 'rhinorrhea(watery/yellow)' item was moderate(% agreement: 68.97%/Kappa: 0.465). Conclusions : It is necessary to resolve problems such as cut-off value setting, bipolar evaluation values(pale/hyperemia, dryness/dampness, watery/yellow, atrophic/edematous) and weighting items. Further rigorous studies that overcome the limitations of the current research are warranted.

• Physical Therapy Rehabilitation Science
• /
• v.11 no.4
• /
• pp.488-492
• /
• 2022

Objective: The purpose of this study is to find out the reliability and validity of the newly updated Balancia 2.5 program using Wii balance board through equipment that can measure center of pressure data with the precision. Design: Cross-sectional study Methods: Twenty-seven healthy adults participated in the study. The subjects were assessed for static balance ability by Accusway, and were assessed for static balance ability on Wii balance board connected to theBalancia 2.5 program.To limit postural fluctuations due to stare, the subjects were asked to look at a 15 cm dot drawn 3 m in front of them for 30 seconds with their eyes open. Static balance ability data such as path length and sway velocity were extracted from all measurement tools.Intra-rater and inter-rater reliability and validity were extracted through intraclass correlation coefficient (ICC) and 95% confidence interval (CI). Results: The intra-rater reliability that the same rater shows consistent results through test-retest was a high level at ICC=0.968 (0.926~0.986), and inter-rater reliability that the requires consistent results even when measured by different raters was a high level at ICC=0.943 (0.870~0.975). The validity was a high level at ICC=0.948 (0.881~0.977), which shows whether the measurement tool is properly measuring what it is intended to measure. Conclusions: The Balancia 2.5 program, newly updated through this study, proved to be a program with high reliability and validity in evaluating static balance ability like the existingBalancia 2.0 program.

• The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
• /
• v.26 no.2
• /
• pp.10-18
• /
• 2013

Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

• Physical Therapy Korea
• /
• v.26 no.2
• /
• pp.24-33
• /
• 2019

Background: Spontaneous use of the upper extremities on the affected side of patients with stroke is a meaningful indicator of recovery and may vary by the age or dominant hand of patients. No prior study has reported changes in actual amount of use test (AAUT) and motor activity log (MAL)-28 according to age and handedness in healthy adults, and AAUT inter-rater reliability for assessment of healthy adults. Objects: This study aimed to (1) research the differences in AAUT and MAL-28 according to age and handedness in healthy adults, and (2) determine the inter-rater reliability of the AAUT. Methods: Seventy healthy adults participated in this study. The MAL-28 was assessed by dividing 61 subjects into young right-handed ($n_1=20$), young left-handed ($n_2=21$), and older right-handed ($n_3=20$) groups. The AAUT was assessed by dividing 63 subjects into young right-handed ($n_1=25$), young left-handed ($n_2=18$), and older right-handed ($n_3=20$) groups. Student's t-test and the Wilcoxon signedrank test were used for statistical analysis. Results: The Amount of Use (AOU) scale values for each group showed no significant differences between age groups and handedness groups in the MAL-28 (p>.05). The AAUT AOU scale value showed significant differences regarding dominant handedness in the AAUT (p<.05), but no significant differences according to age (p>.05). (2) Inter-rater reliability of the AAUT was excellent, except few items (item 9, 11, and 12). Conclusion: Although both the MAL-28 and the AAUT measured how much participants used their dominant arms in healthy subjects, the AAUT only showed significantly higher dominant arm use in left hander than the right hander. In addition, the inter-rater reliability of the AAUT was excellent. Current results can be utilized as a basic information when clinicians develop rehabilitation strategies, and AAUT was shown to be a reliable evaluation tool for measurement of upper extremity use in Korean adults, based on the reliability demonstrated by this study.

• Physical Therapy Korea
• /
• v.20 no.2
• /
• pp.60-68
• /
• 2013

The purpose of this study was to assess the intra-rater test-retest reliability of tibial external rotation angle measurement using a smartphone-based photographic goniometer, DrGoniometer (DrG) compared to a three-dimensional motion analysis system (Vicon). The current study showed an interchangeable method using DrG to measure the tibial external rotation angle in standing knee flexion at $90^{\circ}$. Twelve healthy subjects participated in this study. A rest session was conducted 30 minutes later for within-day reliability and five days later for between-day intra-rater test-retest reliability. To assess the validity of the measurement using DrG, we used a three dimensional motion analysis system as a gold standard to measure the angle of tibial external rotation. Intra-class correlation coefficient (ICC) and the standard error of measurement (SEM) values were used to determine the within- and between- day intra-rater test-retest reliability of using DrG and a three dimensional motion analysis system. To assess validity, Pearson correlation coefficients were used for two measurement techniques. The measurement for tibial external rotation had high intra-rater test-retest reliability of within-day (ICC=.88) and between-day (ICC=.83) reliability using DrG and of within-day (ICC=.93) and between-day (ICC=.77) reliability using a three-dimentional motion analysis system. Tibial external rotation angle measurement using DrG was highly correlated with those of the three-dimensional motion analysis system (r=.86). These results represented that the tibial external rotation angle measurement using DrG showed acceptable reliability and validity compared with the use of three-dimensional motion analysis system.

• The Journal of Korean Association of Computer Education
• /
• v.17 no.2
• /
• pp.39-51
• /
• 2014

In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

• The Journal of the Korea Contents Association
• /
• v.20 no.9
• /
• pp.511-519
• /
• 2020

The aim of this study was to translate and validate the revised Nottingham Sensory Assessment(rNSA) in Republic of Korea. A cross-sectional study was conducted to translate the rNSA into Korean using a modified forward/backward translation procedure. Inter-rater and intra-rater reliability, internal consistency, and concurrent validity were investigated to validate the Korean version rNSA. The Korean version rNSA showed excellent inter-rater reliability (r=0.92-1.00) and intra-rater reliability (r=0.93-1.00). Significant correlations were found between sensory assessment results of the Korean version of the rNSA and the Korean Fugl Meyer Assessment Sensory subscales (r=0.96). The Cronbach α value of internal consistency of Korean version rNSA was ranged from 0.73 to 0.90, the value of K-FMA-S was ranged from 0.70 to 0.88. In these results, psychometric properties of the Korean version of the rNSA achieved the standard level and can be feasible in clinical practice to assess sensory function following stroke in Republic of Korea.

• Physical Therapy Korea
• /
• v.19 no.4
• /
• pp.46-54
• /
• 2012

Ely's test is commonly used to assess rectus femoris muscle flexibility. however, a reliability limit of this test was demonstrated by a previous study. In this study, we present an alternative method using an application for a digital horizontal level in a smartphone (DHLS) to complement the reliability limit of Ely's test. The aim of this study was to examine the reliability of Ely's test using DHLS on the pelvis, compared to using visual observation (VO) of pelvic and hip motions. Nineteen patients with lumbar extension-rotation syndrome were recruited for this study. An examiner examined the rectus femoris flexibility (both pass/fail and goniometer scoring) through Ely's test using both DHLS and VO. A retest session was completed two hours later for within-day reliability and seven days later for between-day intra-rater test-retest reliability. Results showed higher Kappa values for pass/fail scoring and higher intraclass correlation coefficient values for goniometer scoring in Ely's test using DHLS, compared to using VO. Measurement error and Bland and Altman plots further demonstrated the degree of intra-rater variance during Ely's test using DHLS in a clinical setting, compared to using VO. These results demonstrated that Ely's test using DHLS showed acceptable reliability compared to using VO. Ely's test using DHLS could be widely used for measuring the rectus femoris muscle flexibility in patients with lumbar extension-rotation syndrome, although the inter-rater reliability needs to be established first.

• The Journal of Korean Physical Therapy
• /
• v.27 no.3
• /
• pp.154-158
• /
• 2015

Purpose: The purpose of this study was to propose a new reference point for measurement of the infrasternal angle and to investigate the intra- and inter-rater reliabilities of infrasternal angle measurement using photographs. Methods: Twenty-four healthy male college students participated as subjects in this study. Photographs were taken of subjects in two postures, one standing with the shoulders relaxed and one standing with the shoulders at $150^{\circ}$ abduction. All photographs were analyzed using Image J software. Raters used the photographs to measure the infrasternal angle between the xiphoid process, the medial margin of rib and navel on the right and left sides. The reliability of the infrasternal angle measurement was assessed by means of intraclass correlation coefficients [ICC (3,1)]. The level of statistical significance was set at p<0.05. Results: The intra- and inter-rater reliabilities of the infrasternal angle measurement for the right side at rest were excellent (ICC=0.866 and 0.813, respectively), as were those for the left side at rest (ICC=0.919 and 0.846, respectively). At $150^{\circ}$ shoulder abduction, the intra- and inter-rater reliabilities for measurement of the infrasternal angle on the right side were excellent (ICC=0.972 and 0.778, respectively), as were those for the left side (ICC=0.914 and 0.826, respectively). Conclusion: These findings suggest that this technique can be successfully used to measure the infrasternal angle, thus suggesting a new reference point for determining the length of the internal oblique and external oblique muscles in clinical situations.