• Physical Therapy Korea
• /
• v.20 no.2
• /
• pp.46-51
• /
• 2013

The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

• Journal of Korean Academy of Nursing
• /
• v.48 no.4
• /
• pp.419-431
• /
• 2018

Purpose: The purpose of this study was to develop and establish the psychometric properties of a clinical nursing competency evaluation tool to be utilized by clinical preceptors. Methods: The initial items were identified through in-depth literature review and field interviews based on a hybrid model. Content validation of the items was evaluated through three rounds of content validity testing. Participants were 34 clinical preceptors and 443 nursing students participating in clinical practice. Data were analyzed using exploratory and confirmatory factor analysis, convergence and discriminant validity, internal consistency and inter-rater reliability. Results: The final scale consisted of 23 items and four factors, fundamental nursing skills performance, critical thinking skills based on the nursing process, basic nursing knowledge, and professional attitude; these factor explained 69.7% of the total variance. The analysis with multi-trait/multi-item matrix correlation coefficients yielded 100.0% and 95.7 % convergence and discriminant validity, respectively. Cronbach's alpha for the total items was .95. The four subscale model tested by confirmatory factor analysis was satisfactory. Inter-rater reliability ranged from .912 to .967. Conclusion: This scale was found to be a reliable and valid instrument that clinical preceptors can apply for evaluating the clinical nursing competency of nursing students in clinical settings.

• Journal of Korean Academy of Nursing
• /
• v.40 no.1
• /
• pp.110-118
• /
• 2010

Purpose: To develop outcome indicators of urinary incontinence to measure quality of care in long term care hospitals in Korea. Methods: The draft indicators of urinary incontinence were developed from a literature review and clinical expert panel. A survey of medical records of 280 patients in 20 hospitals was conducted to test inter-rater reliability. Statistical analysis was done to test risk adjustment criteria, variation between hospitals, and stability of indicators, using assessment data from 77,918 patients in 623 hospitals. Results: The inter-rater reliability of items was high (Kappa range: 0.66- 0.92). Severe cognitive impairment (odds ratio [OR]: 3.15, confidence interval [CI]: 3.03-3.26) and total mobility activities of daily living (ADLs) dependency (OR: 4.85, CI: 4.72-4.98) increased the prevalence of urinary incontinence, thus they proved to be significant criteria to stratify high and low risk groups. The prevalence for low risk showed more substantial variation than the high risk group. The indicators were stable over one month. Conclusion: This study demonstrated the feasibility of outcome indicators of urinary incontinence. Improving the reliability of the patient assessment tool and refining the indicators through validation study is a must for future study.

• Speech Sciences
• /
• v.14 no.1
• /
• pp.73-89
• /
• 2007

This study explored the perception of transplanted English prosody by thirty American and Korean, male and female listeners. The English utterances of various sentence types produced by Korean and American male speakers were employed to transplant the American prosody contours to Korean English utterances. Then, the thirty subjects were instructed to rate the transplanted prosodic components. Results showed that the interactions between the three factors (e.g., rater groups & transplantation types; transplantation types & sentence types; rater groups & transplantation types & sentence types) turned out to be meaningful. Both Americans and Koreans perceived the effectiveness of the combined effect of transplanted duration and pitch or duration and pitch and intensity. However, when perceiving individual prosodic components, Americans and Koreans showed different perceptual ratings. As for the overall prosody change, Americans perceived the change of intensity in a significant way but Koreans did not because intensity is not a crucial semantic factor in Korean. Americans rated the transplantation of duration alone as ineffective while Koreans rated otherwise. This was explained by the difference between English and Korean. The difference of perspective was also significant with different sentence types, especially with the three sentence types that had speech rates slower than other sentence types. A slower speech rate intensified the mismatch between the transplanted duration and the original pitch causing a negative impression on American listeners whereas this did not affect Korean listeners. Pedagogical implications of the findings are discussed.

• The Journal of Korean Physical Therapy
• /
• v.22 no.5
• /
• pp.83-93
• /
• 2010

Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

• Journal of Information Technology Services
• /
• v.17 no.2
• /
• pp.111-128
• /
• 2018

About 3.9 million apps and 24 primary categories can be approved on Apple iTunes Store. Making accurate categorization can potentially receive many benefits for developers, app stores, and users, such as improving discoverability and receiving long-term revenue. However, current categorization problems may cause usage inefficiency and confusion, especially for cross-attribution, etc. This study focused on evaluating the reliability of app categorization on Apple iTunes Store by using several rounds of inter-rater reliability statistics, locating categorization problems based on Machine Learning, and making more accurate suggestions about representative functionality stems for each primary category. A mixed methods research was performed and total 4905 popular apps were observed. The original categorization was proved to be substantial reliable but need further improvement. The representative functionality stems for each category were identified. This paper may provide some fusion research experience and methodological suggestions in categorization research field and improve app store's categorization in discoverability.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.655-658
• /
• 2009

Fractal dimension has been used for texture analysis as it is highly correlated with human perception of surface roughness and applied to quantifying the structures of wide range of objects in biology and medicine. On the other hand, the evaluation of the human skin state is based solely on the subjective assessment of clinicians; this assessment may vary from moment to moment and from rater to rater. Therefore we attempt to analysis of skin texture image using fractal dimension and discuss its application to evaluating human skin state. It can be helpful for extracting human features and also can be useful for detection of many human skin diseases. This paper presents a method to calculate fractal dimension of skin with use of camera lens magnification. We take multiple pictures frequently from skin with different camera lens magnification as a magnification factor of fractal set, and counting the number of objects (cells) in each picture as a number of self similar pieces of fractal set.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.2
• /
• pp.1201-1216
• /
• 2017

In this study, we described the development of a methodology to measure tip-pinch strength on the paretic hand rehabilitation device and aimed to investigate reliability of the device. FSR sensors were embedded on the device, and tip pinch strength was estimated with data collected from the sensors using a developed equation while participants were demonstrating tip pinch. Reliability tests included inter-rater, test-retest, and inter-instrument reliability. B&L Engineering pinch gauge was utilized for the comparison. Thirty-seven healthy students participated in the experiment. Both inter-rater and test-retest reliability were excellent as Intraclass Correlation Coefficients (ICCs) were greater than 0.9 (p<0.01). There were no statistically significant differences in tip-pinch strengths. Inter-instrument reliability analysis confirmed good correlation between the two instruments (r = 0.88, p < 0.01). The findings of this study suggest that the two instruments are not interchangeable. However, the tip-pinch mechanism used in the paretic hand rehabilitation device is reliable that can be used to evaluate tip pinch strength in clinical environment and can provides a parameter that monitors changes in the hand functions.

• Phonetics and Speech Sciences
• /
• v.7 no.2
• /
• pp.149-156
• /
• 2015

We propose a new method for automatic fluency scoring of English speaking tests spoken by nonnative speakers in a free-talking style. The proposed method is different from the previous methods in that it does not require the transcribed texts for spoken utterances. At first, an input utterance is segmented into a phone sequence by using a phone recognizer trained by using native speech databases. For each utterance, a feature vector with 6 features is extracted by processing the segmentation results of the phone recognizer. Then, fluency score is computed by applying support vector regression (SVR) to the feature vector. The parameters of SVR are learned by using the rater scores for the utterances. In computer experiments with 3 tests taken by 48 Korean adults, we show that speech rate, phonation time ratio, and smoothed unfilled pause rate are best for fluency scoring. The correlation of between the rater score and the SVR score is shown to be 0.84, which is higher than the correlation of 0.78 among raters. Although the correlation is slightly lower than the correlation of 0.90 when the transcribed texts are given, it implies that the proposed method can be used as a preprocessing tool for fluency evaluation of speaking tests.

• Journal of the Korean Data and Information Science Society
• /
• v.23 no.1
• /
• pp.25-37
• /
• 2012

Many statistics, such as Cohen's (1960) ${\kappa}$, Scott's (1955) ${\pi}$, and Park and Park's (2007) H have been proposed as measures of agreement to represent inter-rater reliability. This study compared bias, SE, MSE, and CV of the measures of agreement with nominal and ordinal categories in the balanced marginal distributions, and those with nominal categories in the two paradoxical situations. As a result, in all cases, AC1and Hhad smaller SE and CV.