• Journal of Preventive Medicine and Public Health
• /
• 제42권1호
• /
• pp.49-58
• /
• 2009

Objectives : The purpose of the current study was to evaluate the usefulness of the following four comorbidity indices in gastric cancer patients who underwent surgery: Charlson Comorbidity Index(CCI), Cumulative Illness rating scale(CIRS), Index of Co-existent Disease(ICED), and Kaplan-Feinstein Scale(KFS). Methods : The study subjects were 614 adults who underwent surgery for gastric cancer at K hospital between 2005 and 2007. We examined the test-retest and inter-rater reliability of 4 comorbidity indices for 50 patients. Reliability was evaluated with Spearman rho coefficients for CCI and CIRS, while Kappa values were used for the ICED and KFS indices. Logistic regression was used to determine how these comorbidity indices affected unplanned readmission and death. Multiple regression was used for determining if the comorbidity indices affected length of stay and hospital costs. Results : The test-retest reliability of CCI and CIRS was substantial(Spearman rho=0.746 and 0.775, respectively), while for ICED and KFS was moderate(Kappa=0.476 and 0.504, respectively). The inter-rater reliability of the CCI, CIRS, and ICED was moderate(Spearman rho=0.580 and 0.668, and Kappa=0.433, respectively), but for KFS was fair(Kappa=0.383). According to the results from logistic regression, unplanned readmissions and deaths were not significantly different between the comorbidity index scores. But, according to the results from multiple linear regression, the CIRS group showed a significantly increased length of hospital stay(p<0.01). Additionally, CCI showed a significant association with increased hospital costs (p<0.01). Conclusions : This study suggests that the CCI index may be useful in the estimation of comorbidities associated with hospital costs, while the CIRS index may be useful where estimatation of comorbiditie associated with the length of hospital stay are concerned.

• 재활치료과학
• /
• 제8권4호
• /
• pp.77-92
• /
• 2019

목적 : 본 연구의 목적은 낙상 위험 주거환경 평가인 HOME FAST의 국내사용을 위해 체계적인 절차를 통해 한국어로 번안하여 내용이해도 및 신뢰도를 검증하고자 하였다. 연구 방법 : 한글로 번역된 HOME FAST의 내용이해도를 알아보기 위해 작업치료사 총 21명에게 한글번역본의 이해도 평가하게 하였다. 이후 한글번역본을 역번역 하여 원문과 비교하고 문장구조 및 의미 유사성을 평가하였다. 아울러 신뢰도 검증을 위해 지역사회에 거주하고 있는 낙상 고위험군 노인 75명을 대상으로 평가를 진행하고 내적 일치도를 검증하였다. 그중 9명의 대상자의 경우 2명의 작업치료사가 방문하여 각각 평가한 뒤 검사자 간 신뢰도를 검증하였다. 결과 : 작업치료사를 대상으로 한 내용이해도 검증 결과에서 11개 문장이 이해도가 떨어지는 것으로 나타났다. 이해도 검증 결과의 의견을 바탕으로 검증위원회를 통해 구문을 수정하고 한글번역본을 완성하였다. 한글판을 역번역하여 유사성 검증을 한 결과 문장구조에서는 3문항이 유사하지 않음으로 평가되었고, 의미적 측면에서는 총 6문항이 유사하지 않음으로 평가되었다. 최종적으로 반복적 역번역 과정을 통해 한글판 HOME FAST의 내용 타당도를 확보하였다. 한글번역본의 내적일치도는 .62(p<.01)로 나타났고, 검사자 간의 신뢰도는 .97 (p<.01)로 매우 높은 것으로 나타났다. 결론 : 본 연구는 체계적 번역-역번역 과정을 통해 HOME FAST를 한국어로 번역하였다. 아울러 한글판의 내용이해도를 검증하였고, 내적일치도 및 검사자간 신뢰도 검증을 통해 신뢰도를 입증하였다.

• 영어어문교육
• /
• 제12권1호
• /
• pp.221-238
• /
• 2006

This study investigates the reliability of plagiarism measurement in the ESL essay writing context. The current study aims to address the answers to the following research questions: 1) How does plagiarism measurement affect test reliability in a psychometric view? and 2) how do raters conceive the plagiarism in their analytic scoring? This study uses the mixed-methodology that crosses quantitative-qualitative techniques. Thirty eight international students took an ESL placement writing test offered by the University of Illinois. Two native expert raters rated students' essays in terms of 5 analytic features (organization, content, language use, source use, plagiarism) and made a holistic score using a scoring benchmark. For research question 1, the current study, using G-theory and Multi-facet Rasch model, found that plagiarism measurement threatened test reliability. For research question 2, two native raters and one non-native rater in their email correspondences responded that plagiarism was not a valid analytic area to be measured in a large-scale writing test. They viewed the plagiarism as a difficult measurement are. In conclusion, this study proposes that a systematic training program for avoiding plagiarism should be given to students. In addition, this study suggested that plagiarism is measured reliably in the small-scale classroom test.

• 한국전문물리치료학회지
• /
• 제20권3호
• /
• pp.54-61
• /
• 2013

This study was to determine the reliability and validity of manual measurements of patellar height to standard radiographic measurements in 30 knees of 15 subjects. Patellar height was measured using manual and radiographic methods. The manual measurements were performed by two examiners using digital vernier calipers with the subject sitting and the knees in $30^{\circ}$ of flexion. The radiographic measurements were performed in the same position. The reliability of the manual measurements was assessed by means of intraclass correlation coefficients [ICC(3,1)], and the validity was investigated using the Pearson's product-moment correlation coefficient and an independent t-test. The intra- and inter-rater reliabilities of the manual measurement of patellar height were excellent (ICC=.86 and .88 respectively). The validity of patellar height measured manually compared to the radiographic method was good (Pearson's r=.69). In conclusion, the manual method is an objective, qualitative measurement of patella height.

• 아동학회지
• /
• 제37권6호
• /
• pp.35-56
• /
• 2016

Objective: This study aimed to develop and validate the Childcare Adaptation Scale for Infants and Toddlers (CASIT), which is rated by teachers of Korean children. Methods: The participants consisted of 326 childcare teachers working with infants (ages 0-2 years). Content validity, discriminant validity, convergent validity, concurrent validity, internal consistency, inter-rater reliability, and item discrimination were examined using PASW 18.0 and AMOS 19.0. Results: The results of an exploratory factor analysis identified the 29-item scale and six dimensions of the scale, including group life adaptation, negative behaviors, positive affect, regular routines, activity/interest, and peer interaction. Convergent validity was examined via confirmatory factor analysis, average variation extracted (AVE), and construct reliability, and acceptable evidences of convergent validity was established. The scales were shown to be highly consistent internally and among raters. Also, the mean between the upper group and lower group of each item regarding item discrimination showed a significant difference. Conclusion: It was concluded that the CASIT, which is a quick and convenient tool for teachers to use, is a valid and reliable instrument.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제57권3호
• /
• pp.215-229
• /
• 2018

Despite the importance of learning to do mathematical proofs, researchers have reported that not only secondary school students but also undergraduate students have difficulties in learning proofs. In this study, we introduced a new toll for learning proofs and explored the reliability and the validity of peer assessment on proofs. In the course of a university in Seoul, students were given weekly proof assignments prior to class. After solving the proofs, each student had to assess other students' proofs. The inter-rater reliabilities of weekly peer assessment was higher than .9 over 90 percent of the observed cases. To examine the validity of peer assessment, we check whether students' assessments were similar to expert assessment. Analysis showed that the equivalence has been quite high throughout the semester and the validity was low in the middle of the semester but rose by the end of the semester. Based on these results, we believe instructors can consider the application of peer assessment on proving tasks as a tool to help students learn.

• 한국전문물리치료학회지
• /
• 제16권4호
• /
• pp.1-7
• /
• 2009

The active-knee-extension (AKE) test has been used to measure hamstring muscle length. The traditional AKE test measures the popliteal angle to the point of resistance with a 90-degree flexion of the hip fixed by straps, while the stabilized AKE test measures the popliteal angle to the point of resistance with a 90-degree flexion of the hip stabilized using a pressure biofeedback unit providing lumbopelvic stabilization. The purpose of this study was to determine test-retest reliability of the traditional AKE test and stabilized AKE test. Twenty healthy adults participated in the study. The popliteal angles were measured with a digital inclinometer during each test. To assess the test-retest reliability between the 2 test sessions, intraclass correlation coefficients (ICCs) were calculated. The intrasubject coefficient of variation ($CV_{intra}$) was also calculated. To compare the traditional and stabilized AKE tests for changes in pressure, paired t-tests were applied. The results of this study were as follows: 1) ICCs(3,1) value for test-retest reliability was .96 in the traditional AKE test, and was .98 in the stabilized AKE test. 2) The maximal $CV_{intra}$ was 33.7% in the traditional AKE test and 15.7% in the stabilized AKE test. 3) Differences of $6.1{\pm}2.1$ mmHg in pressure were measured in the traditional AKE test, and differences of $1.2{\pm}1.0$ mmHg in pressure were measured in the stabilized AKE test. The results show the traditional and stabilized AKE test to be highly reliable, with test-retest reliability. However, the stabilized AKE test represented less variation and more stabilization than the traditional AKE test. Further study is needed to measure the inter-rater reliability of the stabilized AKE test for generalization and clinical application.

• 디지털콘텐츠학회 논문지
• /
• 제19권7호
• /
• pp.1405-1412
• /
• 2018

한국어 의지평가 설문지를 개발하고 그 타당도가 연구되었으나, 다리 절단장애인을 대상으로 의지평가 설문지를 적용하여 신뢰도를 평가한 연구는 실시되지 않았다. 본 연구에서는 다리 절단장애인을 대상으로 개발된 한국어-PEQ를 적용하여 그에 대한 신뢰도를 평가하였다. 그 결과, 한국어-PEQ의 모든 항목에서 천장효과와 바닥효과가 15%이하로 나타나 응답의 난이도가 적절한 것으로 나타났다. 한국어-PEQ 영역별 신뢰도(inter-rater reliability)의 급간내 상관계수(intra-class coefficient, ICC)는 .719(95%CI .600~.811)~.920(95%CI .890~.945)로 나타났고, 영역간 신뢰도는 .958로 높게 나타났다. 문항 내적 일치도 Cronbach's ${\alpha}$값은 .910으로 높게 나타나 한국어-PEQ는 높은 신뢰도가 있음을 알 수 있었다.

• 한국전문물리치료학회지
• /
• 제18권1호
• /
• pp.64-73
• /
• 2011

After stroke, many people have problems with balance during movement. Balance is essential for the optimal functioning of the locomotor system and the performance of many activities of daily living. The Functional Gait Assessment (FGA) is a clinical tool for evaluating balance ability during walking. The test consists of ten tasks, seven tasks of the Dynamic Gait Index and three additional tasks. The purpose of this study was to evaluate the reliability and internal consistency of data obtained with the Korean version of the FGA when used with people after suffering a stroke. One-hundred participants, at least three months poststroke and able to walk at least six meters with or without a walking aid, participated in the study (age range=30~83 years; $mean{\pm}SD=58.8{\pm}10.9$). Two physical therapists and two physical therapy students rated the FGA. Intrarater and interrater reliability of the FGA were assessed using kappa statistic and intraclass correlation coefficients (2,1). The internal consistency of the FGA was assessed using the Cronbach alpha. The Cronbach alpha was good (${\alpha}$=.86~.93). The intrarater (intraclass correlation coefficient=.92~.95) and interrater reliability (intraclass correlation coefficient=.91, .95) of the total scores administered by the therapists and students were good, whereas the reliability for single item scores when administered by the physical therapists was moderate to good (kapa value=.42~.97). This study found that intrarater and interrater reliability for total FGA scores and internal consistency were good. Therefore, the Korean version of the FGA can be used as a reliable tool to assess the functional gait performance of patients after stroke.

• 대한물리의학회지
• /
• 제15권2호
• /
• pp.83-91
• /
• 2020

PURPOSE: Postural and structural asymmetry due to muscle imbalances around the lower back and pelvis are the causes of back pain. Muscle imbalances in patients with chronic low back pain affect the pelvic tilt and movement, and it is necessary to assess the pelvic movement ability using the appropriate tools to determine the mediating effects of lower back pain. This paper reports the reliability and validity of the Sensbalance Therapy Cushion (STC) for pelvic movement and proprioception. METHODS: In this study, the Wii balance board (WBB) was used as a golden standard for pelvic movement measurements. FABQ, KODI, Myovision, and Pelvic movement were measured in 50 patients with chronic low back pain. The correlation between the lower-back muscle activity and pelvic movement was checked. The pelvic movement parameter was measured twice to determine the intra-rater reliability. RESULTS: The STC showed high test-retest reliability in the pelvic tilt measurements (ICC = .672 - .809). The test-retest reliability of proprioception measurements (ICC = .588 - .859) and reaction time measurements (ICC = .542 - .836) were also high. The relationship between the WBB and STC showed a significant positive correlation with the pelvic tilt test (p < .01). The posterior pelvic tilt and lower-back muscle activity showed a significant negative correlation (p < .01). The pelvic left tilt and lower-back muscle activity showed a significant negative correlation (p < .05). CONCLUSION: The results revealed the high reliability and validity of the STC. Therefore, the STC can be used as an objective measuring device for evaluating pelvic tilt, proprioception, and reaction time in low back pain patients.