• 한국과학교육학회지
• /
• 제38권3호
• /
• pp.419-430
• /
• 2018

본 연구의 목적은 과학교육에 협력적 문제해결 중심 교수모델 적용에서 학생의 인성 역량을 평가하는 평가 도구를 개발하는 것이다. 문헌 분석을 통해 개방성, 공감, 관용, 배려, 성실, 자기조절, 정직, 책임, 협력의 9개 인성 역량 구성요인을 추출하였다. 기존 인성 역량 관련 척도를 바탕으로 전문가 협의를 통해 협력적 문제해결 중심 교수모델에 기반 한 학생 인성 역량 평가 문항을 개발하였다. 전문가 집단을 대상으로 88개의 예비문항에 대한 1차 조사를 하였고, 예비조사 결과를 바탕으로 문항을 수정 보완하였다. 재구성된 문항의 타당도를 확인하고자 중 고등학교 과학교사 71명을 대상으로 2차 내용타당도 조사를 하였고, 해당 문항의 신뢰도를 검증하기 위해 평정자간 신뢰도를 산출하였다. 평가 문항의 내용타당도 및 평정자간 신뢰도는 전반적으로 양호한 수준으로 나타났고 분석 결과를 토대로 53문항을 최종적으로 선정하였다. 본 연구에서 개발한 평가 도구는 협력적 문제해결 중심 교수모델을 통한 학생의 인성 역량 변화를 알아보고 과학교육에서 학생 인성 역량을 평가하는 데 유용하게 사용될 수 있을 것이다.

• The Journal of Advanced Prosthodontics
• /
• 제14권4호
• /
• pp.203-211
• /
• 2022

PURPOSE. The aim of this study was to introduce rating criteria to evaluate student performance in a newly developed, digital wax-up preclinical program for computer-aided design (CAD) of full-coverage crowns and preliminarily investigate the reliability and internal consistency of the rating system. MATERIALS AND METHODS. This study, conducted in 2017, enrolled 47 fifth-year dental students of Okayama University Dental School. Digital wax-up training included a fundamental practice using computer graphics (CG), multipurpose CAD software programs, and an advanced practice to execute a digital wax-up of the right mandibular second molar (#47). Each student's digital wax-up work (stereolithography data) was evaluated by two instructors using seven qualitative criteria. The total qualitative score (0-90) of the criteria was calculated. The total volumetric discrepancy between each student's digital wax-up work and a reference prepared by an instructor was automatically measured by the CAD software. The inter-rater reliability of each criterion was analyzed using a weighted kappa index. The relationship between the total volume discrepancy and the total qualitative score was analyzed using Spearman's correlation. RESULTS. The weighted kappa values for the seven qualitative criteria ranged from 0.62 - 0.93. The total qualitative score and the total volumetric discrepancy were negatively correlated (ρ = -0.27, P = .09, respectively); however, this was not statistically significant. CONCLUSION. The established qualitative criteria to evaluate students' work showed sufficiently high inter-rater reliability; however, the digitally measured volumetric discrepancy could not sufficiently predict the total qualitative score.

• 성인간호학회지
• /
• 제21권6호
• /
• pp.559-569
• /
• 2009

Purpose: This study was to examine the reliability and validity of Patient-Generated Subjective Global Assessment (PG-SGA) as a nutritional measurement for stroke patients. Methods: This was a methodological study performed from May 6 to June 10, 2009 at a tertiary university hospital in Seoul. For reliability of PG-SGA, inter-rater reliability was used for statistics. For concurrent validity, BMI and biomarkers were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. In addition, sensitivity, specificity, and predictive value of PG-SGA compared with SGA were calculated using a contingency table. For predictive validity, hospital day, complications, and readmission within 1-month after discharge were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. Results: Correlation of PG-SGA score between two observers was 0.83, and kappa value for the agreement of severe malnutrition was 0.78(all $p_s$ < .001). The scored PG-SGA showed high sensitivity and specificity (100% and 96.7%, respectively). Severe undernourished patients (PG-SGA ${\geq}$ 9) had significantly low TLC, protein, albumin, and prealbumin (all $p_s$ < .01) compared with non-undernourished patients (PG-SGA 0 ~ 8). Also, in severe undernourished patients, complications and readmission (all $p_s$ = 0.01) were more often represented, and hospital days (p = .013) were significantly delayed. Conclusion: PG-SGA is a reliable and valid measurement to assess nutritional status for stroke patients.

• 생물정신의학
• /
• 제16권2호
• /
• pp.76-111
• /
• 2009

Objectives : The purpose of this study was to develop the Korean version of the Social Functioning Scale (KSFS) in the patients with schizophrenia. Methods : KSFS was administered to 90 schizophrenic patients and 80 their parents and 90 normal controls for examining the reliability and validity. Results : Data analysis showed statistically significant reliabilities and validities of KSFS. The test-retest reliability, rater vs. self-report reliability, and internal consistency for total scores of KSFS were 0.93, 0.44 and 0.94 respectively. Evidence for discriminant validity of KSFS comes from the results that the mean scores of schizophrenic patients were significantly higher than those of normal controls. Construct validity was assessed by calculating the 7 inter-areas correlations of the KSFS, and all areas were statistically significant. Significant correlations between the total scores of KSFS and those of SOFAS lend support for the concurrent validity of this instrument. Factor analyses were performed and two factors were extracted accounting for 63.7% of the variance. Sensitivity was assessed indirectly via the distribution and range of scores on the SFS. The normal control group showed a distribution around a higher mean with a moderate positive skew. Conclusion : KSFS was found to be a valid, reliable, and sensitive instrument which can be used to evaluate the degree of social functioning in the patients with schizophrenia.

• 대한소아치과학회지
• /
• 제28권4호
• /
• pp.668-672
• /
• 2001

치아우식증의 조기 진단을 위해 개발된 Diagnodent(Kavo, Germany)는 레이저 형광을 이용하는 새로운 방법으로서 그 타당도와 신뢰도가 검증될 필요성이 있다. 연구 목적은 Diagnodent를 사용한 레이저형광 우식진단법의 검사자간 신뢰도를 분석 평가하는 것이었다. 네 명의 치과의사가 발거된 사람 대구치와 소구치 100개를 대상으로 교합면 열구와 지정된 평활면을 검사하였다. 각 검사자의 측정치간의 상관성을 Pearson상관계수와 Spearman순위상관계수를 산출하였으며 척도신뢰도분석으로 검사자간 신뢰도를 분석하였다. 교합면 측정치들간의 상관성은 피어슨 상관계수가 0.703에서 0.870이었고, 평활면 측정치들간의 상관성은 0.764에서 0.932이었으며 검사자간 신뢰도는 신뢰도 계수가 교합면이 0.9450, 평활면이 0.9605이었다. 따라서, Diagnodent를 사용한 우식진단법은 검사자간 신뢰도가 매우 높았으며, 교합면을 진단할 때 평활면보다 검사자의 훈련이 더 필요하다고 사료된다.

• The Journal of Korean Physical Therapy
• /
• 제30권6호
• /
• pp.246-255
• /
• 2018

Purpose: This study was to conduct a Korean cultural adaptation of the WHO disability assessment schedule (WHODAS) 2.0: 36-item version. Methods: An internationally standardized process of translation and cultural adaptation of an instrument was used to develop a Korean version of WHODAS 2.0: 36-item version. Linking each item into the International Classification of Functioning, Disability and Health (ICF) was also conducted in order to ensure the concepts in the translated instrument were compatible with ICF. All translated versions of the instrument, linking results and feedback from participants were used for the final adaptation of the Korean version of the instrument. The Korean version of the instrument was assessed twice on different occasions to examine Inter- and intra-rater reliability, and the intra-class correlation coefficient (ICC) was calculated. Results: Twelve participants were involved in the translation and linking process. Ninety-five volunteers were invited to participate to examine the reliability of the instrument. Fifty participants completed the self-rated version of the instrument and 45 finished the interviewer version. The Korean WHODAS 2.0: 36-item version was found to have excellent reliability: self-rated version and interviewer version reliability coefficients were ICC=0.92 and ICC=0.94, respectively. Thirty-four items of the translated instrument were to be linked to ICF categories. Some adaptation was made; details and a familiar example were added to help respondents answer the questions. Conclusion: The study results show that the adaptation of the 36-item version of WHODAS 2.0 to Korean was successful and the instrument is ready for use in testing its psychometric properties.

• 한국산학기술학회논문지
• /
• 제10권12호
• /
• pp.3963-3970
• /
• 2009

본 연구에서는 컴퓨터를 이용하여 미술치료에서 윤곽선의 예리성으로 형태를 평가하고 컬러이미지스케일을 통해 색채를 평가하여 '부드러운-딱딱한'의 정도를 정량적으로 평가하는 방법을 제안한다. 회귀모형을 사용하며 종속 변수는 색채 전문가가 그림을 '부드러운-딱딱한'으로 평가한 순위가 된다. 독립변수는 그림의 명도 및 채도의 평균과 표준편차, 그림의 색채 수, 픽셀의 양, 클러스터의 수, 윤곽선의 길이 및 예리성 등을 고려한다. 단계별 회귀분석에 의하여 종속변수를 설명하는 적절한 독립변수들을 선정한다. 평가자 간의 신뢰성을 살피고 평가자 순위와 시스템 순위 간의 순위상관계수를 통해 시스템의 타당성을 입증한다. 객관적이고 정량적 평가를 가능케 함으로써 색채심리 연구, 미술치료뿐만 아니라 패션, 섬유, 인테리어 산업 등에 유용한 정보를 제공한다.

• The Journal of Korean Physical Therapy
• /
• 제32권6호
• /
• pp.341-347
• /
• 2020

Purpose: The purpose of this study is to introduce a tool for evaluating eye movement and analyze the reliability of measurement based on 10 cases of evaluating the oculomotor function of children with spastic cerebral palsy Methods: The participants were selected by 6 medical and welfare institutions in Busan as GMFCS grade 1-3 among spastic diplegia and hemiplegia. Seven examiners evaluated 3 children for the evaluation of inter-rater agreement of Ocular Motor Score (OMS) and evaluated the condition of the ocular motor of 10 children using OMS, a re-examination was performed at six weeks after the initial examination. SPSS ver.25.0 was used to calculate the interclass correlation coefficient and Wilcoxon's signed-rank test, Mann Whitney-U test. Results: The inter-rater agreement of OMS was 0.89. Second mean values were decreased compared first examination in motility/ductions/version, saccades and smooth pursuit, but there was no significant difference. Children under 6 years old had a high mean value of saccades in first examination and the motility/ductions/version, fixation, saccades in second examination, but there was no significant difference. Spastic diplegia children's mean values were higher in head posture, fixation in 8 gaze directions than hemiplegia children in both first and second examination, but there were no significant differences. Conclusion: Ocular motor function in 10 children of spastic children who participated in the study and could see that the scores was differed depending on age, type, grade of cerebral palsy. OMS may be available for this purpose.

• 아동학회지
• /
• 제38권3호
• /
• pp.91-111
• /
• 2017

Objective: This study aimed to review scales and tests developed for or validated with children and their families that were published in the Korean Journal of Child Studies from 1984 to 2016. Specifically, the purpose of the present study was to analyze the contents and format of the selected instruments, as well as to evaluate their psychometric properties. Methods: Using several databases and journal archives from the Korean Journal of Child Studies, searches were implemented using the key terms: instrument, scale, development, and validation. Instruments from 76 selected studies were reviewed based on several characteristics, such as assessment areas, contents, respondents, responding types, and psychometric properties. Results and Conclusion: First, a majority of the reviewed instruments were developed for infants and children, whereas only one was developed for adolescents. With regard to their specific measurement domains, many instruments focused on social emotional development among children. Second, with a few exceptions, the selected studies provided appropriate evidence for the reliability of the instrument, including its internal consistency, inter-rater reliability, and spilt-half reliability. Many studies also reported on the criterion-related or construct validity of the instrument to establish its validity. Future studies need to develop instruments across diverse developmental areas that collect information from multiple sources and raters. In addition, more evidence on the reliability and validity of the reviewed instruments should be provided to demonstrate their psychometric qualities.

• 말소리와 음성과학
• /
• 제10권1호
• /
• pp.75-81
• /
• 2018

Diplophonia is generally defined as the perception of more than one fundamental frequency component in a voice. Its perceptual aspect has traditionally been used to evaluate diplophonia because the perceptions can be easily evaluated, but there are limitations in the validity of the reliability of the intra- and inter-raters, examination situation, and variation of voice sample. Therefore, the purpose of this study is to confirm the reliability and accuracy of auditory perceptual evaluation by comparing non-invasive indirect assessment methods (sound waveform and EGG analysis), and to identify their usefulness with diplophonia. A total of 28 diplophonic voices and 39 non-periodic voices were assessed. Three raters assessed the diplophonia by performing an auditory perception evaluation and identifying the quasi-periodic perturbations of the acoustic waveform and EGG. Among the three discrimination methods, intra- and inter-rater reliability, sensitivity, specificity, accuracy, positive likelihood ratio, and negative likelihood ratio were examined, and the McNemar test was performed to compare the discriminant agreement. The accuracy of the auditory perceptual evaluation (86.57%) was not significantly different from that of sound waveform acoustic (88.06%), but it was significantly different from that of EGG (83.33%). The reading time (6.02 s) for the auditory perceptual evaluation was significantly different from that for sound waveform analysis (30.15 s) and EGG analysis (16.41 s). In the discrimination of diplophonia, auditory perceptual evaluation has sufficient reliability and accuracy as compared to sound waveform and EGG. Since immediate feedback is possible, auditory perceptual evaluation is more convenient. Therefore, it can continue to be used as a tool to discriminate diplophonia in clinical practice.