• Journal of the Korean Home Economics Association
• /
• v.39 no.10
• /
• pp.169-186
• /
• 2001

The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

• Journal of Korean Society of Water and Wastewater
• /
• v.29 no.5
• /
• pp.583-590
• /
• 2015

Evaluation and comparison for the performance on the contracting-out became possible after the introduction of the performance indicators(PIs) in 2012 in Korea, And local governments and private companies are utilizing them as evaluation data to enhance the performance of the contracting-out. Several revisions on performance indicator were carried out by expert group on contents validity of PIs, But the review of the composition validity of PIs was not sufficient. In this study, the applicability, distinction ability and composition validity of PIs is evaluated by statistical method. From the results, Improvement of indicator is required in order to increase the interrelationship among indicators to enhance the compostion validity of indicators related with operation, sludge and water reuse.

• Journal of Korean Academy of Nursing Administration
• /
• v.13 no.1
• /
• pp.17-23
• /
• 2007

Purpose: The purpose of this study was to develop the tool that can be used for measuring and appraising the performance of Oncology Advanced Practice Nurse(APN). Method: On the basis of some articles about roles of oncology APN, the researcher made a temporary tool and verified both content validity and face validity. Also the reliability and construct validity were verified. Result: The reliability of this tool was measured by internal consistency. Cronbachs' ${\alpha}$ was .92. The method of verification of construct validity was used known group technique because of small numbers of Oncology APN. Conclusions: This performance appraisal tool of Oncology APN was verified by both the reliability and construct validity. In future, this tool will be able to be used for appraisal and verifying of nursing care of Oncology APN.

• Korean Journal of Child Studies
• /
• v.26 no.2
• /
• pp.27-41
• /
• 2005

The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

• Journal of Educational Research in Mathematics
• /
• v.9 no.1
• /
• pp.333-350
• /
• 1999

The purpose of this study is to define performance assessment of mathematics, to make a model of performance task of mathematics for the first grade middle school students in higher group, to examine validity and reliability of performance task and to investigate the effects on the students' achievement and attitude. It first defines performance assessment and exanmines its main features and scoring methods. Based on these, nine performance assessment tasks and scoring criteria were designed for the first grade middle school students in higher group. The validity of performance tasks were examined by experts. The loaming achievement and mathematical attitude test between two groups were performed as pre and post test. The thinking of students about performance assessment was investigated by attitude survey. The results of this study are as follows: First, the validity of the performance tasks is very high. Second, The control group. Forth, there is a difference in student's attitude about mathematics between scorer reliability was high due to the scorer training. Third, there is little difference in teaming achievement between experimental and experimental and control group in 5% meaningful levels. That is, student's of both groups attitude about mathematics comes negatives, but the width of change of negative attitude in experimental group is less than control group. In the trend of negative attitude of mathematics as grade comes higher, this results showed that performance assessment of mathematics had positive influence on attitude of mathematics. The result of survey about mathematical performance assessment experience showed that students have positive attitude to performance assessment and recognized effectiveness of the performance assessment of mathematics.

• Child Health Nursing Research
• /
• v.21 no.2
• /
• pp.131-140
• /
• 2015

Purpose: The purpose of this study was to develop an instrument that evaluated QUality Of care Through patients' Eyes for hospitalized child (QUOTE-Child), and examine the validity and reliability. Methods: Preliminary items were reviewed through expert content validity and face validity. To test the validity and reliability of the instrument, the data were collected from 221 care givers of hospitalized children. Data were analyzed using exploratory factor analysis, Pearson correlation coefficient, Cronbach's alpha and Spearman-Brown coefficient. Results: Factor analysis yielded 19 items in four factors including 1) respect, 2) explanation, 3) kindness, and 4) skillfulness, with a cumulative explanatory variance of 70.68%. For criterion-related validity, a significant positive relationship was found between quality of care and pediatric family satisfaction. For internal consistency reliability, the Cronbach's ${\alpha}$ was .93 (importance) and .95 (performance) for the overall instrument. The half split reliabilities were .86, .95 (importance) and .92, .97 (performance). The Cronbach's ${\alpha}$ of 110 data was .92 (importance) and .94 (performance). Conclusion: Researchers and practitioners can use this instrument to systematically assess quality of care for hospitalized children and identify areas of support for hospitalized children and their family.

• Journal of Korean Society for Quality Management
• /
• v.30 no.3
• /
• pp.79-93
• /
• 2002

Many companies are struggling with the issue of performance measurement because a generally accepted framework does not exist. The Balanced Scorecard is designed to help firms that have historically overemphasized short-term financial performance. In this article, we discuss the interrelation between supply relationship and BSC. The Balanced Scorecard to measure quality performance with respect to supply relationship is suggested. Based on the survey of 84 venture firms, the validity of the measurement tool is tested statistically. Consequently, it was found that the suggested items have validity to measure supply relationship quality performance

• Journal of the Korean Operations Research and Management Science Society
• /
• v.41 no.2
• /
• pp.17-33
• /
• 2016

Clustering is one of the leading methods to analyze big data and is used in many different fields. This study deals with Clustering Validity Index (CVI) to verify the effectiveness of clustering results. We compare the performance of CVIs with business applications of various field. In this study, the used CVIs for comparing performance are DU, CH, DB, SVDU, SVCH, and SVDB. The first three CVIs are well-known ones in the existing research and the last three CVIs are based on support vector data description. It has been verified with outstanding performance and qualified as the application ability of CVIs based on support vector data description.

• Journal of Korean Academy of Nursing
• /
• v.35 no.1
• /
• pp.95-103
• /
• 2005

Purpose: The purpose of this study was to develop an instrument of task performance evaluation for clinical nurses, thus testing the validity and the reliability of the scale. Method: Data was collected from 84 Head Nurses and 255 General Nurses. A conceptual framework, composed of 4 factors of meaning in task performance evaluation, was identified through review of the relevant literature. A total of 78 items were developed and were used on a five-point likert scale. Through factor analysis, items whose factor loading was below 0.50 were deleted, thus 35 items remained. To test the validity and reliability of the instrument, the SPSS 11.0 windows program was used. Result: The results of the factor analysis indicated that 4 factors were classified and the cumulative percent of variance was 67.54%. The results of the reliability test indicated that Cronbach's coefficient of the total 35 items was over 0.9176. The results of the factor analysis indicated that factor loadings of all items was over 0.50. Conclusively, the validity and the reliability of the scale were proven. Conclusion: This study was identified as a tool with a high degree of reliability and validity.

• Korean Medical Education Review
• /
• v.23 no.3
• /
• pp.185-193
• /
• 2021

Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.