• Proceedings of the KSPS conference
• /
• 2003.10a
• /
• pp.83-88
• /
• 2003

This study carried out an experimental English pronunciation assessment to see the differences in the relationship between the different rater categories. The result shows that i) correlation between Korean and Native American raters is high(r=.98) enough to be considered reliable, ii) previous instructions about assessment rubric and the knowledge about English phonetics and phonology exert little influence on the rating scores, iii) correlation between the automatic ILT(Interactive Language Tutor) rating using speech recognition technology and Natives' rating is stronger than that between ILT and Koreans' rating.

• School Mathematics
• /
• v.4 no.1
• /
• pp.63-78
• /
• 2002

This research's purpose is to investigate follows. 1. How do middle school teachers recognize the mathematical communication globally? 2. If we classify the modes of mathematical communication as written, spoken, graphic and active ones, how much do teachers use them and how do the students' communication ability come as teachers judge? 3. What are teachers' thinking, the present condition and the future indication for the application of mathematical communication with computer? 4. Do teachers evaluate their students' communication ability? If then, what is the assessment rubric of student's communication ability? The results are analyzed by frequency analysis including percentile and free writings are arranged by similar responses. The result of this study is that global recognition for mathematical communication, current state for students' concrete performance of mathematical communication, and assessment of mathematical communication & proposals are very lacking.

• Journal of Science Education
• /
• v.45 no.3
• /
• pp.275-291
• /
• 2021

The purpose of this study is to analyze the level and characteristics of system thinking of middle and high school students on cycle of matter in the Earth system considering the impact of human activities on the cycle. For this purpose, we developed items for assessment and assessment rubric through the analysis of 2015 revised curriculum and applying systems thinking, respectively. Middle and high school students who participated in the Korea Earth Science Olympiad were the subjects of this study. The level of system thinking was determined using the assessment rubric for student responses collected using items for assessment. The characteristics of system thinking were identified using word analysis. Based on these, the improvement of the curriculum considering the impact of human activities was discussed. The results of the study are as follows: first, the system thinking level of most secondary school students was low in identifying or classifying system elements for matter cycle, and high levels, such as system relationship or generalization of patterns, were found to be relatively small. It was found that students had a higher level of system thinking in the carbon cycle than in the water cycle. Second, in terms of the characteristics of system thinking about water cycle, water was recognized as a major system element and mainly related with evaporation between atmosphere and other system elements. Whereas, in the carbon cycle, carbon dioxide was regarded as a major system element, and photosynthesis and respiration were represented in relation with the biosphere. Third, for education considering the impact of human activities on the matter cycle in the Earth system, it is proposed improving the curriculum considering the socio-ecological system by extending the existing earth system.

• Korean Journal of Child Studies
• /
• v.26 no.2
• /
• pp.27-41
• /
• 2005

The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

• Journal of the Health Care and Life Science
• /
• v.11 no.2
• /
• pp.289-302
• /
• 2023

This study is a methodological research aimed at developing a program outcome assessment system for 'Utilization of Information and Communication Technology and the Latest Healthcare Technology' as required for nursing education accreditation. To ensure the theoretical validity of the assessment system, Kim's evaluation model (2009) and Zimmaro's rubric development stages (2004) were applied. The program outcome assessment system for information and communication and healthcare technology was developed, encompassing performance criteria, performance level, achievement goals, curriculum, evaluation methods, criteria, and the Close-the-Loop. The resulting assessment system is anticipated to be effectively utilized in nursing education, demonstrating broad applicability. This study is significant in providing specific directions for the development of program outcome assessment systems in undergraduate nursing programs. Further research is expected to evaluate and analyze program outcomes based on the applied assessment system.

• Journal of Korean Elementary Science Education
• /
• v.29 no.4
• /
• pp.441-450
• /
• 2010

The purpose of this study was to evaluate the level of elementary gifted students' argumentation and examine the special features of argumentation founded in scientific inquiry. 28 students were selected in the special education center for the gifted in K National University. They were organized 8 groups of 3~4 students and engaged in scientific inquiry activity. The researcher wasn't involved in students' inquiry activity and argumentation except for the guiding and introducing their activity. In the first session, each group carried out the experiment 'Putting a heated can in the water' and then, the students discussed to probe their experimental results and build their explanation. In the second session, each group presented their experiment results and evidence from their experiment justifying their claims, and had questions from other groups. The protocol data during 8 groups' argumentations were analyzed using 'Rubric for Scientific Argumentation Assessment' (Yang et al., 2009) in three domains- the form, content and attitude. As a result, in form domain, almost groups were rated 2 points due to their argument without rebuttal on the subcategory of 'composition', but they got a good grade above 3 points in subcategory such as 'claim', 'ground', and 'conclusion'. In content domain, almost groups got points above 3 points. In attitude domain, there were some striking contrast between each groups. Six groups got good score more than 4 points on the subcategory of openness, but two groups, they alleged and got score below 3 point. While the 6 groups of all got 4 points in the aspect of participation, 3 groups got 3 points lower than because they only just asserted and not interact with other groups. Throughout the argumentation, two features were found that; as time goes by, arguments were refined; Students tended to use their prior to knowledge rather than evidence such as experimental data in making claims and conclusions.

• The Journal of Korean Medicine
• /
• v.45 no.1
• /
• pp.1-16
• /
• 2024

Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

• Journal of the Korean Geographical Society
• /
• v.36 no.2
• /
• pp.177-190
• /
• 2001

As standardized test and current perfomance assessment have some problems in the aspects of contextuality, authenticity and intelligence faimess, the aim of this study is to propose an 'intelligence-fair and authentic assessment(IFAA)as an appropriate altemative and to make sure of the probability of its application. In geographical education, an idealistic assessment can be realized when the tasks bear authenticity, multiple intelligence of students are accepted and the objective are confirming with general purpose. IFAA model consists of 5 elements. They are the selecting for strategic ideas, the developing a real-life task, the constructive instructing with teacher, the offering opportunity of multiple representation and the allotting of marks for each items, IFAA model proposed in this study is worth considering in educational validity and realistic adaptability.

• The Journal of Korean Association of Computer Education
• /
• v.9 no.4
• /
• pp.35-42
• /
• 2006

We have investigated the effect of student-generated rubrics on learning motivation and achievement in performance evaluation of computer class. We studied the related previous researches and developed the procedure for performance evaluation using student-generated rubrics. According to thc developed procedure, the performance evaluation has been carried. Students have more clear understanding of their assignments and rubrics during the negotiation process. Student generated rubric has a positive effect on learning motivation and achievement.

• School Mathematics
• /
• v.5 no.1
• /
• pp.1-25
• /
• 2003

This study develops a performance assessment system to improve grade 4-9 students' creativity. First, this study discusses its educational meaning, its task types, scoring methods and practical application methods. Then, this study provides the typical examples of performance assessment task classified by each of the types and its scoring rubrics. Finally, this study analyzes students' achievement levels for each task. Each task includes item informations such as content area, evaluation goal, evaluation procedure, preparatory material, characteristics, considering points, scoring rubric etc. for grade 4-9 teachers to use them in their evaluation processes directly without difficulties.