• Journal of the Korean Society of Earth Science Education
• /
• v.17 no.2
• /
• pp.181-193
• /
• 2024

Summative assessment provides information on how well students have achieved learning objectives, making the development of high-quality assessment items essential for accurate evaluation. This is one of the competencies that teachers must possess. This study aims to analyze summative assessment items created by pre-service elementary teachers, examining their intentions and the difficulties encountered in the item development process. The study involved 45 second-year students enrolled in an elementary teacher training university. They were grouped into teams of three and tasked with developing ten items, documenting the purpose of each item, the answer key, and the challenges faced during item creation. The collected summative assessment items were analyzed using a two-dimensional purpose classification table that includes Klopfer's taxonomy of educational objectives. The intentions behind the summative assessments and the difficulties faced during item development were inductively organized and analyzed through qualitative data analysis. The results revealed that pre-service elementary teachers adequately reflected scientific content elements but did not evenly cover assessment domains. The most challenging aspect for them was adjusting the difficulty level. Although they considered most factors that should be taken into account during item development, these considerations were not reflected in the actual items. These findings suggest that knowledge and experience are crucial in developing summative assessment items, and systematic lectures are necessary for pre-service elementary teachers.

• Journal of Korean Elementary Science Education
• /
• v.39 no.1
• /
• pp.15-25
• /
• 2020

In this study, we investigated elementary and preservice elementary school teachers' actual and preferred types of science assessment focusing on the purpose and the method of assessment. Participants were 75 elementary school teachers and 93 preservice elementary school teachers. The questionnaire adopted from previous relevant studies was administerd in order to examine the types of assessment which the teachers have actually implemented and the preferred types of assessment for hypothetical situations known as the prototypical examples of constructivist assessment. The results revealed that most teachers and preservice teachers tend to possess the summative-oriented purpose of assessment. An affective assessment purpose focused on evaluating students' interest, attitude, and curiosity toward science was newly identified in this study. In analyzing teachers' responses from the viewpoint of the method of science assessment, responses of an informal mode such as observation and portfolio were noticeable. However, most of them were found to correspond to the traditional summative-oriented purpose of assessment. For prototypical constuctivist assessment situations, teachers and preservice teachers were found to prefer the performance and the informal modes than the measurement mode of the assessment methods, whereas their purposes of the assessment were not found to be constructivist.

• Journal of Science Education
• /
• v.34 no.1
• /
• pp.164-174
• /
• 2010

The purpose of this study was to find out taxonomic characteristics of objectives infered from questions of summative evaluation by analyzing those objectives with Bloom's revised taxonomy of educational objectives. 1,711 questions of midterm and final examinations collected from 25 middle schools were analyzed to classify objective of each question. The major findings of the study were as follows: first, from the analysis of objectives in the knowledge dimension, the assessment of factual knowledge was most prevailing(67.6%) in the biology summative evaluation. In the cognitive process dimension, memory assessment was most dominant(76.1%). Thus, the main objectives of evaluation leaned toward particular classes in the Bloom's revised taxonomy, which was different from the findings of earlier studies on the weights of evaluation areas. Second, the level of the objectives should be determined in consideration of the grade of middle schoolers, as their cognitive level improves with grade. In fact, however, there was no difference among three grades in characteristics of objective taxonomy.

• Korean Medical Education Review
• /
• v.15 no.2
• /
• pp.87-92
• /
• 2013

The purpose of this study was to assess third-year medical students' competency for development or revision of the undergraduate curriculum and assessments. One hundred and twenty-seven third-year medical students at the Pusan National University were included in the study. After third- and fourth-year students took a common written examination, clinical performance examination (CPX), and objective structured clinical examination (OSCE) with common items as a summative assessment, the third-year students' competency was compared with 132 forth-year students' results. The correlation of the written examination and CPX/OSCE was analysed, and the summative results were compared with the grade point average (GPA) through the second year, CPX/ OSCE in the second year, and GPA in the clerkship. On the written examination, the third-year students' mean score was lower than the fourth-year students' by over 11 points, whereas the gap in the CPX/OSCE was 4 points and there was no difference in the OSCE. There was a moderate correlation between the written examination and the CPX/OSCE scores (R=0.371, p<0.01). The written examination was highly correlated with GPA through the second year, which mainly evaluated medical knowledge (R=0.771, p<0.01). A relatively high correlation was observed between CPX/OSCE scores and GPA in the clerkship (R=0.641, p<0.01). The summative CPX/ OSCE scores showed a moderate correlation with formative CPX/OSCE scores in the second year (R=0.464, p< 0.01). The third-year students' score was quite low on the written examination and slightly low on the CPX/OSCE compared to that of the fourth-year students. The written examination and CPX/OSCE cannot replace each other and should be combined with other methods of evaluation to measure competency. Early OSCE and workplacebased assessment should be useful in the early assessment of clinical skills competency.

• Journal of Digital Convergence
• /
• v.19 no.8
• /
• pp.275-283
• /
• 2021

This study was intended to help improve assessment in college EFL classes by examining the relationship between formative assessment (FA) and summative assessment (SA). Participants for the study were 75 undergraduates, taking an eight-week optional college English course at a four-year college in China. FA data were collected in the final course of the course by a self-reporting survey using the online training platform Mosoteach. To achieve the finding, the relationship between FA scores and SA scores (final exam and performance scores) was analyzed in SPSS by means of Pearson correlation analyses. Significant positive correlations were found between FA and SA scores overall. In addition, students' performance on chapter tests, online discussions, brainstorming, quick-responses, assignments and the number of thumbs-up clicks by teachers were significantly correlated with SA scores. The results suggested that FA administered through the Mosoteach app could improve students' academic performance, thus providing an empirical basis for improving educational assessment. Based on these findings, implications for assessment in EFL classes were described.

• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.9 no.9
• /
• pp.1-16
• /
• 2019

This study was carried out to develop a physics education program for foreign students of university in Korea to improve their ability to major in the field and to prevent them from becoming dropout. The subjects of the study are five Chinese students attending a natural science and engineering college. Prior to the development of the physics education program, the researchers developed basic physics textbooks for the foreign students and questionaries for diagnosis and summative evaluation, and utilized them to apply a total of seven classes. After the application of the classes, the results of the student's diagnosis and summative evaluation, the teacher's diaries, the observer's diaries, and the transcripts were analyzed by triangulation method. In addition, Nvivo12 was used for the analysis of the teacher's and observer's diaries to help with qualitative analysis. The results of the study are as follows: First, the oder and contents of physics education program for students of the natural science and engineering college were presented in detail, and basic physics textbooks and tools for diagnosis and summative assessment were developed. Second, as a result of the analysis of the diagnosis and summative assessment results of the program, the students' basic physics achievement improved by an average of 40 points due to the application of the developed program. Third, as a result of the application of the program using Nvivo12, meaningful node and actual cases were extracted. There were 10 types of nodes created such as understanding of the students, teaching method, rate of the participation, level differences, language problems, relevance to majors, curriculum and methods of education in the country of origin, cooperative learning, and interest inducement. The researcher provided suggestions on physics education methods for students of science and engineering colleges in Korea based on the related cases.

• Korean Medical Education Review
• /
• v.15 no.3
• /
• pp.112-119
• /
• 2013

Most medical colleges in Korea have been shifting from traditional education to outcome-based education, which is the general trend in medical education. The purpose of this study was to make some suggestions in light of the reality and challenges of student assessment in medical education from the perspective of outcome- based education. First, those who are responsible for student assessment should be diversified to include faculty, residents, students, and evaluation committee members. They need separate roles in educational evaluation, so evaluation competencies are required for them. Second, various methods for evaluation and score interpretation can be used for effective evaluation. We can adopt diagnostic, formative, and summative evaluation functionally, and the norm-referenced, criterion-referenced, growth-referenced, and ability-referenced evaluation based on criteria for score interpretation. Finally, various evaluation domains and test forms can be administered together in the common lectures in the medical school. We can test not only knowledge but also skills and attitudes, with diverse test forms such as supply and performance types.

• Research in Community and Public Health Nursing
• /
• v.13 no.3
• /
• pp.433-443
• /
• 2002

Objectives; The purpose of this study was to develop a framework for home care and a Home Care Need Assessment Tool. Method 1. Identifying common domains in the provision of home care. 2. Charts of 253 home care clients were reviewed to obtain a classification of the nursing diagnoses. 3. A focus group methodology was used to develop the domains. 4. The tool was applied to 439 home care clients.(Kappa value=0.460-1.000, sensitivity, 0.444-1.000: specificity, 0.743-1.000). 5. Some refinements and extractions of the defining characteristics and related factors were made based on the results of the focus group. Results Home Care Need Assessment Tool consists of three parts; -Part I : factors related to basic conditions -Part II : a screening component that enables home care nurses to assess 30 multiple domains of 53 nursing diagnoses. -Part III : summative nursing diagnoses and nursing need intensity for the clients. Conclusion This tool provides a comprehensive assessment that helps the recognition of many strengths as well as problems of the clients. It will be usefully utilized in scheduling home care nursing plans and evaluating client outcomes.

• Research in Mathematical Education
• /
• v.18 no.3
• /
• pp.223-234
• /
• 2014

Research shows that formative assessment has a more powerful effect on student learning than summative assessment. This case study of an 8th grade algebra classroom focuses on how the implementation of Formative Assessment Lessons (FALs) and the participation in teacher learning communities related to FALs changed in the teacher's instructional practices, over the course of a year, to promote students' mathematical reasoning and justification. Two classroom observations are analyzed to identify how the teacher elicited and built on students' mathematical reasoning, and how the teacher prompted students to respond to and develop one another's mathematical ideas. Findings show that the teacher solicited students' reasoning more often as the academic year progressed, and students also began developing mathematical reasoning in meaningful ways, such as articulating their mathematical thinking, responding to other students' reasoning, and building on those ideas leading by the teacher. However, findings also show that teacher change in teaching practices is complicated and intertwined with various dimensions of teacher development. This study contributes to the understanding of changes in teaching practices, which has significant implications for teacher professional development and frameworks for investigating teacher learning.

• Korean Medical Education Review
• /
• v.18 no.1
• /
• pp.38-43
• /
• 2016

The authors investigated the effect of feedback and remediation after formative assessment (FRFA) by comparing the FRFA score and that of summative assessment (SA) in a course on clinical skills. In March 2015, 33 subjects underwent evaluation of their ability to perform a complex clinical skill using a real-time ready-made mobile assessment form tool, and through e-mail they were supplied with their feedback and final score (the pass group earned 2 points; the intermediate group earned 1 point; the nonpass group earned 0 points) followed by their self-reflection. The nonpass group underwent a re-test and e-mail feedback again until they passed the test, given the ease of performance. In December 2015, the 33 subjects took a 10-item SA, and one of the 10 items addressed a similar clinical skill. The difference between the first score on the FRFA and the score on the SA was evaluated statistically (p=0.05) through data analysis, variance distribution, correlation analysis, and linear regression analysis using SPSS software ver. 16. The increase from the score on the SA to that on the FRFA was statistically significant ($4.5{\pm}9.29$) in the pass group and the intermediate group, and was $29.7{\pm}11.49$ in the nonpass group of the formative evaluation (p<0.001). Using an FRFA could decrease the range in the standard deviation of the score and increase the minimum score among the subjects.