• Journal of the Korean Society of Earth Science Education
• /
• v.17 no.2
• /
• pp.181-193
• /
• 2024

Summative assessment provides information on how well students have achieved learning objectives, making the development of high-quality assessment items essential for accurate evaluation. This is one of the competencies that teachers must possess. This study aims to analyze summative assessment items created by pre-service elementary teachers, examining their intentions and the difficulties encountered in the item development process. The study involved 45 second-year students enrolled in an elementary teacher training university. They were grouped into teams of three and tasked with developing ten items, documenting the purpose of each item, the answer key, and the challenges faced during item creation. The collected summative assessment items were analyzed using a two-dimensional purpose classification table that includes Klopfer's taxonomy of educational objectives. The intentions behind the summative assessments and the difficulties faced during item development were inductively organized and analyzed through qualitative data analysis. The results revealed that pre-service elementary teachers adequately reflected scientific content elements but did not evenly cover assessment domains. The most challenging aspect for them was adjusting the difficulty level. Although they considered most factors that should be taken into account during item development, these considerations were not reflected in the actual items. These findings suggest that knowledge and experience are crucial in developing summative assessment items, and systematic lectures are necessary for pre-service elementary teachers.

• Journal of the Korean School Mathematics Society
• /
• v.16 no.4
• /
• pp.899-925
• /
• 2013

The purpose of this study was to examine how constructive-response questions in regular test was in aligned with the nature and goals of 2007 Curriculum Amendment. For this purpose, data were collected and analysed by using the framework for mathematical task and the cognitive demand of tasks suggested by Smith & Stein(1998) and mathematical proficiency suggested by National Research Council(2001). In particular, it aimed to reveal the overall picture of the level of cognitive demand and the proportion of mathematical proficiency of constructed-response items created by secondary mathematics teachers. The findings from the analysis showed that 70 percent of the constructed-response items were at low-level and the rest at high-level in terms of cognitive demand. Also, the constructed-response assessment focused on conputing (89%), understanding(45%), applying(30%) and least reasoning(17%). Most of the constructed-response items included computing and were algorithmic.

• Communications of Mathematical Education
• /
• v.14
• /
• pp.151-162
• /
• 2001

교육평가는 선발의 기능을 할 뿐 아니라 학습자의 학습상태나 오류경향에 대한 진단을 통해 학습자의 학습에 도움을 주어야 한다. 이르한 측면에서 오류분석은 평가가 지녀야 하는 가장 중요한 기능 중 하나라고 할 수 있다. 인터넷의 대중적 보급과 시간적, 공간적, 기술적 효율성은 평가환경에 대한 새로운 가능성을 제시하고 있다. 인터넷 환경에서의 평가문항은 선다형을 기본으로 하게 되는데, 선다형 평가문항을 통해서는 학습자들의 오류를 직접적으로 관출할 수 없다는 한계가 있다. 그러나 선다형 평가문항을 통한 오류분석이 불가능한 것은 아니다. 본 연구의 목적은 선다형 평가문항에서의 오류분석을 위한 구체적인 방법과 절차를 모색하는 것이다.

• Journal of Science Education
• /
• v.37 no.2
• /
• pp.278-293
• /
• 2013

The purpose of this study was to analyze the characteristics of multiple-choice test items used in assessment of high school integrated science according to 2009 revised curriculum. For the analysis of the tendency of item setting, we devised an analytic framework specific to integrated science, and analyzed the characteristics of items by applying the devised framework and item response theory. The results of the tendency of item setting revealed that most of items run counter to the intent of integrated science in terms of item resource, integration extent, and cognitive level, which means teachers are stick to separative method in teaching-learning and assessment of integrated science. The results of the analysis applying item response theory showed that item difficulty was appropriate and item discrimination was considerably high. However, there was no relevance between the tendency of item setting and qualitative characteristics of the items. We also discussed some agendas to improve the teaching-learning and assessment of integrated science based on the results of this study.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.122-131
• /
• 2002

Recently, performance assessment that makes growing use of free response items in a large scale assessment has been emphasized. This study is an empirical examination of the effectiveness of free response items in comparison with multiple choice items. Using the information function in Item Response Theory (IRT) framework, item information of free response items and multiple-choice items from the Third International Mathematics and Science Study-Repeat (TlMSS-R) were obtained. Test information of the whole science area as well as each area of science contents was computed. On average, free response items yielded more information than multiple choice items, especially in earth science, physics, chemistry, and life science. This study also showed that free response items were appropriate for students in high science ability. Also, free response items estimated students' science ability more accurately than multiple choice items with smaller number of free response items.

• School Mathematics
• /
• v.12 no.2
• /
• pp.113-136
• /
• 2010

According to the self-assessment tool identifying teacher's competence in assessment, many teachers have difficulty in making assessment tools. This study analyzes the types of modification with data of NAEA(National Assessment of Educational Achievement) items from 2006 to 2008. NAEA goes through complicated formalities from begin to make draft items to completing them. This study shows the types of item modification and its specific examples. NAEA analyzes the degrees of studuents' achievement according to the educational objectives of the National Curriculum. This study provides specific comments on making mathematics assessment items to the teachers who embody national curriculem. Therefore this study will contribute to improve mathematics teacher's professional competence in the area of assessment tool development.

• Journal of the Korean Geographical Society
• /
• v.49 no.3
• /
• pp.472-487
• /
• 2014

This study aims to analyze the characteristics of GIS-related test items of high school Korean Geography in the 7th National Education Curriculum, and to discuss some issues and challenges. First, we developed a framework for analyzing test items based on the literature review and the content analysis on the textbooks, which categorizes test items in terms of content elements and activity elements. Then, we examined test items of nation-wide tests including CSAT(College Scholastic Ability Test) carried out 2004-2012 and analyzed the percentage of correct answers as well. According to the results, there was a significant predominance of particular test item categories, and the percentage of correct answers of GIS-related items was slightly higher than whole average but it depended on the test item categories. Finally, we discussed the implications of this analysis to the tests as well as the teaching-learning process in the classroom, and suggested improvement directions such as integration of GIS with other contents, reinforcement of the inquiry-based test items, maintaining moderate difficulty.

• Education of Primary School Mathematics
• /
• v.15 no.1
• /
• pp.13-29
• /
• 2012

This study is the analytic research of items having gender gap in 6th grade students in 'National Assessment of Educational Achievement(NAEA)'. For this problem solving, the following was investigated. First, items having gender gap were selected in NAEA for the past eight years. Then, the mathematical factors that cause gender gap were analyzed. Second, to do this the field test was developed using item concept map. Finally, after the analysis of field test result the reason of gender gap was deduced. Through this study the improvement of mathematics teaching and learning method in elementary school is expected.

• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• Journal of Korean Elementary Science Education
• /
• v.40 no.2
• /
• pp.191-209
• /
• 2021

This study analyzed how characteristics of process-focused assessment are implemented in the distributed process-focused assessment examples in elementary school science education. To this end, through a review of previous studies, the analysis perspectives on the characteristics of the process-focused assessment were extracted into six categories. Using the analysis framework, it was described how process-focused assessment examples in elementary school science education developed by metropolitan office of education reflected the characteristics of process-focused assessment. As a result of the study, the characteristics of process-focused assessment were often formally reflected in sample materials. For example, there was a lack of skills on how to effectively integrate instruction and evaluation in practical terms. In many cases, feedback simply induced a recall of a learned concept or simply guides a related scientific concept. In some cases, the characteristics of process-focused assessment did not appear prominently in the sample materials. Also the developed sample materials were divided into the same type as the existing science and performance assessment questionnaire, a narrative·essay type, and a type similar to experimental workbook.