• Journal of the Korean School Mathematics Society
• /
• v.16 no.1
• /
• pp.63-86
• /
• 2013

This study aimed to explore how middle school students perceive constructed-response items and how they solve those items and the patterns of the processes. For this purpose, data were collected from middle school students through survey, written responses on those items that were developed for this particular purpose, and interviews. The survey data were analyzed by using Excel and the written responses and interview data qualitatively. The findings about the students' perceptions about the constructed-response items suggested that the middle school students perceive the items primarily as involving writing solutions logically(17%) and being capable of explaining while solving them(7%). The most difficulties they encounter when solving the items were understanding(26%), applying(12%), mathematical writing(25%), computing(23%), and reasoning(14%). The findings about the students' mathematical proficiencies showed that they made an error most in reasoning (35%), then in understanding(31%), in applying(9%), and least in computing(3%).

• Annual Conference on Human and Language Technology
• /
• 2023.10a
• /
• pp.95-100
• /
• 2023

끊임없이 재생산되는 혐오 표현의 정확한 탐지를 위해서는 혐오란 무엇인가에 대한 본질적인 이해가 필요하다. 본 연구에서는 화용론에서 사용되는 적정성 조건이라는 분석 틀을 활용하여 모델이 '혐오하기' 화행을 어떻게 인식하고 있는지 평가하고자 했다. 혐오 화행의 적정성 조건을 명제 내용 조건, 예비 조건, 성실성 조건, 본질 조건으로 나누어 분석하였으며, 이를 진위형, 연결형, 단답형, 논술형 문항으로 구성했다. 그 결과 모든 문항 유형에서 50점이 넘는 점수를 받았으나 비교적 고차원인 사고 능력을 측정하는 단답형과 논술형 문항 유형의 점수가 가장 낮게 나타났다.

• Journal of the Korean School Mathematics Society
• /
• v.17 no.2
• /
• pp.275-290
• /
• 2014

This study aims to examine how secondary mathematics teachers perceive and how they use constructed-response assessment in their mathematics classrooms. For this purpose, we conducted a survey in Seoul, Inchun, and Gyeonggi-do; 189 teachers participated in the survey. Results from the data analysis suggest as follows: a) the secondary mathematics teachers participated in the survey seem to consider the primary goals of assessment through constructed-response items as evaluating student achievement and the development of students' thinking and creativity; b) the teachers perceive that constructed-response assessment would promote students' mathematical thinking and problem solving skills; c) in general, constructed-response items were included in both performance assessment(less than 20 percent) and paper-and-pencil test(20 to 40 percent); and d) constructed-response items were primarily used as a part of regular examination, rather than as an independent assessment.

• Communications for Statistical Applications and Methods
• /
• v.1 no.1
• /
• pp.206-214
• /
• 1994

본 논문은 1994학년도 부터 부활된 대학별고사 실시에 따른 문항분석, 표준 점수제 그리고 검사동등화의 문제점을 지적하기 위하여 교육측정이론의 기본 개념을 소개하는데 있다. 대학별고사의 타당성과 신뢰성을 보장받기 위하여는 양질의 문항제작이 우선하여야하며, 이를 위하여 문항분석은 종전에 사용하던 고전검사이론 보다는 문항반응이론을 이용하는 것이 바람직하다. 문항반응이론에 의한 문항분석은 피험자 집단의 특성에 의하여 문항특성이 달리 분석되지 않는 특징을 지니고 있기 때문이다. 문항이 논술형일 경우 채점자간 신뢰도와 채점자 내 신뢰도를 간과하여서는 안될 것이다. 다양한 선택과목을 채택하는 대학별 고사에서 입학 사정을 위하여 원점수를 사용하거나, 표준점수 혹은 검사동등화 방법을 이용하고 있으나 이는 교육측정이론에 위배된다. 다른 과목에 대한 인가의 능력을 상대비교 할 수 없으며, 표준점수와 검사동등화는 동일 능력에 대한 상대비교를 위한 방법이다. 특히 검사동등화는 동일 특성, 공정성, 모교집단 불변성, 대칭성을 전제한다. 표준점수제에 의하여 수험생들의 다른 능력을 상대 비교하는 방법은 다른 능력이 점수로 표현되기 때문에 가능하나 그 점수가 무엇을 의미하는 가를 분석할 때는 교육평가의 기본 철학에도 위배된다.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.4
• /
• pp.543-567
• /
• 2008

The current 2007 Mathematics Curriculum in Korea emphasizes mathematical problem solving, advanced mathematical thinking and effective mathematical communicating. Therefore, in order to assess and evaluate these important thinking attributes, performance evaluation using descriptive and essay type of assessments are emphasized. In this paper, analysis of the elementary mathematics curriculum is used to develop descriptive assessment problems and grading rubrics that could be used objectively and consistently by teachers of the grade 6 school mathematics. The assessment problems were developed, pilot tested, revised, implemented and analyzed in detail to understand the overall effectiveness of the descriptive evaluation method in school mathematics.

• Journal of Korean Elementary Science Education
• /
• v.40 no.2
• /
• pp.191-209
• /
• 2021

This study analyzed how characteristics of process-focused assessment are implemented in the distributed process-focused assessment examples in elementary school science education. To this end, through a review of previous studies, the analysis perspectives on the characteristics of the process-focused assessment were extracted into six categories. Using the analysis framework, it was described how process-focused assessment examples in elementary school science education developed by metropolitan office of education reflected the characteristics of process-focused assessment. As a result of the study, the characteristics of process-focused assessment were often formally reflected in sample materials. For example, there was a lack of skills on how to effectively integrate instruction and evaluation in practical terms. In many cases, feedback simply induced a recall of a learned concept or simply guides a related scientific concept. In some cases, the characteristics of process-focused assessment did not appear prominently in the sample materials. Also the developed sample materials were divided into the same type as the existing science and performance assessment questionnaire, a narrative·essay type, and a type similar to experimental workbook.

• Journal of The Korean Association For Science Education
• /
• v.24 no.3
• /
• pp.519-531
• /
• 2004

In recent years, there has been an increased emphasis on performance assessment to evaluate students' abilities. Our nation has introduced a change in testing and assessment. Additional work on the efficacy, reliability, and comparability in order to develop the performance assessment item has been needed in the enforcement of the 7th National Science Curriculum. Also, criteria for professional and technical standards has been needed to be developed. The purpose of this study was to draw out various key concepts and to develop achievement standards, assessment standards and performance assessment items based on the 7th National Science Curriculum on the subject matter of reproduction(chapter 13) and biological accumulation(chapter 17). And also, this study examined the validity of completed performance assessment items based on classical test theory and polytomous item response theory. Twelve key concepts in chapter 13(reproduction) and four from chapter 17(biological accumulation) were abstracted. Twenty-six achievement standards in chapter 13(reproduction), and nine in chapter 17(biological accumulation) were developed. The achievement standards were determined in terms of knowledge(K), process skill(P) and attitude(A). Twenty-five assessment standards in chapter 13(reproduction) and nine in chapter 17(biological accumulation) were developed. Based on the developed achievement standards and assessment standards, twenty-two performance assessment items(seventeen open-ended questions, three essays, and two portfolios) with concrete grading criteria were developed. Eight open-ended items were applied to 240 10th graders to evaluate reliabilities of the test which consisted of four items per each chapter. The results would be suggested that the applied items were valid for performance assessment because item difficulties and item discriminations were proper. There was not much differences in item discrimination between interpretation from classical test theory and that from polytomous item response theory. However, there were some differences in item difficulties between the interpretations of two theories because the characteristics of examinees were reflected in classical test theory.

• The Journal of Korean Association of Computer Education
• /
• v.21 no.1
• /
• pp.31-42
• /
• 2018

Countries around the world are strengthening informatics education to cope with the development of technology that leads to rapid social change. The last step in the capacity to foster through formal education is high school education. The purpose of this study is to examine the competence and level of informatics curriculum for high school students who aim to enter university in terms of testing tools. In order to carry out the research, we analyzed informatics education related test tools for high school students such as Japan, Germany, and USA. The results of the analysis are as follows: First, both the essay type and the short answer type question are included in the test tool as well as the multiple choice question type. Second, we use the real world model as an item and ask whether we can use computing power for practical problem solving ability. Third, the items directly related to the university education are reflected in the items. This study suggests that it has helped to elucidate the features and discussions of the test tool and establish the development direction of the test tool for informatics education.

• The Mathematical Education
• /
• v.61 no.2
• /
• pp.287-303
• /
• 2022

The purpose of this study is to draw implications for the improvement in the CSAT by analyzing structures and tasks in the Abitur. To this end, it analyzes the mathematics test system with a focus on the basic and advanced level examination systems, the operator, the using technology, and mathematical formulas. And the characteristics of tasks in the 2021 Abitur were analyzed. As a result of the analysis, first, Germany evaluates whether students have the competency emphasized in the curriculum at Abitur. Second, Germany, which emphasizes the proper use of technology, utilizes both tasks that use technology and those that do not in the Abitur. Third, the Abitur consists of most of the tasks using promised operators and uses various types of operators to present various types of questions to evaluate competence. Fourth, the Abitur includes not only simple structured items consisting of 2-3 subtasks but also tasks dealing in depth with a single situation centered on a big idea. Finally, mathematical justification and proof play an important role in the Abitur. Based on this, some specific measures for improving the CSAT were suggested.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.159-181
• /
• 2023

The purpose of this study is to explore secondary mathematics teachers' perceptions on Artificial Intelligence (AI). For this purpose, we conducted three focus group interviews with 18 secondary in-service mathematics teachers and analyzed their perceptions on AI for math and math for AI. The secondary in-service mathematics teachers perceive that AI allows to implement different types of mathematics instruction but has limitations in exploring students' mathematical thinking and having emotional interactions with students. They also perceive that AI makes it easy to develop assessment items for teachers but teachers' interventions are needed for grading essay-type assessment items. Lastly, the secondary in-service mathematics teachers agree the rationale of adopting the subject ＜Artificial Intelligence Mathematics＞ and its needs for students, but they perceive that they are not well prepared yet to teach the subject and do not have sufficient resources for teaching the subject and assessing students' understanding about the subject. The findings provide implications and insights for developing individualized AI learning tools for students in the secondary level, providing AI assessment tools for teachers, and offering professional development programs for teachers to increase their understanding about the subject.