• Journal of Elementary Mathematics Education in Korea
• /
• v.18 no.2
• /
• pp.297-318
• /
• 2014

This study is designed for helping elementary school teachers have an insight into making or choosing questions of descriptive assessment in mathematics. For this, it is analyzed 30 descriptive mathematical questions produced by Gyeonggi Provincial Office of Education in 2011 and 2012 and 3rd to 6th grade students' papers marked by their teachers in charge from 2 elementary schools located in Gyeonggi Province. The main focus of analysis is the errors of students' answers and teachers' marking not from their own mistakes but from the defects of questions themselves. As a result of analysis, 7 cases of problematic situations are induced and they are reorganized into 3 categories as follow: i) case of not performing unique purpose of descriptive assessment, ii) case of inducing the problem of fairness of grading, iii) case of leading students erroneous direction.

• School Mathematics
• /
• v.10 no.3
• /
• pp.401-422
• /
• 2008

In the current school curriculum, an alternative assessment method which focuses more on the problem solving process rather than the final solution is being investigated. The goal is to evaluate students' understanding of the subject. A descriptive evaluation is being suggested as a way of examining the thought process of the students by a structured analysis of the problem solving process. But currently, there are not enough descriptive problems available for teachers to effectively carry out the alternative assessment method in the elementary school mathematics curriculum. In this research, we surveyed 197 elementary school teachers in Seoul to determine the status of descriptive evaluation in elementary school mathematics and to understand the teachers perception about the new assessment method. The goal of the survey was to find an effective implication of the new assessment method in elementary mathematics classes. The research showed that the elementary teachers use this assessment method about 4 to 7 times per month in their classes. They give descriptive problem test anytime they think it is appropriate during the Instruction of the topic. More than 90% of the teachers were using this assessment method to improve students' creativity and mathematical thinking. The teachers in the survey also commented that the teachers' administrative responsibility should be reduced and that the school environment in general should be improved for the new assessment method to be successful. Finally the study also showed that development of more descriptive problems in each grade level is needed to progress the new assessment method.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.3
• /
• pp.377-397
• /
• 2008

In today's secondary school mathematics curriculum, assessment is to be focused on evaluating the student's mathematical thinking rather than finding the correct solution to the problem. A descriptive evaluation method is therefore introduced to the school districts and suggested as an alternative assessment method in K-12 school mathematics. Descriptive evaluation method is widely available for use in schools, but there are barriers to using it since the teachers are forced to use the method by the school districts. In this research, we surveyed 120 secondary school mathematics teachers in Seoul and the surrounding metropolitan area to understand the status and the perception about using descriptive evaluation. The goal of the study was to find and understand the direct implications of using the new assessment method in secondary mathematics classes. The study showed that most of the mathematics teachers used the descriptive assessment method during their regular exam periods which is given twice per semester. Most of the open-ended problems used for descriptive evaluation were medium or high level math questions which were graded by the teachers at least 3 times to ensure objective evaluation. The teachers stated that objectivity in grading, administrative situation, and development of descriptive problems were the difficult barriers in descriptive evaluation. The teachers in the survey also commented that teachers' administrative responsibility should be reduced and that school environment in general should be improved for the new assessment method to become successful. Finally, the study showed that development of more descriptive problems with specific grading guidelines need to be developed for each grade level.

• The Mathematical Education
• /
• v.53 no.4
• /
• pp.509-524
• /
• 2014

This study was to investigate the types of errors and the frequency of errors to understand students' solving process on the descriptive items with the students of an excellent high school which located in a non-leveling local school district of Gyunggi Province. All 11 items were developed in the equation of a circle and 120 students who attended this high school participated in solving them. The result showed a tendency as follows: Logically invalid inference(Type A, 38.83%) of errors, Omission error of the problem solving process(Type B, 25%), Technical error(Type C, 15.67%), Wrong conclusion(Type D, 11.94%), Use of wrong theorem(Type E, 5.97%), and Use of wrong picture(Type F, 2.61%). The logically invalid inference the students showed with a largest tendency was made because of the lack of reflection. This meant that this error could be corrected in a little treatment of carefulness.

• Journal of Educational Research in Mathematics
• /
• v.18 no.3
• /
• pp.335-352
• /
• 2008

The purpose of this research was to investigate the descriptive evaluation method that focuses on the problem solving process of the student. The goal was to evaluate the students' understanding of the subject rather than the students' ability to find the final answer. The descriptive evaluation is being suggested as a way of examining the thought process of the student by performing a structured analysis of the problem solving process. Today, there are not enough descriptive evaluation resources available for teachers to effectively carry out this alternative assessment method in the elementary school mathematics curriculum. This research is a case study on the development of resources for descriptive evaluation in grade 4 mathematics. We designed the development process for descriptive evaluation and its rubric for all 8 units of the 4-Na level of mathematics in the elementary school curriculum. Three descriptive problems were developed for each of the 8 units for a total of 24 problems. The rubric consisted of three areas of assessment, 1) understanding of the problem, 2) problem solving, and 3) mathematical communication. The problems were first pilot tested in two 4th grade classes. Modified problems were then tested in a different 4th grade classroom. The study showed that the three defined areas of evaluation framework (problem understanding, problem solving and mathematical communication) were measurable and analyzable using the developed grading rubric. We then conclude that he descriptive evaluation could be used as an effective tool for improving teacher performance in elementary school mathematics.

• The Mathematical Education
• /
• v.55 no.2
• /
• pp.171-192
• /
• 2016

As teachers' competency is evaluated based on their teaching performance. pre-service teachers need to have an opportunity to reflect on themselves by systematically analyzing and evaluating their own lesson planning and teaching performance through self-assessment. In this study, we aimed to examine what evaluation criteria for lesson planning and teaching performance pre-service mathematics teachers consider in the process of self-assessment. This study used a mixed-methods research design. To draw the self-evaluation criteria for lesson planning and teaching performance, pre-service self-reported assessments were analyzed using qualitative analyses. In addition, descriptive statistics were used to investigate the pre-service teachers' distribution across the criteria and check the ratio of pre-service mathematics teachers for each element. As a result, it was disclosed that pre-service mathematics teachers considered eight elements in self evaluating their own lesson planning and teaching performance. In addition, we found that pre-service mathematics teachers tended to consider Pedagogical Content Knowledge (PCK) more than Subject-Matter Knowledge (SMK). Moreover, the results of this study provide educational implications for the curriculum in the pre-service teacher's education program.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.187-207
• /
• 2024

In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.165-186
• /
• 2024

Despite the growing attention on artificial intelligence-based automated scoring technology as a support method for the introduction of descriptive items in school environments and large-scale assessments, there is a noticeable lack of foundational research in mathematics compared to other subjects. This study developed an automated scoring model for two descriptive items in first-year middle school mathematics using the Random Forest algorithm, evaluated its performance, and explored ways to enhance this performance. The accuracy of the final models for the two items was found to be between 0.95 to 1.00 and 0.73 to 0.89, respectively, which is relatively high compared to automated scoring models in other subjects. We discovered that the strategic selection of the number of evaluation categories, taking into account the amount of data, is crucial for the effective development and performance of automated scoring models. Additionally, text preprocessing by mathematics education experts proved effective in improving both the performance and interpretability of the automated scoring model. Selecting a vectorization method that matches the characteristics of the items and data was identified as one way to enhance model performance. Furthermore, we confirmed that oversampling is a useful method to supplement performance in situations where practical limitations hinder balanced data collection. To enhance educational utility, further research is needed on how to utilize feature importance derived from the Random Forest-based automated scoring model to generate useful information for teaching and learning, such as feedback. This study is significant as foundational research in the field of mathematics descriptive automatic scoring, and there is a need for various subsequent studies through close collaboration between AI experts and math education experts.

• East Asian mathematical journal
• /
• v.32 no.4
• /
• pp.501-518
• /
• 2016

In this paper, we analyzed the correlation among scores of the mathematics B-type grade of College Scholastic Ability Test(CSAT), scores of Mathematics Level Assessment(MLA) and written test scores of Basic Mathematics Subject(BMS) made by students. Especially, we examined the relationship between CSAT grade with results of MLA and results of BMS through survey of students who changed their grades and learned about reasons. In addition, we analyzed error types for the descriptive problem solving in BMS written tests..

• Research in Mathematical Education
• /
• v.13 no.2
• /
• pp.141-150
• /
• 2009

This study gives opportunity for investigating how student teachers view the teaching profession and how they transfer their pedagogical knowledge into practice. The aim of the study is to investigate the teaching skills student teachers gained in the assessment of micro teaching of their peers. The participants are 30 mathematics student teachers enrolled in the teacher training program in a state university. Document analysis and semi-structured interviews are the research instruments and inferential & descriptive statistics are used for the data analysis. The findings suggest that the qualitative and quantitative peer assessments of student teachers were graded differently which results from the difference of perceptions about teaching and different conceptualizations of the teaching qualifications.