• Journal of the Korean School Mathematics Society
• /
• v.11 no.3
• /
• pp.377-397
• /
• 2008

In today's secondary school mathematics curriculum, assessment is to be focused on evaluating the student's mathematical thinking rather than finding the correct solution to the problem. A descriptive evaluation method is therefore introduced to the school districts and suggested as an alternative assessment method in K-12 school mathematics. Descriptive evaluation method is widely available for use in schools, but there are barriers to using it since the teachers are forced to use the method by the school districts. In this research, we surveyed 120 secondary school mathematics teachers in Seoul and the surrounding metropolitan area to understand the status and the perception about using descriptive evaluation. The goal of the study was to find and understand the direct implications of using the new assessment method in secondary mathematics classes. The study showed that most of the mathematics teachers used the descriptive assessment method during their regular exam periods which is given twice per semester. Most of the open-ended problems used for descriptive evaluation were medium or high level math questions which were graded by the teachers at least 3 times to ensure objective evaluation. The teachers stated that objectivity in grading, administrative situation, and development of descriptive problems were the difficult barriers in descriptive evaluation. The teachers in the survey also commented that teachers' administrative responsibility should be reduced and that school environment in general should be improved for the new assessment method to become successful. Finally, the study showed that development of more descriptive problems with specific grading guidelines need to be developed for each grade level.

• Journal of the Korean School Mathematics Society
• /
• v.15 no.2
• /
• pp.239-258
• /
• 2012

The present study examined the differences of system and problems of descriptive assessment at the national, district level, and school's levels between Korea and U.S.A. (focused on NCTM perspective). As results, both Korea and U.S.A. showed that their goals for descriptive assessment at the national level pointed out the importance of assessment of process rather than result. In addition, States of U.S.A. demonstrated concrete rubrics and examples to help many school teachers to use easily, while many Districts of Education in Korea presented implementation rate in school in order to give a official direction to teachers.

• Journal of the Korean School Mathematics Society
• /
• v.17 no.3
• /
• pp.409-435
• /
• 2014

This study examines relations between the 5th graders' fraction operation skills and error types on constructed-response items. As results, first, the participants have lower fraction operation skills on 'multiplication of fraction' than 'addition and subtraction of fraction'. Second, the participants have different error types depend on their constructed-response items. Most of error types which group with high ability made was 'leap of solving process', both groups error type with medium ability as well as low ability is 'misunderstanding of questions'. Third, the operation skills on 'addition and subtraction of fraction' have an influence on their operation skills on 'multiplication of fraction', and error types of 'understanding of questions' and 'understanding of solving process' have the most effects on the influence.

• Journal of The Korean Association of Information Education
• /
• v.20 no.3
• /
• pp.255-262
• /
• 2016

In this paper, we proposes a method to effectively evaluate learner competencies of computational thinking. Developed descriptive performance assessment tool is the use of assessment items presented in a creative computing MIT. This tool is selected and modified items through expert delphi technique. The performance assessment tool is composed of four areas that are an experimenting and iterating, testing and debugging, reusing and remixing and abstracting and modularizing. We apply to software classes for the pre-service teachers and conducted this descriptive performance assessment. Applying result of the assessment, the developed assessment tool shows the reliability $Cronbach-{\alpha}$ values higher than 0.6. In addition, the validity of the test results is higher in experts delphi test. Descriptive assessment tool suggested in this study are identified as a useful assessment tool to effectively measure student CT competencies.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.187-207
• /
• 2024

In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

• Journal of The Korean Association For Science Education
• /
• v.34 no.6
• /
• pp.593-599
• /
• 2014

The purpose of this study is to figure out the influence on the students' achievement of the cognitive and the affective domains by descriptive items assessment of teacher or peer and to obtain implications by analyzing the students' satisfaction and the reliability of the assessment. For this purpose, two classes of 11th grade students located in a small city were selected and took an exam related to the cognitive and the affective domains before and after the assessment. The assessment activities were carried out during 10 lessons and the teacher gave feedback to the students of the teacher assessment class in the lessons. In the peer assessment class, a small-size student group discussion and feedback were given to the students after the exam. The results show that higher level achievement group students represented relatively positive satisfaction on teacher assessment, and lower level achievement group students represented positive satisfaction on peer assessment. In spite of the same marker list, higher level achievement group students represent relatively high reliability than lower level achievement group students. The lower level achievement group students in the peer assessment class got statistically meaningful improvement of achievement than the students of teacher assessment class. The peer assessment activity was positively influenced on the affective domain of the lower level achievement group students, especially signigicant meaning of statistics was found on the students' perception about science.

• The Journal of Korean Association of Computer Education
• /
• v.21 no.6
• /
• pp.105-115
• /
• 2018

The descriptive-type question is appropriate for deep thinking ability evaluation, but it is not easy to grade. Since, even though same grading criterion, the graders produce different scores, we need the objective evaluation system. However, the system needs the Korean analysis. As the descriptive-type answering is described with the compound sentence, the system has to analyze the compound sentence. This paper develops the Korean syntactic-semantic analysis system for compound sentence and evaluates performance of the system. This system selects the modifiee of the word phrase using syntactic-semantic constraint and semantic dictionary. The 93% accurate rate shows that the system is effective. This system will be utilized in descriptive-type grading and Korean processing.

• Journal of The Korean Association For Science Education
• /
• v.25 no.2
• /
• pp.173-183
• /
• 2005

In this study, we questioned what assessment types and scoring methods of science performance assessment(SPA) were being used in middle and high school, and how much these SPA scores were reliable(generalizable). To answer these questions, SPA data obtained from the seven schools were classified according to assessment type and scoring method. Based upon this classification, we analyzed the reliability by applying generalizability theory. The result, from the classification of assessment type and scoring method, showed that SPA types of the seven schools were divided into two types: paper-pencil type and task type. Paper-pencil type included answer(content)-restricted essay-type test solely. Task type has two parts: process and outcome assessment. As the results of analyzing scoring methods of the seven schools, there were two cases in the way of scoring methods: one case is scoring all essay-type items and performance tasks by one teacher, the other is scoring assigned performance tasks by two teachers. But the case of scoring assigned essay-type items or the case of cross scoring by two or more teachers were not found. The findings of the reliability analysis are as follows: (1) Effect of essay-type item to SPA score was larger than that of performance task. (2) There was remarkable difference among the seven schools' interaction effect of person and rater in scoring performance tasks. (3) Most of generalizability(reliability) coefficients of SPA for the seven schools were smaller than the acceptable generalizability coefficient(0.80). Therefore, the population of statistical parameters such as number of item, task and rater, should be increased for approaching the acceptable generalizability level.

• Journal of Educational Research in Mathematics
• /
• v.23 no.4
• /
• pp.533-551
• /
• 2013

The purpose of this study is to investigate how middle school mathematics teachers understand the definition and the purpose of constructed-response assessments as well as what they expect from the assessments. By examining the responses of 189 middle school mathematics teachers to the survey, we found that there is discrepancy between their perceptions and reality of the constructed-response assessments in practice. In other words, teachers' practice is not well aligned with their perceptions and expectations due to the restraint of school system and environment. The findings give us some meaningful implication for the improvement of effective constructed-response assessments and professional development.

• The Mathematical Education
• /
• v.47 no.4
• /
• pp.487-503
• /
• 2008

In this paper, descriptive assessment method for middle school mathematics was evaluated by developing a framework for designing and grading problems for descriptive assessment and analyzing the effectiveness of the problems. The new descriptive assessment problems were developed by reviewing the current 7th National Mathematics Curriculum of Korea and aligned mathematics textbooks to define a set of problem design principles and evaluation framework for the assessment strategy. The developed problems were first pilot tested and then revised based on the feedback from the test. The final version was field tested by 100 students in 7th grade middle school. After the field test, the problems were graded by two middle school math teachers and one math education researcher to determine the overall correlation between graders and also to analyze effectiveness of the evaluation framework of the test. This result of this study is expected to assist in the further development of descriptive problems and grading framework by providing a reference work for teachers to better understand the process and the limitations of executing the new assessment strategy.