• Journal of The Korean Association For Science Education
• /
• v.24 no.3
• /
• pp.519-531
• /
• 2004

In recent years, there has been an increased emphasis on performance assessment to evaluate students' abilities. Our nation has introduced a change in testing and assessment. Additional work on the efficacy, reliability, and comparability in order to develop the performance assessment item has been needed in the enforcement of the 7th National Science Curriculum. Also, criteria for professional and technical standards has been needed to be developed. The purpose of this study was to draw out various key concepts and to develop achievement standards, assessment standards and performance assessment items based on the 7th National Science Curriculum on the subject matter of reproduction(chapter 13) and biological accumulation(chapter 17). And also, this study examined the validity of completed performance assessment items based on classical test theory and polytomous item response theory. Twelve key concepts in chapter 13(reproduction) and four from chapter 17(biological accumulation) were abstracted. Twenty-six achievement standards in chapter 13(reproduction), and nine in chapter 17(biological accumulation) were developed. The achievement standards were determined in terms of knowledge(K), process skill(P) and attitude(A). Twenty-five assessment standards in chapter 13(reproduction) and nine in chapter 17(biological accumulation) were developed. Based on the developed achievement standards and assessment standards, twenty-two performance assessment items(seventeen open-ended questions, three essays, and two portfolios) with concrete grading criteria were developed. Eight open-ended items were applied to 240 10th graders to evaluate reliabilities of the test which consisted of four items per each chapter. The results would be suggested that the applied items were valid for performance assessment because item difficulties and item discriminations were proper. There was not much differences in item discrimination between interpretation from classical test theory and that from polytomous item response theory. However, there were some differences in item difficulties between the interpretations of two theories because the characteristics of examinees were reflected in classical test theory.

• The Mathematical Education
• /
• v.53 no.4
• /
• pp.509-524
• /
• 2014

This study was to investigate the types of errors and the frequency of errors to understand students' solving process on the descriptive items with the students of an excellent high school which located in a non-leveling local school district of Gyunggi Province. All 11 items were developed in the equation of a circle and 120 students who attended this high school participated in solving them. The result showed a tendency as follows: Logically invalid inference(Type A, 38.83%) of errors, Omission error of the problem solving process(Type B, 25%), Technical error(Type C, 15.67%), Wrong conclusion(Type D, 11.94%), Use of wrong theorem(Type E, 5.97%), and Use of wrong picture(Type F, 2.61%). The logically invalid inference the students showed with a largest tendency was made because of the lack of reflection. This meant that this error could be corrected in a little treatment of carefulness.

• The Mathematical Education
• /
• v.47 no.2
• /
• pp.181-195
• /
• 2008

The purpose of this study was to investigate the understanding of basic knowledge of mathematics for $6^{th}$ grade students in elementary school by an essay test and provide instructional suggestions for teachers. A total of 132 students from 6 classes in 3 elementary schools were tested and analyzed in terms of the characteristics of correct answers and types of incorrect answers. The results showed that students had poor understanding of basic conceptual concepts and principles throughout six content areas of school mathematics curriculum, despite their good performance on mathematical skills. This study included implications to teaching and learning for each of the content areas.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.187-207
• /
• 2024

In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Journal of the Korean School Mathematics Society
• /
• v.15 no.4
• /
• pp.719-745
• /
• 2012

This research is a study on student's understanding fundamental conception of mathematical curriculum, especially in geometry domain. The goal of researching is to analyze student's wrong conception about that domain and get the mathematical teaching method. We developed various questions of descriptive assessment. Then we set up the term, procedure of research for the understanding student's knowledge of geometry. And we figured out the student's understanding extent through analysing questions of descriptive assessment in geometry. In this research, we concluded that most of students are having difficulty with defining the fundamental conception of mathematics, especially in geometry. Almost all the students defined the fundamental conceptions of mathematics obscurely and sometimes even missed indispensable properties. Prior to this study, we couldn't identify this problem. Here are some suggestions. First, take time to reflect on your previous mathematics method. And then compile some well-selected questions of descriptive assessment that tell us more about student's understanding in geometry.

• Journal of Elementary Mathematics Education in Korea
• /
• v.18 no.1
• /
• pp.123-148
• /
• 2014

The purpose of this study is to figure out the perceptional characteristics of mathematically gifted elementary students by comparing the mathematical reasoning ability and errors between mathematically gifted elementary students and non-gifted students. This research has been targeted at 63 gifted students from 5 elementary schools and 63 non-gifted students from 4 elementary schools. The result of this research is as follows. First, mathematically gifted elementary students have higher inductive reasoning ability compared to non-gifted students. Mathematically gifted elementary students collected proper, accurate, systematic data. Second, mathematically gifted elementary students have higher inductive analogical ability compared to non-gifted students. Mathematically gifted elementary students figure out structural similarity and background better than non-gifted students. Third, mathematically gifted elementary students have higher deductive reasoning ability compared to non-gifted students. Zero error ratio was significantly low for both mathematically gifted elementary students and non-gifted students in deductive reasoning, however, mathematically gifted elementary students presented more general and appropriate data compared to non-gifted students and less reasoning step was achieved. Also, thinking process was well delivered compared to non-gifted students. Fourth, mathematically gifted elementary students committed fewer errors in comparison with non-gifted students. Both mathematically gifted elementary students and non-gifted students made the most mistakes in solving process, however, the number of the errors was less in mathematically gifted elementary students.

• Proceedings of the KAIS Fall Conference
• /
• 2007.11a
• /
• pp.162-165
• /
• 2007

본 논문에서는 고주파 전류형 인버터의 출력을 제어하기 위하여 입력단의 쵸핑 스위칭 방법을 제안한다. 인버터의 출력제어는 스위칭 소자에 인가되는 구동신호에 위상천이의 크기에 따라 제어하고 있으며, 제한회로의 동작원리를 서술하였다. 또한 회로설계에 필요한 출력특성은 수치해석에 의해 평가자료를 도출하고 실험 장치를 제작하여 이론결과와 비교 검토하여 특성평가의 정당성을 입증하였다.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.606-610
• /
• 2009

We propose a method utilizing BLEU(BiLingual Evaluation Understudy), which is widely used in automatic evaluation of machine translations, for an autonomous assessment of a short essay answer. BLEU evaluates translations with an assumption that the translation by a machine is supposed to be more accurate as it is getting to be more similar to the translation by a human. BLEU scores the translation by comparing the n-grams of translations by a machine and humans. Similarly we score students answers by comparing to multiple reference answers with BLEU. In the experiment, we compute correlation coefficient values between scores of our system and human instructors.

• The Mathematical Education
• /
• v.53 no.1
• /
• pp.131-146
• /
• 2014

This study examines whether there is discrepancy between elementary and middle school mathematics teachers' beliefs and practices in constructed-response assessment and how their beliefs and practices are interrelated. Analyzing the responses of 212 elementary teachers and 189 middle school mathematics teachers to the questionnaire, we found that there is lack of consistency among elementary and middle school teachers' beliefs, practices, and expected benefits regarding constructed-response assessment. In addition, there was a weak correlation between each group of teachers' beliefs and expected benefits about constructed-response assessment. The results from this study imply that such inconsistency in elementary and middle school teachers' beliefs and practices regarding assessments may determine the effects of constructed-response assessment.