• Annual Conference on Human and Language Technology
• /
• 2012.10a
• /
• pp.138-141
• /
• 2012

한국어 서답형 문항의 자동채점 프로그램을 개발하기 위해서는 모범답안, 오답, 부분점수 부여를 위한 세부적인 내용을 채점 기준표로 기술해야 한다. 자동채점에 필요한 구체적인 사항들을 기술하기 위하여 XML 형식으로 정답 템플릿을 정의하였다. 채점에 필요한 내용을 단위 개념으로 정의하고 이를 컴퓨터가 엑세스 가능한 형태의 정답 템플릿을 설계하였다. 정답 템플릿 형식에 맞게 편리하게 템플릿을 작성할 수 있는 작성 도구를 이용하여 학업 성취도평가 각 문항에 대한 채점 기준표를 정답 템플릿으로 작성하여 채점기준표를 작성하는 실험을 수행하였다.

• Journal of the Korean Physical Therapy Association
• /
• v.7 no.1
• /
• pp.33-39
• /
• 1986

• Annual Conference on Human and Language Technology
• /
• 2012.10a
• /
• pp.69-72
• /
• 2012

본 논문은 한국어 서답형(단어, 구 수준) 문항 유형을 분석하고 실제 채점자가 채점 기준표를 보고 채점하는 방법을 컴퓨터가 인식할 수 있도록 정답 템플릿을 설계 및 개념 정의를 하여 한국어 서답형에 특화된 자동채점 시스템 방법을 제시한다. 본 시스템을 사용하여 1000개의 학생 답안지에 대한 유형 가지수 500개 이하의 2011년도 학업성취도 평가 과학 6개 문항에 대하여 채점 기준표 내용을 정답 템플릿으로 작성한 뒤 250개 학생 답안을 학습데이터로, 정답 템플릿을 업데이트로 사용, 750개 학생 답안에 대하여 자동채점한 결과, 평균 카파계수 0.84라는 수치로서 실제 사람 채점 결과와 거의 완벽히 일치라는 결과를 얻었다.

• Communications of Mathematical Education
• /
• v.27 no.4
• /
• pp.581-609
• /
• 2013

Students' learning processes and mathematical levels should be correctly diagnosed in many different methods of assessment to help students learn mathematics. The study developed the model for the process-based assessment while using manipulatives in the middle school in order to improve problem solving, reasoning and communication which are emphasized in 2009 reformed curriculum as the areas of mathematical process. Identifying the principles of assessment, we created the assessment model for each area and carried out a preliminary study. Based on this, we revised the representative items and the observation checklist and then conducted a main study. Through the results of assessment, we found that students' thinking processes were well presented in scoring rubric for their responses on each item. It meant that the purpose of the assessment as a criterion-referenced test was achieved.

• KIISE Transactions on Computing Practices
• /
• v.22 no.5
• /
• pp.218-224
• /
• 2016

This paper proposes a computer-based practical automatic scoring system for Korean short answers through student answer analysis and natural language processing techniques. The proposed system reduces the overall scoring time and budget, while improving the ease-of-use to write answer templates from student answers as well as the accuracy and reliability of automatic scoring system. To evaluate the application of the automatic scoring system and compare to the human scoring process, we performed an experiment using the student answers of social science subject in 2014 National Assessment of Educational Achievement.

• Journal of Korean Home Economics Education Association
• /
• v.32 no.3
• /
• pp.135-159
• /
• 2020

The purpose of this study was to develop items of an essay response assessment that could align with the instructions and assessments in the high school home economics curriculum. The contents of the study were as follows. First, to establish an assessment plan, 14 achievement standards were analyzed in the assessment area, and the elements of the questions were developed including the content elements of a total of 29 questions. Second, to develop the assessment tools, preliminary questions suited to the structure of essay questions were developed, and the method of presenting data and scoring criteria to be utilized in the questions was selected. Third, to prepare the answers and the scoring criteria tables, the answers to the sample questions for each score were prepared in form of a scoring criteria table, and the objectives of the assessment, the scoring items, and the scores for each item were reviewed. Fourth, the developed questions and answers were revised and supplemented by teachers of the professional learning community through preliminary and mutual review on the components of the questions, the embodiment of the assessment objectives, the implementation of the assessment intent, and the grading. This study can be used as a foundational study for the development of essay-type questions and scoring criteria in essay assessment in the field of education. Furthermore, the results of this study could help teachers enhance their learners' ability to apply knowledge in the future.

• School Mathematics
• /
• v.15 no.2
• /
• pp.263-288
• /
• 2013

This study was conducted to provide practical ways to apply interview assessments in classrooms. Interview assessments have been asserted to serve as one of the alternatives to the traditional paper-and-pencil tests. In order to propose ways for teachers to actively use interview assessments for mathematics assessments, relevant instruments were developed by analyzing a number of related theories. These instruments were developed in two forms: interview assessments focused on identifying student characteristics and those focused on identifying thought processes. The interview assessments were applied in classroom settings and the results of this application were analyzed. The findings from this study are expected to suggest beneficial implications for teachers who are interested in practicing interview assessments in classrooms.

• Journal of The Korean Association For Science Education
• /
• v.42 no.2
• /
• pp.239-252
• /
• 2022

This study aims to develop performance criteria based on characteristics observed in science inquiry tasks for elementary school students. First, the performance characteristics by observing 70 fifth-grade elementary school students' science inquiry activity report are listed. Second, the checklist-type scoring criteria in connection with the theoretical framework of scientific inquiry process and relevant competencies are developed. Third, with the developed scoring criteria, 11 raters participate in scoring 350 students' reports. The main findings are as follow: first, the scoring data are well-fitted for the many-faceted Rasch model, and 22 scoring criteria are reasonably-well differentiated for various levels of proficiency. Second, at low performance level, observable characteristics are to answer questions explicitly required by the task or to observe objects or phenomena using pre-learned scientific concepts, while at high performance level, to explore additional data other than given data or to reflect on one's experimental process. Based on the results, the usefulness of analyzing students' performance characteristics for developing the scoring criteria, and further research directions are discussed.

• School Mathematics
• /
• v.6 no.1
• /
• pp.21-35
• /
• 2004

This article was to develop a tool and apply it to the high school classrooms for the performance assessment in trigonometry Bloom(1956)'s cognitive domain and holistic rubric and analytic rubric(NCTM, 1999) were used to guide the development of 12 problems. To find validity and credibility of this developed tool, Cronbach n and Rasch's BIGSTEPS were used with the samples of high students, 208, using SPSS 10.0K. The results from the investigation, indicated that the tool was very worth assessing students' achievement and there was no difference between the areas where students lived, but were differences between genders as well as between a specialized high school and preparatory high schools.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.11a
• /
• pp.1227-1230
• /
• 2021

최근, 초보 운전자의 차량 운전 접근성이 높아짐에 따라 사고 발생률 또한 증가하고 있다. 이를 예방하기 위해 본 연구에서는 도로 환경을 VR 시뮬레이션으로 제공하여, 사용자가 실제 도로 교통 상황과 유사한 환경에서 주행 연습이 가능하도록 하였다. 일반 도로, 어린이 보호 구역, 주차 구역, 산간 도로를 가상 환경을 구성하여 각 환경별 난이도와 장애물을 설정하였다. 또한, 실제 운전 면허 자격 시험 기준표를 기반으로 채점 표를 작성하였고, 이를 적용한 시뮬레이션 결과를 사용자에게 제공한다. 사용자는 운전 상황에서 발생 가능한 다양한 돌발 상황에 대비하고 제공받은 채점 기능을 통해 학습함으로써 운전 실력을 향상시킬 것으로 기대된다.