• Proceedings of the Korea Information Processing Society Conference
• /
• 2004.05a
• /
• pp.965-968
• /
• 2004

기존의 주관식 문제 채점 보조 시스템은 자연어 처리의 어려움으로 인해 채점의 자동화가 어려워 전자우편 등을 통하여 채점자에게 채점 의뢰를 하는 수준이었다. 본 논문에서는 이러한 문제점을 해결하기 위하여 문제 공간을 벡터 공간으로 정의하고 벡터를 구성하는 각 자질간의 상관관계를 고려한 방법을 적용하였다. 먼저 학습자가 답안을 작성할 때 동의어 사용을 한다는 가정하에 출제자가 여러 개의 모범 답안을 작성하고 이들 답안을 말뭉치에 첨가하여 구성한 다음 형태소 분석기를 통하여 색인을 추출한다. 그리고 학습자가 작성한 답안 역시 색인을 추출한 다음, 이들 색인들을 각 자질로 정의한 벡터를 구성한다. 이렇게 구성된 벡터들을 이용하여 답안들간 유사도 측정을 하고, 유사도 범위에 따라 답안을 자동으로 정답과 오답으로 분류하려는 시스템을 제안한다. 170 문항의 주관식 문제을 제안된 방법으로 실험하여, 기존 모델에 비해 성능과 신뢰성 향상을 이룰 수 있었다.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.11
• /
• pp.127-133
• /
• 2019

SQL is the most common language in data processing. Therefore, most of the colleges offer SQL in their curriculum. In this research, an auto scoring SQL test is proposed for the efficient results of SQL education. The system was treated with algorithms instead of using expensive DBMS(Data Base Management System) for automatic scoring, and satisfactory results were produced. For this system, the test question bank was established out of 'personnel management' and 'academic management'. It provides users with different sets of test each time. Scoring was done by dividing tables into two sections. The one that does not change the table(select) and the other that actually changes the table(update, insert, delete). In the case of a search, the answer and response were executed at first and then the results were compared and processed, the user's answers are evaluated by comparing the table with the correct answer. Modification, insertion, and deletion of table actually changes the data table, so data was restored by using ROLLBACK command. This system was implemented and tested 772 times on the 88 students in Computer Information Division of our college. The results of the implementation show that the average scoring time for a test consisting of 10 questions is 0.052 seconds, and the performance of this system is distinguished considering that multiple responses cannot be processed at the same time by a human grader, we want to develop a problem system that takes into account the difficulty of the problem into account near future.

• Journal of KIISE
• /
• v.42 no.9
• /
• pp.1124-1132
• /
• 2015

In order to train a supervised machine learning algorithm, it is necessary to have non-biased labels and a sufficient amount of training data. However, it is difficult to collect the required non-biased labels and a sufficient amount of training data to develop an automatic English Composition scoring system. In addition, an English writing assessment is carried out using a multi-faceted evaluation of the overall level of the answer. Therefore, it is difficult to choose an appropriate machine learning algorithm for such work. In this paper, we show that it is possible to alleviate these problems through ensemble learning. The results of the experiment indicate that the ensemble technique exhibited an overall performance that was better than that of other algorithms.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.05a
• /
• pp.187-190
• /
• 2018

최근 프로그래밍 교육에서 학생들의 학습 성취도를 빠르고 정확하게 평가하기 위하여 자동 채점 시스템을 사용한다. 강의를 통해 습득한 이론적인 지식을 이해하기 위해 직접 코드를 작성하는 실습이 진행되는 프로그래밍 교육에서 효과적이기 때문이다. 현재 실습에 필요한 실습문항의 대부분은 강사가 직접 생성해야 한다. 특히 강의내용을 바탕으로 예제 소스코드를 이해하여 빈 칸에 알맞은 코드를 작성하는 실습은 강사가 직접 빈 칸에 해당되는 부분을 예제 코드에서 지정해줘야 하는 추가적인 작업이 필요하다. 이러한 빈 칸 채우기 문항은 일반적으로 빈 칸이 고정된 행태이기 예문에 학생들이 답안을 공유하기 쉽다. 이를 막기 위해서 강사는 유사한 내용의 빈 칸 채우기 문항을 추가적으로 생성해야 한다. 하지만 대부분의 자동 채점 시스템은 이를 지원하지 않거나 강사에게 빈 칸을 직접 지정하도록 하는 경우가 대부분이다. 따라서 본 논문에서는 이러한 문제를 해결하는 빈 칸 채우기 문항 자동생성기법을 제안하고 적용 사례를 보인다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2013.10a
• /
• pp.173-176
• /
• 2013

This paper's questions, and an automatic scoring system written in HTML, and XML-based system that is at issue, the issue questions in a convenient offline automatically how to register, Easy to manage questions of issues, questions and problems of merging the PC and the mobile device in a place that can be obtained without taking the test system study. Server systems, and real-time registration questions merging problem, such as difficulty adjusting to the test required to build the system. Clients communicate with the server using the mobile device and the PC is required to take the exam in the View application, and responses are sent for treatment research.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.370-372
• /
• 2014

This study questions, and an automatic scoring system written in HTML, and XML-based system that is at issue, the issue questions in a convenient offline automatically how to register, Easy to manage questions of issues, questions and problems of merging the PC and the mobile device in a place that can be obtained without taking the test system study. Server systems, and real-time registration questions merging problem, such as difficulty adjusting to the test required to build the system. Clients communicate with the server using the mobile device and the PC is required to take the exam in the View application, and responses are sent for treatment research.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.1
• /
• pp.45-56
• /
• 2015

In this paper, we present a method that can detect context-sensitive word errors and generate correction candidates. Spelling error detection is one of the most widespread research topics, however, the approach proposed in this paper is adjusted for an automated English scoring system. A common strategy in context-sensitive word error detection is using a pre-defined confusion set to generate correction candidates. We automatically generate a confusion set in order to consider the characteristics of sentences written by second-language learners. We define a word error that cannot be detected by a conventional grammar checker because of part-of-speech ambiguity, and propose how to detect the error and generate correction candidates for this kind of error. An experiment is performed on the English writings composed by junior-high school students whose mother tongue is Korean. The f1 value of the proposed method is 70.48%, which shows that our method is promising comparing to the current-state-of-the art.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.16 no.2
• /
• pp.180-189
• /
• 2017

Some people who take a driver's license test retake it again because of license cancellation, but most of them take the test for the first time to drive the car. Driving a car is directly linked to life, and the initial correct driving habits are more important than anything else. In particular, it is very important to obtain a license by evaluating the correct driving ability based on objective and fair standards when learning the first driving, because many people acquire a driving license while entering the society for the first time. In this paper, we propose the S / W design and its main functions that can emit high quality drivers through efficient, fair and accurate automated scoring. Through this, it is proposed to improve the automatic grading driver's license system, to prevent traffic accidents, and to reduce traffic accidents through proper driving.

• The KIPS Transactions:PartA
• /
• v.12A no.6 s.96
• /
• pp.539-546
• /
• 2005

Recently, as the number of Internet users are growing explosively, e-learning has been applied spread, as well as remote evaluation of intellectual capacity However, only the multiple choice and/or the objective tests have been applied to the e-learning, because of difficulty of natural language processing. For the intelligent marking of short-essay typed answer papers with rapidness and fairness, this work utilize heterogenous linguistic knowledges. Firstly, we construct the semantic kernel from un tagged corpus. Then the answer papers of students and instructors are transformed into the vector form. Finally, we evaluate the similarity between the papers by using the semantic kernel and decide whether the answer paper is correct or not, based on the similarity values. For the construction of the semantic kernel, we used latent semantic analysis based on the vector space model. Further we try to reduce the problem of information shortage, by integrating Korean Word Net. For the construction of the semantic kernel we collected 38,727 newspaper articles and extracted 75,175 indexed terms. In the experiment, about 0.894 correlation coefficient value, between the marking results from this system and the human instructors, was acquired.

• English Language & Literature Teaching
• /
• v.13 no.1
• /
• pp.235-259
• /
• 2007

The purpose of the present study is to develop a prototype automated scoring system for English writing. The system was developed for scoring writings of Korean middle school students. In order to develop the automated scoring system, following procedures have been applied. First, review and analysis of established automated essay scoring systems in other countries have been accomplished. By doing so, we could get the guidance for development of a new sentence-level automated scoring system for Korean EFL students. Second, knowledge base such as lexicon, grammar and WordNet for natural language processing and error corpus of English writing of Korean middle school students were established. Error corpus was established through the paper and pencil test with 589 third year middle school students. This study provided suggestions for the successful introduction of an automated scoring system in Korea. The automated scoring system developed in this study should be continuously upgraded to improve the accuracy of the scoring system. Also, it is suggested to develop an automated scoring system being able to carry out evaluation of English essay, not only sentence-level evaluation. The system needs to be upgraded for the improved precision, but, it was a successful introduction of an sentence-level automated scoring system for English writing in Korea.