• Annual Conference on Human and Language Technology
• /
• 2016.10a
• /
• pp.181-185
• /
• 2016

최근 교육과정에서 학생들의 능력 평가는 단순 암기보다 학생들의 종합적인 사고력을 판단할 수 있는 서답형 문항을 늘리는 방향으로 변하고 있다. 그러나 서답형 문항의 경우 채점하는 데 시간과 비용이 많이 들고, 채점자의 주관에 따라 채점 결과의 일관성과 신뢰성을 보장하기 어렵다는 문제가 있다. 이런 점을 해결하기 위해 해외의 사례를 참고하여 국내에서도 서답형 문항에 자동채점 시스템을 적용하는 연구를 진행하고 있다. 본 논문에서는 2014년도에 개발된 '한국어 문장 수준 서답형 문항 자동채점 시스템'의 성능분석을 바탕으로 언어 처리 기능과 자동채점 성능을 개선한 2015년도 자동채점 시스템을 간략하게 소개하고, 각 자동채점 시스템의 성능을 비교 분석한다. 성능 분석 대상으로는 2014년도 국가수준 학업성취도평가의 서답형 문항을 사용했다. 실험 결과, 개선한 시스템의 평균 완전 일치도와 평균 정확률이 기존의 시스템보다 각각 9.4%p, 8.9%p 증가했다. 자동채점 시스템의 목적은 가능한 채점 시간을 단축하면서 채점 기준의 일관성과 신뢰성을 확보하는 데 있으므로, 보완한 2015년 자동채점 시스템의 성능이 향상되었다고 판단할 수 있다.

• KIPS Transactions on Software and Data Engineering
• /
• v.5 no.11
• /
• pp.527-534
• /
• 2016

The emergent information society requires the talent for creative thinking based on problem-solving skills and comprehensive thinking rather than simple memorization. Therefore, the Korean curriculum has also changed into the direction of the creative thinking through increasing short-answer questions that can determine the overall thinking of the students. However, their scoring results are a little bit inconsistency because scoring short-answer questions depends on the subjective scoring of human raters. In order to alleviate this point, an automated scoring system using a machine learning has been used as a scoring tool in overseas. Linguistically, Korean and English is totally different in the structure of the sentences. Thus, the automated scoring system used in English cannot be applied to Korean. In this paper, we introduce an automated scoring system for Korean short-answer questions using predictability and unanimity. We also verify the practicality of the automatic scoring system through the correlation coefficient between the results of the automated scoring system and those of human raters. In the experiment of this paper, the proposed system is evaluated for constructed-response items of Korean language, social studies, and science in the National Assessment of Educational Achievement. The analysis was used Pearson correlation coefficients and Kappa coefficient. Results of the experiment had showed a strong positive correlation with all the correlation coefficients at 0.7 or higher. Thus, the scoring results of the proposed scoring system are similar to those of human raters. Therefore, the automated scoring system should be found to be useful as a scoring tool.

• Journal of The Korean Association For Science Education
• /
• v.36 no.4
• /
• pp.563-579
• /
• 2016

This study seeks educational implication by analyzing research papers dealing with science assessment in the most recent 30 years in Korea. The main purpose of the study is to analyze the trends in published papers on science assessment, their purpose, methodology, and key words, especially concentrating on the cognitive and affective domains. We selected 273 research articles and categorized them by research object, subject, methodology, and contents. To examine the factors that affect the research trend, we also tried to contextualize papers' theme in terms of changes in national curriculum and assessment system during the contemporary period. As a result, an overall research trend reflects changes in science curriculum and assessment events such as implementation of college scholastic ability test or performance assessment. There is an unequal distribution in various aspects of the researches, showing a superiority in cognitive domains than the affective ones. By using standardized data obtained through the national and international assessment of educational achievement in science, quantitative researches were superior to qualitative ones. Studies on cognitive domain use variously written- and performance-based tests, whereas most studies of the affective ones prefer written tests. Applied research and evaluation research are predominant comparing to basic ones, which most of the research methodology is based on statistics. Lastly, we found out that key words and subjects tend to be subdivided and detailed rather than general and comprehensive, as time goes on. Such trend will be helpful to elaborate and refine assessment tools that have been regarded as a problem.

• Journal of the Korean School Mathematics Society
• /
• v.21 no.1
• /
• pp.39-62
• /
• 2018

In vocational high schools, mathematics classes aims to improve students' mathematics-applying ability as the employ ability. However, these classes are based on the national curriculum of mathematics likewise general high schools. In this study, we develop and present the materials of teaching and learning mathematics for teachers and students in vocational high schools. We analyze the Test for Enhanced Employ Ability and Upgraded Proficiency (TEENUP) and 2015 revised national curriculum of mathematics, and consider how teachers can use this curriculum to enhance employ ability. As a result, materials of teaching and learning mathematics should be developed in terms of use of curriculum based on teachers' didactical understanding. Moreover, we present the developed materials as examples reflecting on the framework of TEENUP and connecting the 2015 revised national curriculum of mathematics. Based on these results, we draw some recommendations for applying and developing material of teaching and learning mathematics.

• Korean Journal of Comparative Education
• /
• v.28 no.4
• /
• pp.1-21
• /
• 2018

The OECD ITP project has looked at the black box of each participating countries' teacher education system. In the 2000s, various countries have tried to reform their professional development systems for teachers, including teacher education and induction, as an initial yet crucial step to improve the quality of education. Since 2015, OECD member countries have been conducting an international comparison study on teacher education and induction programs(i.e. ITP). The ITP project is an in-depth comparative study among the member countries that have expressed willingness to participate voluntarily. This paper introduces the progress of the ITP project and analyzed the national background report on the teacher education and induction system of the participating countries and compared the features of the systems. In addition, this study explores the common issues surrounding the teacher education and induction system. Moreover, the researcher has tried to derive some suggestions for improvement of teacher education and induction system in Korea.

• Journal of the Korean Chemical Society
• /
• v.65 no.3
• /
• pp.209-218
• /
• 2021

This study investigated the condition of chemistry teacher's student competency assessment based on the inquiry report. To this end, an inquiry report was collected for chemistry teachers who took the training at two universities that conducted the 2020 first-class chemistry teacher training. The science subject competencies presented in NAEA analysis framework was used to analyze what kind of competencies teachers assess students through inquiry reports. A total of 63 chemistry teachers submitted inquiry reports, which were analyzed by competency, sub-element of each competency, and detail element to analyze the actual situation. As a result of the study, most chemistry teachers reflected their 'scientific inquiry and problem-solving ability' in their evaluation through inquiry reports. 'Ability to understand and apply scientific principles', which is mainly evaluated through paper-based evaluation, was partially used as confirmation of prerequisite learning at the beginning of the inquiry and the weight of evaluating 'scientific communication skill' was not large. In 'scientific inquiry and problem-solving ability' through inquiry report, 'design and conduct explorations', 'data analysis and interpretation' and 'drawing conclusion and suggesting solution' were mainly assessed. However, 'discover and recognize problems' and 'development and use of model' were hardly assessed.

• Journal of Digital Convergence
• /
• v.18 no.6
• /
• pp.81-91
• /
• 2020

The purpose of this study is to analyze the effect of group co-learning on English reading ability and motivation and the change in group co-learning perception after planning and applying a group co-study class program that can be applied in university liberal arts English class. In order to achieve this goal, the experiment team (34 students) conducted the class from September 2 to December 13, 2019 for 62 freshmen who participated in the compulsory liberal arts English class at the four-year university in North Chungcheong Province, and the control team (28 students) conducted the class as a typical lecture class based on the basis of cooperative learning. The English proficiency of the learners was approached by dividing the area of academic proficiency into English reading skills and the area of justice into English reading motivations. The pre-experimental learners' English reading skills were measured by excerpting the national level educational achievement assessment (high 2). The research results are as follows. First, it was shown that the English reading ability score of a group that applied group cooperative learning and the English reading ability score of a group that did not apply group cooperative learning were statistically significant differences. Second, there was a difference between the English reading motivation score of the group applying the convocation group cooperative learning and the English reading motivation score of the group not applied. Third, the change in the perception of groups applying the convocation group cooperative learning occurred before and after the experiment. This study found that the awareness of English reading, English reading motivation, and cooperative learning increased through cooperative learning among university students during liberal arts English classes, which has a positive effect on self-identity and so on.