• Journal of the Korean School Mathematics Society
• /
• v.20 no.1
• /
• pp.1-18
• /
• 2017

Most enrolled students arranging for the College Scholastic Ability Test(CSAT) prepare it through two types of mock tests during the year of the third grade. One type is Nationwide Coalition Scholastic Ability Evaluation(NCSAE) conducted four times by the city and provincial office of education, the other type is the CSAT June and September Mock Test administered by the Korea Institute of Curriculum and Evaluation(KICE). However, these two types of tests are highly heterogeneous evaluations with many similarities. In this study, based on the analysis results of 2016 NCSAE grading statistics published by Seoul, Incheon and Gyeonggi provincial office of education and those of 2017 CSAT June and September Mock Test released by KICE, we analyzed the heterogeneity between two types of mock tests focused on the difficulty level. Based on this analysis, we examined mathematics section scores of 2016 NCSAE(March, April, July, October) and 2017 CSAT June and September Mock Test of 161 students in two high schools in Seoul and investigated the change of enrolled students grades according to the change of the test group. Through this, we sought to draw implications for the educational policy that should be accompanied necessarily in order to improve the item building system of the NCSAE.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.818-828
• /
• 2010

It has already been 17 years since the first implementation of the Korean College Scholastic Ability Test (CSAT). Having been administered so many CSAT tests including practice tests, criticisms have been made against CAST tests being stuck to the same pattern and focusing mainly on knowledge-based items. To address this issue, we analyzed the chemistry items of the Japanese National Center Test for University Admissions (NCTUA) administered in January of 2009 with regard to content factors, behavioral domains, item types, and noted any peculiarities in comparison to CSAT. Also, we estimated the predicted percentage of correct answers from the perspectives of Korean candidates to arrive at implications for chemistry items of CSAT.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.11
• /
• pp.509-520
• /
• 2015

College Scholastic Ability Test(CSAT) is a primary test to evaluate the study achievement of high-school students and used by most universities for admission decision in South Korea. Because its level of difficulty is a significant issue to both students and universities, the government makes a huge effort to have a consistent difficulty level every year. However, the actual levels of difficulty have significantly fluctuated, which causes many problems with university admission. In this paper, we build two types of data-driven prediction models to predict correct answer rate and to identify significant factors for CSAT English test through accumulated test data of CSAT, unlike traditional methods depending on experts' judgments. Initially, we derive candidate question-specific factors that can influence the correct answer rate, such as the position, EBS-relation, readability, from the annual CSAT practices and CSAT for 10 years. In addition, we drive context-specific factors by employing topic modeling which identify the underlying topics over the text. Then, the correct answer rate is predicted by multiple linear regression and level of difficulty is predicted by classification tree. The experimental results show that 90% of accuracy can be achieved by the level of difficulty (difficult/easy) classification model, whereas the error rate for correct answer rate is below 16%. Points and problem category are found to be critical to predict the correct answer rate. In addition, the correct answer rate is also influenced by some of the topics discovered by topic modeling. Based on our study, it will be possible to predict the range of expected correct answer rate for both question-level and entire test-level, which will help CSAT examiners to control the level of difficulties.