• Journal of the Korean School Mathematics Society
• /
• v.26 no.2
• /
• pp.137-158
• /
• 2023

This study aimed to analyze the shifts in the mathematics domains of the College Scholastic Ability Test (CSAT) since its inception in 1993, with the intent of identifying improvements for the future. The goal is to provide insights for exploring the direction of assessment in Korean high school mathematics education. To this end, we focused on the test system, content area, and behavioral area within the CSAT mathematics domains. Key findings include: first, the test structure influences the assessment factors and item types, in addition to the examination time and number of items. Second, by analyzing the content area, we established a correlation between the national curriculum and assessment area, and confirmed the importance of setting the assessment area. Third, the examination of the behavioral area tended to the item-type fixation, demonstrating the necessity of the ongoing modifications in evaluation item types. Building upon these findings, we discuss the direction of an evaluation that considers the evolving demands and shifts within mathematics education.

• Communications of Mathematical Education
• /
• v.28 no.2
• /
• pp.195-217
• /
• 2014

The College Scholastic Ability Test(CSAT) is the Korean national university examination based on the national curriculum. The CSAT is a high-stakes test because of powerful social forces which the college admission system has in Korea. This examination has changed many times through not only the national curriculum revision but also various external factors including the normalization of public education, mitigating the burden of students, etc. This study analysis the changes of assessment contents of the Mathematics of the CSAT due to the national curriculum revision. Additionally, this study analysis the mathematics content domains of the college entrance examinations in some foreign countries. Based on the result of this analysis, this study will derive implications for improvement directions of the Mathematics of the CSAT.

• Journal of Science Education
• /
• v.46 no.1
• /
• pp.121-149
• /
• 2022

Descriptive assessment is a meaningful assessment method in relation to problem solving ability, reasoning ability, and communication ability as emphasized in mathematics curriculum. In Korea, as performance assessment has been emphasized since the 7th mathematics curriculum, descriptive assessment is being conducted as a method of performance assessment in schools. However, descriptive assessment has not been introduced in the university scholastic ability test for various reasons. Considering that descriptive assessment is emphasized in the mathematics classroom and has sufficient educational value, a serious discussion on the implementation of descriptive assessment in the university scholastic ability test will be necessary. In this study, we analyzed the descriptive assessment of Russia's unified state examination (USE) in the mathematics, which corresponds to Korea's university scholastic ability test. Through a literature review, we investigated how mathematics examination problems were structured in the USE and which mathematical abilities were required for the examination. In particular, the outer structure of the problems was analyzed focusing on the mathematics problems of the USE 2021, and the scoring method of the descriptive problems was also analyzed. The results of this study are expected to provide a variety of information on the possibility of introducing descriptive assessment in the Korean university scholastic ability tests.

• Journal of The Korean Association For Science Education
• /
• v.30 no.4
• /
• pp.452-471
• /
• 2010

As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.818-828
• /
• 2010

It has already been 17 years since the first implementation of the Korean College Scholastic Ability Test (CSAT). Having been administered so many CSAT tests including practice tests, criticisms have been made against CAST tests being stuck to the same pattern and focusing mainly on knowledge-based items. To address this issue, we analyzed the chemistry items of the Japanese National Center Test for University Admissions (NCTUA) administered in January of 2009 with regard to content factors, behavioral domains, item types, and noted any peculiarities in comparison to CSAT. Also, we estimated the predicted percentage of correct answers from the perspectives of Korean candidates to arrive at implications for chemistry items of CSAT.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.233-256
• /
• 2023

This study conducted foundational research to derive ways to use ChatGPT in mathematics education by analyzing ChatGPT's responses to questions from the National Assessment of Educational Achievement (NAEA) and the College Scholastic Ability Test (CSAT). ChatGPT, a generative artificial intelligence model, has gained attention in various fields, and there is a growing demand for its use in education as the number of users rapidly increases. To the best of our knowledge, there are very few reported cases of educational studies utilizing ChatGPT. In this study, we analyzed ChatGPT 3.5 responses to questions from the three-year National Assessment of Educational Achievement and the College Scholastic Ability Test, categorizing them based on the percentage of correct answers, the accuracy of the solution process, and types of errors. The correct answer rates for ChatGPT in the National Assessment of Educational Achievement and the College Scholastic Ability Test questions were 37.1% and 15.97%, respectively. The accuracy of ChatGPT's solution process was calculated as 3.44 for the National Assessment of Educational Achievement and 2.49 for the College Scholastic Ability Test. Errors in solving math problems with ChatGPT were classified into procedural and functional errors. Procedural errors referred to mistakes in connecting expressions to the next step or in calculations, while functional errors were related to how ChatGPT recognized, judged, and outputted text. This analysis suggests that relying solely on the percentage of correct answers should not be the criterion for assessing ChatGPT's mathematical performance, but rather a combination of the accuracy of the solution process and types of errors should be considered.

• Korean Journal of Mathematics
• /
• v.23 no.4
• /
• pp.643-654
• /
• 2015

This study analyses the cross-application system, one of the diversified college admission processes, based on the entrance examination system by the reorganization of the education curriculum. In addition, this study suggests an improvement direction of mathematics education for students who cross-apply by comparing and analysing academic results in Calculus for those students entering universities through the cross-application system.

• Research in Mathematical Education
• /
• v.9 no.4 s.24
• /
• pp.329-333
• /
• 2005

Based on author's practice of instructing Chinese gifted students to join the Chinese Mathematics Olympic (CMO), the paper adopted test analysis model of the Scholastic Aptitude Test of Mathematics (SAT-M), tested mathematics ability of 212 mathematical gifted students to join the CMO, applied correlation analysis and factor analysis and proposed the mathematics ability structure in Chinese gifted students including comprehensive operation ability, logic thinking ability, abstract generalization ability, spatial imagination ability, memory ability, transfer ability and intuition thinking ability. And it analyzed the expression form of these abilities respectively and gave some suggestion on mathematics teaching about gifted Chinese students.

• Communications of Mathematical Education
• /
• v.25 no.3
• /
• pp.525-536
• /
• 2011

In the College Scholastic Ability Test, applicants of science tracks usually choose type Ga mathematics. However, students who took type Na mathematics test can also apply to science and engineering tracks in many universities by cross-Applications. Many universities have given additional points to type Ga mathematics test taker in order to recruit students who excel in the natural science track curriculum. In this paper, we study the necessity and effect of additional points system by using the data of Seoul National University of Science and Technology.

• Journal of Korean Society for Quality Management
• /
• v.50 no.2
• /
• pp.199-220
• /
• 2022

Purpose: The purpose of this study is to analyze the score data released by the Korea Institute of Curriculum and Evaluation to find out the problems with the current scoring system provided by the College Scholastic Ability Test and to suggest improvement measures to solve these problems. Methods: We calculated the descriptive statistics of the standard scores using the frequency distribution table of the standard scores and identified the characteristics of the standard scores by expressing the distribution as a graph. Also, we developed an index to evaluate whether each stanine level was stably assigned and calculated the indexes for each area/subject by using the data on the number of examinees for each level. Results: We found that the relationship of conversion from raw scores to integerized standard scores is different depending on the size of the standard deviation of the raw scores, and identified the problem that the raw score information is not fairly reflected in the calculation of the percentile and level as the two raw scores are converted to one standard score. This problem can be solved by calculating the standard score to a decimal point. Conclusion: In this study, as a way to improve the quality of the scores of the current CSAT, the standard score and percentile decimal notation, the specific regulations of the standard score and stanine level calculation method, and the expansion of the open range of the scores were suggested.