Journal of Korean Society for Quality Management (품질경영학회지)

Korean Society for Quality Management (한국품질경영학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Quality Improvement of College Scholastic Ability Test Scoring System

대학수학능력시험 점수산정시스템의 품질 제고를 위한 연구

  • Park, Youngsun (Division of Business Administration, Seokyeong University)
  • Received : 2022.04.27
  • Accepted : 2022.06.07
  • Published : 2022.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The purpose of this study is to analyze the score data released by the Korea Institute of Curriculum and Evaluation to find out the problems with the current scoring system provided by the College Scholastic Ability Test and to suggest improvement measures to solve these problems. Methods: We calculated the descriptive statistics of the standard scores using the frequency distribution table of the standard scores and identified the characteristics of the standard scores by expressing the distribution as a graph. Also, we developed an index to evaluate whether each stanine level was stably assigned and calculated the indexes for each area/subject by using the data on the number of examinees for each level. Results: We found that the relationship of conversion from raw scores to integerized standard scores is different depending on the size of the standard deviation of the raw scores, and identified the problem that the raw score information is not fairly reflected in the calculation of the percentile and level as the two raw scores are converted to one standard score. This problem can be solved by calculating the standard score to a decimal point. Conclusion: In this study, as a way to improve the quality of the scores of the current CSAT, the standard score and percentile decimal notation, the specific regulations of the standard score and stanine level calculation method, and the expansion of the open range of the scores were suggested.

Keywords

Acknowledgement

본 연구는 2020년 서경대학교 교내 학술연구비 지원으로 수행된 것임.

References

  1. Ban, J. -C. 2008. Issues in Reported Standard Score and Stanine Score of Collage Scholastic Ability Test in Korea. Journal of Educational Evaluation 21(1):127-147.
  2. Chang, S. 2021. Philosophical Justification and Direction of Essay Evaluation in College Scholastic Ability Test. Writing Research 51:117-151.
  3. Cho, J. and Pyun, J. 2022. A Study on the Implementation Plan for Public Service Quality Management Applying the ISO 18091 Framework. Journal of Korean Society for Quality Management 50(1):1-19. https://doi.org/10.7469/JKSQM.2022.50.1.1
  4. Hwang, H. 2005. A Study on an Alternative to the Standardized Scoring Systems in CSAT. The Korean Journal of Applied Statistics 18(5):521-532. https://doi.org/10.5351/KJAS.2005.18.3.521
  5. Jin, K. A., Song, M. Y., and Ban, J. C. 2010. Research on the Assessment System for Math and English Ability-Grouping Classes. The Journal of Curriculum & Evaluation 13(2):335-358. https://doi.org/10.29221/jce.2010.13.2.335
  6. Jongro Academy. 2021. http://b.jongro.co.kr/exam/ex211118/go3_cut.asp.
  7. KICE. 2004. A 20-Year History of College Scholastic Ability Test. Korea Institute for Curriculum and Evaluation.
  8. KICE. 2014. The Absolute Evaluation Test System and Scoring System for the Korean History Section of the 2017 CSAT. KICE Position Paper 6(5):1-22.
  9. KICE. 2015. The Absolute Evaluation Test System and Scoring System for the English Section of the 2018 CSAT. KICE Position Paper 7(4):1-18.
  10. KICE. 2019. CSAT Score Calculation Method According to the Introduction of Common + Elective Subjects. KICE Position Paper 11(5):1-20.
  11. KICE. 2021. https://www.suneung.re.kr/boardCnts/view.do?boardID=1500230&boardSeq=5074372&lev=0&m=0302&searchType=S&statusYN=W&page=1&s=suneung.
  12. Kim, S. H. 1998. The Scoring System of Optional Subtests of the College Scholastic Ability Test. Journal of Educational Evaluation 11(2):149-166.
  13. Kim, S. -Y. 1999. A Empirical Investigation on the Contribution of the Subscores of CSAT to the Total Test Scores. The Journal of Curriculum Studies 2(1):289-299.
  14. Kim, S. -Y., Koo, C. -H, Im, H., and Park, C. 1998. A Study on Reporting and Analyzing Scores of CSAT. KICE.
  15. KLD. 2022. https://www.ikld.kr/news/articleView.html?idxno=254832.
  16. KOSTAT. 2021. https://kostat.go.kr/portal/korea/kor_nw/1/1/index.board?bmode=read&aSeq=391575.
  17. Megastudy. 2021. https://www.megastudy.net/Entinfo/total_rankCut/main.asp.
  18. Nam, B. -W. 2002. 2005 Case Study for An Equating the Normalized Score in the National Entrance Examination. 2002 Proceedings of the Korean Operations and Management Science Society Conference 85-89.
  19. Nam, B. -W. 2011. A Linear Programming Model to the Score Adjustment among the CSAT Optional Subjects. Korean Management Science Review 28(1):141-158.
  20. Nam, H. -W. 2003. Applicability of Synthetic Group Methods to the Elective Subject Test Scores Linking in 2005 CSAT Inquiry Sections. Journal of Educational Evaluation 16(1):163-182.
  21. Nam, H. -W. 2004. Applicability of Modified Chained Equipercentile Linking Method to CSAT Elective Subject Tests. Journal of Educational Evaluation 17(2):93-105.
  22. Park, C. 2005. Assessing Item Response Theory Methods for Moderation of Elective Subject Test Scores in 2005 Korean CSAT Inquiry Sections. Korean Journal of Educational Research 43(2):135-154.
  23. Park, H. J., Kang, P., Jang, K. Y., Lee, Y., and Kim, W. J. 2015. Prediction of Correct Answer Rate and Identification of Significant Factors for CSAT English Test Based on Data Mining Techniques. KIPS Transactions on Software and Data Engineering 4(11):509-520. https://doi.org/10.3745/KTSDE.2015.4.11.509
  24. Park, S. H. and Kim, C. W. 1998. A Study on Standardization of Selected Subjects for College Entrance Examination. The 12th Asia Quality Management Symposium: Total Quality Management for Restoring Competitiveness 113-122.
  25. Park, S. H., Kim, C. W., and Park, J. O. 2000. A Study on a Standardized Scoring System of Selected Subjects for College Entrance Examination. Journal of Korean Society for Quality Management 28(3):124-132.
  26. Seo, H., Byun, J. -H., and Kim, D. 2021. Quality 4.0: Concept, Elements, Level Evaluation and Deployment Direction. Journal of Korean Society for Quality Management 49(4):447-466. https://doi.org/10.7469/JKSQM.2021.49.4.447
  27. Seong, Y., Lee, D., and Jang, U. 2022. Group-wise Keyword Extraction of the External Audit using Text Mining and Association Rules. Journal of Korean Society for Quality Management 50(1):77-89. https://doi.org/10.7469/JKSQM.2022.50.1.77
  28. Yang, J. H. 2012. Examining the Perceptions of Students, Parents, and Teachers about New 2014 College Scholastic Ability Test. Journal of Educational Evaluation 25(2):167-191.
  29. Yi, J. H. 2020. Two Different Views Towards University Entrance Examination: Selection or Evaluation of Educational Attainment? Journal of Korean Social Trend and Perspective 108:46-79.