DOI QR코드

DOI QR Code

University Ranking Model Considering the Statistical Characteristics of Indicators

평가지표의 통계적 특성을 고려한 대학순위 결정 모형

  • Park, Youngsun (Division of Business Administration, Seokyeong University)
  • Received : 2013.10.29
  • Accepted : 2013.11.28
  • Published : 2014.02.15

Abstract

University ranking models, though they consider multiple indicators to evaluate universities, determine the overall score of each university based on their own normalization and aggregation methods. Thus, the rankings provided by such models primarily depend on actual scores of evaluation indicators, but they are also significantly affected by the normalization and aggregation methods. We examine the normalization methods of four university ranking models used in South Korea, China, and United Kingdom. We discuss a possible unintended consequence of these methods, i.e., some universities who want to improve their rankings may focus on unnecessary indicators, contrary to the evaluator's intension, due to the normalization methods. We suggest a new normalization method based on the statistical characteristics of the distribution of each evaluation indicator so that the new method can motivate the universities to move into the desirable directions intended by the evaluator.

Keywords

References

  1. ARWU(Academic Ranking of World University) Methodology, http://www.shanghairanking.com/ARWU-Methodology-2013.html.
  2. Bae, J. H. (2013), Efficiency Comparison and Performance Targets for Academic Departments in the Local Private College Using DEA, Journal of the Korean Institute of Industrial Engineers, 39(4), 298-312. https://doi.org/10.7232/JKIIE.2013.39.4.298
  3. CUG(Complete University Guide), University League Table 2014, http://www.thecompleteuniversityguide.co.uk/league-tables/rankings.
  4. Decampo, D. (2012), Adjusted Sum of Institutional Scores as an Indicator of the Presence of University Systems in the ARWU Ranking, Scientometrics, 90(2), 701-713. https://doi.org/10.1007/s11192-011-0490-y
  5. Jeon, S. and Lee, C. (2011), Measure the Productivity of Airports in Korea Considering Environment Factor : An Application of DEA, Journal of the Korean Institute of Industrial Engineers, 37(4), 350-357. https://doi.org/10.7232/JKIIE.2011.37.4.350
  6. Joongang Ilbo Korean University Ranking, 2012 Handbook, http://univ.joongang.co.kr/customer/pds_view.asp?pg=1&ps=10&pb=10&sf=0&sw=&tf=&sm=&cf=0&sc=&ix=61&ht.
  7. Lee, Y. and Kim, J. Y. (2012), A Study on the Evaluation Methods of Selecting Universities Having Restricted Government Subsidy in 2013 Academic Year, Ministry of Education.
  8. Park, J., Bae, H., and Lim S. (2011), Multi-Criteria ABC Inventory Classification Using the Cross-Efficiency Method in DEA, Journal of the Korean Institute of Industrial Engineers, 37(4), 358-366. https://doi.org/10.7232/JKIIE.2011.37.4.358
  9. The World University Rankings Methodology, http://www.timeshighereducation.co.uk/world-university-rankings/2013-14/world-ranking/methodology.