Journal of the Korean Society for information Management (정보관리학회지)

Korean Society for Information Management (한국정보관리학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Evaluation Methods of Research Institution: Based on the h-index and its Variants

기관단위 연구성과 평가방법에 관한 연구: h-지수 및 변형지수를 중심으로

  • 박지연 (이화여자대학교 문헌정보학과) ;
  • 김정은 (대외경제정책연구원 자료팀) ;
  • 민윤경 (포스코경영연구소 지식정보팀)
  • Published : 2010.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

The h-index is a new tool for measuring research outputs based on citation and many variants of h-index have been proposed to improve the weaknesses of h-index. The h-index and its variants can be applied to institutional evaluation in three different ways. We worked out 447 practical cases of professors from 10 business schools and examined h-index and its variants. And then we compared three evaluation methods of research institution based on the h-index and its variants.

h-지수는 개인의 연구성과를 측정하는 지표로 지수의 강건성과 계산의 용이성 등이 인정되면서 이를 보완하는 다양한 변형지수들이 연구되었으며, 이 지수들을 이용하여 연구자 개인의 영향력 평가는 물론, 저널, 학과, 대학, 연구소 등 기관단위 평가를 하려는 시도가 이루어지고 있다. h-지수를 이용한 기관단위의 평가 방법으로는 기관 h-지수, 평균 h-지수, 메타 h-지수 등 세 가지가 있으며, 본 연구에서는 국내 10개 경영대학을 대상으로 h-지수 및 변형지수들의 특징 및 상관관계를 살펴 본 후, 위의 세 가지 방법을 모두 적용하여 각 방법론을 비교 분석하였다.

Keywords

References

  1. 이재윤. 2006. 연구성과 측정을 위한 h-지수의 개량에 관한 연구. 한국정보관리학회지,23(3): 167-186.
  2. Arencibia-Jorge, R. et al. 2008. "Applying successive H indices in the institutional evaluation: A case study." Journal of the American Society for Information Science and Technology, 59(1): 155-157. https://doi.org/10.1002/asi.20729
  3. Arencibia-Jorge, R. and R. Rousseau. 2009. "Influence of individual researcher's visibility on institutional impact: an example of Prathap's approach to successive h-indices." Scientometrics, 79(3): 507-516. https://doi.org/10.1007/s11192-007-2025-0
  4. Batista, P.D., M. G. Campiteli, O. Kinouchi, and A.S. Martinez. 2005. "An index to quantify an individual's scientific research valid across discipline." cientometrics, 68(1): 179-189. https://doi.org/10.1007/s11192-006-0090-4
  5. Bornmann, L. and H. Daniel. 2007. "What do we know about the h index?" Journal of the American Society for Information Science and Technology, 58(9): 1381-1385. https://doi.org/10.1002/asi.20609
  6. Bornmann, L., R. Mutz, and H. Daniel. 2008. "Are there better indices for evaluation purposes than the h index? A Comparison of nine variants of the h index using data from biomedicine." Journal of the American Society for Information Science and Technology, 59(5): 830-837. https://doi.org/10.1002/asi.20806
  7. Bornmann, L., R. Mutz. & H. Daniel. 2009. "Do we need the h-index and its variants in addition to standard bibliometric measures?" Journal of the American Society for Information Science and Technology, 60(6): 1286-1289. https://doi.org/10.1002/asi.21016
  8. Braun, T., W. Glänzle, and A. Schubert. 2006. "A Hirsch-type index for journals." Scientometrics, 69(1): 169-173. https://doi.org/10.1007/s11192-006-0147-4
  9. Cronin, B. and L. Meho. 2006. "Using the h-index to rank influential information scientist." Journal of the American Society for Information Science and Technology, 57(9): 1275-1278. https://doi.org/10.1002/asi.20354
  10. Egghe, L. 2006. "An improvement of the h-index: the g-index." IISI Newsletter, 2(1): 8-9.
  11. Grant, J., J. Olden, Neson. C. Lawler, and B. Silliman. 2007. "Academic Institutions in the US and Canada ranked according to research productivity in the field of Conservation Biology." Conservation Biology, 21: 1139-1144. https://doi.org/10.1111/j.1523-1739.2007.00762.x
  12. Hirsch, J. E. 2005. "An index to quantify an individual's scientific research output." Proceedings of the National Academy of Sciences of the United States of America, 102: 16569-16572. [cited on . https://doi.org/10.1073/pnas.0507655102
  13. Jin, B. 2006. "h-index: an evaluation indicator proposed by scientist." Science Focus, 1(1): 8-9.(in Chinese).
  14. Jin, B., L. Liang, R. Rousseau, and L. Egghe. 2007. "The R- and AR-indices: complementing the h-index." Chinese Science Bulletin, 52(6): 855-863. [cited on 2010.2.16]. . https://doi.org/10.1007/s11434-007-0145-9
  15. Kosmulski, M. 2006. "A new Hirsch-type index saves time and works equally well as the original h-index." ISSI Newsletter, 2(3): 4-6. [cited 2010.2.19]. .
  16. Lazaridis, T. 2010. "Ranking university departments using the mean h-index." Scientometrics, 82(2): 211-216. https://doi.org/10.1007/s11192-009-0048-4
  17. Lehmann. S., A. D. Jackson, and B. Lautrup. 2006. "Measures and mismeasures of scientific quality." [cited on 2010.2.19]. .
  18. Luz, M. et. al. 2008. "Institutional h-index: The performance of a new metric in the evaluation of Brazilian Psychiatric Postgraduation Programs." Scientometrics, 77(2): 361-368. https://doi.org/10.1007/s11192-007-1964-9
  19. Molinari, A. and J-F. Molinari. 2008. "Mathematical aspects of new criterion for ranking scientific institutions based on the h-index." Scientometrics,75 (2): 339-356. https://doi.org/10.1007/s11192-007-1872-z
  20. Oppenheim, C. 2007. "Using the h-index to rank influential British Researchers in information science and librarianship." Journal of the American Society for Information Science and Technology, 58(2): 297-301. https://doi.org/10.1002/asi.20460
  21. Prathap, G. 2006. "Hirsch-type indices for ranking institutions' scientific research output." Current Science, 91(11): 1439.
  22. Ravichandra Rao, I.K. 2007. "Distributions of Hirsch-index and G-index: An empirical study." In D. Torres-Salinas & H.F. Moed(eds.), Proceedings of the 11th conference of the international society for scientometrics and informetrics(Vol.2, 655-658), Madrid, Spain : Spanish Research Council(CSIC).
  23. Ruane, F. and R. Tol. 2008. "Rational(succes sive) h-indices: an application to economics in the republic of Ireland."Scientometrics, 75(2): 395-405. https://doi.org/10.1007/s11192-007-1869-7
  24. Schubert, A. 2007. "Successive h-indices." Scientometrics, 70(1): 201-205. https://doi.org/10.1007/s11192-007-0112-x
  25. Schreiber, M. 2008. "An empirical investigation of the g-index for 26 physicists in comparison with the h-index, the A-index, and the R-index." Journal of the American Society for Information Science and Technology, 59(9): 1513-1522. https://doi.org/10.1002/asi.20856
  26. Schreiber, M. 2010. "Revisiting the g-index: the average number of citations in the g-Core." Journal of the American Society for Information Science and Technology, 61(1): 169-174. https://doi.org/10.1002/asi.21218
  27. Tol, Richard S. J. 2009. "The h-index and its alternatives: An application to the 100 most prolific economists." Scientometrics, 80(2): 317-324. https://doi.org/10.1007/s11192-008-2079-7
  28. Quoted in Rousseau, R. 2006. "New developments related to the Hirsch index." [cited on 2010.2.19]. .
  29. Quoted in Bornmann, L., Mutz, R. & Daniel, H. 2008. "Are there better indices for evaluation purposes than the h index? A Comparison of nine variants of the h index using data from biomedicine." Journal of the American Society for Information Science and Technology, 59(5): 830-837. https://doi.org/10.1002/asi.20806

Cited by

  1. Factors Influencing Research Collaboration in the Field of Informetrics vol.31, pp.4, 2014, https://doi.org/10.3743/KOSIM.2014.31.4.201