Journal of Korean Institute of Industrial Engineers (대한산업공학회지)

Korean Institute of Industrial Engineers (대한산업공학회)
권호 표지
DOI QR코드

DOI QR Code

Performance Evaluation of Collaborative Research in Government Research Institutes

정부출연연구기관의 산학연 공동연구 성과 평가

  • Lee, Seonghee (Graduate School of Public Policy and Information Technology, Seoul National University of Science and Technology/Electronics and Telecommunications Research Institute) ;
  • Lee, Hakyeon (Department of Industrial and Systems Engineering, Seoul National University of Science and Technology)
  • 이성희 (서울과학기술대학교 IT정책전문대학원 / 한국전자통신연구원 SW-SoC융합R&BD센터) ;
  • 이학연 (서울과학기술대학교 글로벌융합산업공학과)
  • Received : 2016.10.28
  • Accepted : 2017.01.10
  • Published : 2017.06.15
Download PDF
⟨ Previous Next ⟩

Abstract

Research collaboration is regarded as core source to lead various innovations in all countries. This paper compares and analyzes the performance of Industry-University-Government Research Institutes (GRI) collaboration based on the four types of research collaborations; GRI-GRI, Industry-GRI, University-GRI and Industry-University-GRI. So this paper will show which collaboration type has the best work on each R&D step. We use four R&D steps; research, development, commercialization and overall. We also evaluate the performance of research collaboration of GRIs based on the collaboration types. In order to evaluate the performance of research collaboration, Data Envelopment Analysis (DEA) is employed for measuring the efficiency of GRIs in this paper. DEA is a non-parametric approach to measuring the relative efficiency of decision-making units (DMUs) with multiple inputs and outputs. The empirical results represent that the performance of collaboration with industry is generally superior to other collaboration types. These findings from this paper are expected to provide basic information for national collaboration strategy making.

Keywords

References

  1. Abramo, G., Cicero, T., and D'Angelo, C. A. (2011), A Field-Standardized Application of DEA to National-Scale Research Assessment of Universities, Journal of Informetrics, 5(4), 618-628. https://doi.org/10.1016/j.joi.2011.06.001
  2. Agasisti, T., Catalano, G., Landoni, P., and Verganti, R. (2012), Evaluating the Performance of Academic Departments : an Analysis of Research-Related Output Efficiency, Research Evaluation, 21(1), 2-14. https://doi.org/10.1093/reseval/rvr001
  3. Banker, R. D., Charnes, A., and Cooper, W. W. (1984), Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis, Management Science, 30(9), 1078-1092. https://doi.org/10.1287/mnsc.30.9.1078
  4. Bonaccorsi, A. and Daraio, C. (2003), A Robust Nonparametric Approach to the Analysis of Scientific Productivity, Research Evaluation, 12(1), 47-69. https://doi.org/10.3152/147154403781776726
  5. Calvert, J. and Patel, P. (2003), University-Industry Collaboration in the UK : Bibliometric Trends, Science and Public Policy, 30(2), 85-96. https://doi.org/10.3152/147154303781780597
  6. Charnes, A., Cooper, W. W., and Rhodes, E. (1978), Measuring the Efficiency of Decision Making Units, European Journal of Operational Research, 2(6), 429-444. https://doi.org/10.1016/0377-2217(78)90138-8
  7. Cooper, W. W., Seiford, L. M., and Tone, K. (2007), Data Envelopment Analysis : A Comprehensive Text with Models, Applications, References and DEA-Solver Software, Springer, Boston, MA.
  8. Dai, M., Wang, C., Hu, X.-R., and Xie, C. (2013), Efficiency Evaluation of Industry-University-Research Institute Collaboration : A Case Study of Suzhou, Industrial Engineering and Engineering Management, 1463-1470.
  9. Dhewanto, W. and Sohal, A. S. (2015), The Relationship between Organizational Orientation and Research and Development/Technology Commercialization Performance, R&D Management, 45(4), 339-360. https://doi.org/10.1111/radm.12073
  10. Guan, J. and Wang, J. (2004), Evaluation and Interpretation of Knowledge Production Efficiency, Scientometrics, 59(1), 131-155. https://doi.org/10.1023/B:SCIE.0000013303.25298.ae
  11. Hsu, F.-M. and Hsueh, C.-C. (2009), Measuring Relative Efficiency of Government-Sponsored R&D Projects : A Three-Stage Approach, Evaluation and Program Planning, 32(2), 178-186. https://doi.org/10.1016/j.evalprogplan.2008.10.005
  12. Jeon, I. and Lee, H. (2015), Performance Evaluation of R&D Commercialization : A DEA-Based Three-Stage Model of R&BD Performance, Journal of the Korean Institute of Industrial Engineers, 41(5), 425-438. https://doi.org/10.7232/JKIIE.2015.41.5.425
  13. Johnes, J. and Johnes, G. (1995), Research Funding and Performance in UK University Departments of Economics : A Frontier Analysis, Economics of Education Review, 14(3), 301-314. https://doi.org/10.1016/0272-7757(95)00008-8
  14. KISTEP (2009), 2009 National Research and Development Business Performance Analysis Report.
  15. Kocher, M., Luptacik, M., and Sutter, M. (2006), Measuring Productivity of Research in Economics : A Cross-Country Study Using DEA, Socio-Economic Planning Sciences, 40(4), 314-332. https://doi.org/10.1016/j.seps.2005.04.001
  16. Lee, D., Seo, I., Choe, H., and Kim, H. (2012), Collaboration Network Patterns and Research Performance : The Case of Korean Public Research Institutions, Scientometrics, 91(3), 925-942. https://doi.org/10.1007/s11192-011-0602-8
  17. Lee, H., Park, Y., and Choi, H. (2009), Comparative Evaluation of Performance of National R&D Programs with Heterogeneous Objectives : A DEA Approach, European Journal of Operational Research, 196(3), 847-855. https://doi.org/10.1016/j.ejor.2008.06.016
  18. Lee, H. and Shin, J. (2014), Measuring Journal Performance for Multidisciplinary Research : An Efficiency Perspective, Journal of Informetrics, 8(1), 77-88. https://doi.org/10.1016/j.joi.2013.10.004
  19. Lee, H. Y. and Park, Y. T. (2005), An International Comparison of R&D Efficiency : DEA Approach, Asian Journal of Technology Innovation, 13(2), 207-222. https://doi.org/10.1080/19761597.2005.9668614
  20. Lee, S. H., Kim, T. S., and Lee, H. Y. (2015), Measuring the Dynamic Efficiency of Government Research Institutes in R&D and Commercialization by DEA Window Analysis, Journal of the Korean Operation Research and Management Science Society, 32(4), 192-207.
  21. Lee, S. and Lee, H. (2015), Measuring and Comparing the R&D Performance of Government Research Institutes : A Bottom-Up Data Envelopment Analysis Approach, Journal of Informetrics, 9(4), 942-953. https://doi.org/10.1016/j.joi.2015.10.001
  22. Liu, J. S. and Lu, W.-M. (2010), DEA and Ranking with The Network-Based Approach : A Case of R&D Performance, Omega, 38(6), 453-464. https://doi.org/10.1016/j.omega.2009.12.002
  23. Luwel, M., Noyons, E. C. M., and Moed, H. F. (1999), Bibliometric Assessment of Research Performance in Flanders : Policy Background and Implication, R&D Measurement, 29(2), 133-142.
  24. Meng, W., Zhang, D., Qi, L., and Liu, W. (2008), Two-Level DEA Approaches in Research Evaluation, Omega, 36(6), 950-957. https://doi.org/10.1016/j.omega.2007.12.005
  25. Ministry of Education, Science and Technology (2011), Research Situation Analysis of GRIs.
  26. Nam, I. S., Song, Y. Y., and Jeong, B. H. (2008), Analysis of Relative Efficiency of Government Funded Research Institutes Using DEA model, Journal of the Society of Korea Industrial and Systems Engineering, 31(1), 1-10.
  27. Narin, F. and Hamilton, K. S. (1996), Bibliometric Performance Measures, Scientometrics, 36(3), 293-310. https://doi.org/10.1007/BF02129596
  28. NSTC (2009), National R&D Performance Analysis and Implications.
  29. Ortega, J. L., Lopez-Romero, E., and Fernandez, I. (2011), Multivariate Approach to Classify Research Institutes According to Their Outputs : The Case of The CSIC's Institutes, Journal of Informetrics, 5 (3), 323-332. https://doi.org/10.1016/j.joi.2011.01.004
  30. Park, S. M. (2014), Identification of DEA Determinant Input-Output Variables : An Illustration for Evaluating The Efficiency of Government-Sponsored R&D Projects, Journal of the Korean Institute of Industrial Engineers, 40(1), 84-99. https://doi.org/10.7232/JKIIE.2014.40.1.084
  31. Revilla, E., Sarkis, J., and Modrego, A. (2003), Evaluating Performance of Public-Private Research Collaborations : A DEA Analysis, Journal of the Operational Research Society, 54(2), 165-174. https://doi.org/10.1057/palgrave.jors.2601524
  32. Rousseau, S. and Rousseau, R. (1997), Data Envelopment Analysis as A Tool for Constructing Scientometric Indicators, Scientometric, 40 (1), 45-56. https://doi.org/10.1007/BF02459261
  33. Rousseau, S. and Rousseau, R. (1998), The Scientific Wealth of European Nations : Taking Effectiveness into Account, Scientometric, 42 (1), 75-87. https://doi.org/10.1007/BF02465013
  34. Sharma, S. and Thomas, V. (2008), Inter-Country R&D Efficiency Analysis : An Application of Data Envelopment Analysis, Scientometric, 76(3), 483-501. https://doi.org/10.1007/s11192-007-1896-4
  35. STEPI (2013), Technology Commercialization Activation of Universities and GRIs.
  36. Sylvan, K. J. and Martin, B. R. (1997), What is Research Collaboration? Research Policy, 26(1), 1-18. https://doi.org/10.1016/S0048-7333(96)00917-1
  37. Wang, E. C. and Huang, W. (2007), Relative Efficiency of R&D Activities : A Cross-Country Study Accounting for Environmental Factors in The DEA Approach, Research Policy, 36(2), 260-273. https://doi.org/10.1016/j.respol.2006.11.004
  38. Yim, D. S. and Kim, W. D. (2005), The Evolutionary Responses of Korean Government Research Institutes in A Changing National Innovation System, Science Technology and Society, 10(1), 31-55. https://doi.org/10.1177/097172180401000103
  39. Yuezhi G. and Xia, F. (2010), The Innovation Efficiency of Industry-University-Research Cooperation Based on DEA, Information Management, Innovation Management and Industrial Engineering, 3, 345-348.