Journal of Korean Society of Industrial and Systems Engineering (산업경영시스템학회지)

Society of Korea Industrial and System Engineering (한국산업경영시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Open Innovation R&D Efficiency Evaluation by Integrated AHP-DEA

개방형 혁신에 의한 R&D 연구의 효율성 평가 분석 : 과학기술적 성과 관점에서 AHP-DEA방법론 적용

  • Min, Hyun-Ku (School of Business and Economics Graduate School, Hanyang University) ;
  • Kim, Tai-Young (School of Business and Economics, Hanyang University ERICA) ;
  • Hwang, Seung-June (School of Business and Economics, Hanyang University ERICA)
  • 민현구 (한양대학교 일반대학원 전략경영학과) ;
  • 김태영 (한양대학교 경상대학 경영학부) ;
  • 황승준 (한양대학교 경상대학 경영학부)
  • Received : 2012.11.05
  • Accepted : 2012.12.05
  • Published : 2012.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The current environment of technological and competitive changes influences not only the business R&D environment but also government driven national R&D strategies. Open innovation has now become an important paradigm that is replacing the outdated paradigm of closed innovation. Many companies and nations have been increasing R&D investment because R&D has been considered a driving force for national and corporate competitive advantage. The purpose of this paper is to evaluate and compare the performance of R&D focused on open innovation according to scientific and technological outputs which is based on paper publications, patents and etc. Comparisons should not be only based on the quantity but also on the quality of the output. This paper shows that it is possible to develop DEA models that utilize the Analytical Hierarchical Process in order to transform the qualitative index into a quantitative index. Hence, the relative efficiency for R&D organizations is obtained based on both quantity and quality outputs and subsequently provides comprehensive and realistic methods for decision makers to identify levels of project efficiency.

Keywords

References

  1. Bae, J.T. and Bong, S.H., Development of a performance index in private company R&D activity. Journal of Technology Innovation, 1998, Vol. 12, p 45-69.
  2. Banker, R.D., Chanes, A., and Cooper, W.W., Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 1984, Vol. 30, p 1078-1092. https://doi.org/10.1287/mnsc.30.9.1078
  3. Berchicci, L., Towards an open R&D system : Internal R&D investment, external knowledge acquisition and innovative performance. Research Policy, 2012, Vol. 42, p 117-127.
  4. Bitman, W.R. and Sarif, N., A Conceptual Framework for Ranking R&D Projects. Engineering Management, 2008, Vol. 55, p 267-278.
  5. Charnes, A., Cooper, W.W., and Rhodes, E. Measuring the efficiency of decision making units. European Journal of Operational Research, 1978, Vol. 3, p 429-444.
  6. Chesbrough, H.W., Open Innovation : the new imperative for creating and profiting from technology. Boston, Massachusetts, USA : Harvard Business school press; 2006.
  7. Cho, K.T., Cho, Y.K., and Kang, H.S., Analytic Hierarchy Decision Making of Proceeding Leaders, Seoul, Korea : Donghyun, 2003, p 9-12.
  8. Cho, Y.G. and Cho, K.T., Development of an evaluation model in public R&D programmes-conceptual approach. The korean Operations Research and Management Science Society, 2005, p 1045-1051.
  9. Choi, J.W., A study on the improvement of management outcomes in the start-up companies using AHP and DEA-Focusing on the tenant companies of business incubator center-. [dissertation]. [Seoul, Korea] : Ky.
  10. Choi, T.G., Strategic Design of the Government R&D Management System based on the Analysis of Relationship between R&D Program Types and their Outputs. [dissertation]. [Seoul, Korea] : Konkuk University; 2000.
  11. Ho, W., Integrated analytic hierarchy process and its applications-A literature review. European Journal of Operational Research, 2008, Vol. 186, p 211-228. https://doi.org/10.1016/j.ejor.2007.01.004
  12. Hsu, P.M. and Hsueh, C.C., Measuring realtive efficiency of government-sponsored R&D projects : A three- stage approach. Evaluation and Program Planning, 2009, Vol. 32, p 178-186. https://doi.org/10.1016/j.evalprogplan.2008.10.005
  13. Jang, H.D. and Lee, J.H., An efficient selection of promising technology using DEA and AHP. Korean Corporation Management Review, 2011, Vol. 6, p 67-85.
  14. Jyoti, Banwet D.K. and Deshmukh, S.G., Evaluating performance of national R&D organizations using integrated DEA-AHP technique. International Journal of Productivity and Performance Management, 2008, Vol. 57, p 370-386. https://doi.org/10.1108/17410400810881836
  15. Kim, B.W. and Oh, H.S., An effective R&D performance measurement system : survey of Korean R&D researchers. Omega, 2002, Vol. 30, p 19-31. https://doi.org/10.1016/S0305-0483(01)00049-4
  16. Kim, H.B., Yoon, J.H., Kim, J.S., and Kim, K.S., A Performance Indicator Roadmap Framework for evaluating Government R&D Programs. Proceeding of The Korean Institute of Industrial Engineers Spring Conference, 2009, p 1-9.
  17. Kim, M.S. and Jeong, H.J., Countstratgy Post catch-up in Mobile Phone industry. Korea Information Society Development Institute, 2010, Vol. 22, p 1-16.
  18. Kim, M.S., Internet shopping mall evaluation by AHP/ DEA. [dissertation] [Seoul, Korea] : Korea University, 2001.
  19. Kim, S.H., Jeong, B.H., and Kim, J.K., Analysis and Application of Decision making. 8th ed. Seoul, Korea : Youngchimunwhasa, 2009, p 379-401.
  20. Kim, Y.G., A Direction of Industrial Technology Policy for Open Innovation., Issue paper 2011-11. Seoul, Korea : KIAT, 2011.
  21. Lee, D.J., Bae, S.S., and Kang, J.S., Development of R&D project selection model and web-based R&D project selection system using hybrid DEA/AHP model. Journal of the Korean Institute of Industrial Engineers, 2006, Vol. 32.
  22. Lee, J.J. and Lee, K.C. The Role of Government and The Strategy of Post Catch-up Science and Technology. Proceedings of Korea Technology Innovation Society Conference, 2010, p 223-239.
  23. Lee, K.W., Kim, H.B., and Jang, I.H., Implication and Analysis of Application system and management of Pubic R&D Performance. Korea Institute of Science and Technology Evaluation and Planning, 2012, Vol. 2, p 3-7.
  24. Lin, M.I., Lee, Y.D., and Ho, T.N., Applying integrated DEA/AHP to evaluate the economic performance of local governments in China. European Journal of Operational Research, 2011, Vol. 209, p 129-140. https://doi.org/10.1016/j.ejor.2010.08.006
  25. Liu, J.S. and Lu, W.-M., DEA and ranking with the network-based approach : a case of R&D performance. Omega, 2010, Vol. 38, p 453-464. https://doi.org/10.1016/j.omega.2009.12.002
  26. Management Manual of R&D Performance in Ministry of Education, Science and Technology. Seoul, Korea : Ministry of Education, Science and Technology, National Research Foundation of Korea : 2009, p 50-51.
  27. Meng, W., Zhang, D., Qi, L., and Liu, W., Two-level DEA approaches in research evaluation. Omega, 2008, Vol. 36, p 950-957. https://doi.org/10.1016/j.omega.2007.12.005
  28. Park, S.J., Kim, K.H., and Jeong, S.K., The Study on the Analysis of Efficiency of Governmental R&D Programs Regarding to the S&T Outcomes. Journal of Korea Technology Innovation Society, 2010, Vol. 14, p 205-222.
  29. Park, S.M., Khoe, K.I., and Sul, W.S., A Study on Performance Evaluation of Government-Funded R&D Projects with Composite Scores : Focussing on 'Supporting Project on Application Technology Development. Korean Journal.
  30. Park, S.M., Analysis of Congruence Between DEA Efficiency Scores and Normalization Indices of R&D Projects, Korean Journal of Business Administration, 2011, Vol. 24, p 1999-2014.
  31. Park, S.M., Two-staged DEA/AR-I Performance Evaluation Model for R&D Projects Efficiency Correlation Analysis and Programs Positioning Investigation. Korean Journal of Business Administration, 2010, Vol. 23, p 3285.
  32. Rhim, H.S., Yoo, S.C., and Kim, Y.S., A DEA/AHP hybrid model for evaluation and selection of R&D projects. The korean Operations Research and Management Science Society, 1999, Vol. 24, p 1-12.
  33. Saaty, T.L., How to Make a Decision : The Analytic Hierarchy Process. European Journal of Operational Research, 1990, Vol. 48, p 9-26. https://doi.org/10.1016/0377-2217(90)90057-I
  34. Shang, J. and Sueyoshi, T., A Unified Framework for the Selection of a Flexible Manufacturing System. European Journal of Operational Research, 1995, Vol. 85, p 297-315. https://doi.org/10.1016/0377-2217(94)00041-A
  35. Sohn, S.Y., Yong, G.J., and Hong, K.H., Structural equation model for the evaluation of national funding on R&D project of SMEs in consideration with MBNQA criteria. Evaluation and Program Planning, 2007, Vol. 30, p 10-20. https://doi.org/10.1016/j.evalprogplan.2006.10.002
  36. Wang, E.C. and Huang, W., Relative efficiency of R&D activities : A cross-country study accounting for environmental factors in the DEA approach. Research Policy, 2007, Vol. 36, p 260-273. https://doi.org/10.1016/j.respol.2006.11.004
  37. Wang, Y.M., Liu, J., and Elhag, T.M.S., An integrated AHP-DEA methodology for bridge risk assessment. Computers and Industrial Engineering, 2009, Vol. 54, p 513-525.
  38. Yang, T. and Kuo, C., A hierarchical AHP/DEA methodology for the facilities layout design problem. European Journal of Operational Research, 2003, Vol. 147, p 128-136. https://doi.org/10.1016/S0377-2217(02)00251-5
  39. Yang, W.M., A study on the selection methodology of R&D projects using DEA/AHP with ordinal factors. [Master's thesis]. [Seoul, Korea] : Kyung Hee University, 2003.
  40. Yim, H., 2010 Technology Level Evaluation Report -95 Focued Science Technology-. 2011-031. Seoul, Korea : KISTEP, 2011.
  41. Yun, J.H., Kwon, O.J., Park, J.S., and Jeong, E.S., A Study on the Development and Adaption of Open Innovation Analysis Model. Journal of Korea Technology Innovation Society, 2010, Vol. 13, p 99-123.

Cited by

  1. DEA와 AHP를 이용한 대학의 성과 평가 vol.37, pp.3, 2014, https://doi.org/10.11627/jkise.2014.37.3.51
  2. 외부 R&D가 혁신 효율성에 미치는 영향 분석 : 국내 제조 산업을 중심으로 vol.39, pp.4, 2012, https://doi.org/10.11627/jkise.2016.39.4.125
  3. 기술이전 및 사업화 활성화를 위한 전략 도출 프레임워크 - R&BD 효율성 평가를 기반으로 - vol.44, pp.4, 2012, https://doi.org/10.7469/jksqm.2016.44.4.785
  4. 국방분야 품질정책 고도화를 위한 군수품 생산업체 품질경영수준 조사 및 분석 vol.40, pp.3, 2017, https://doi.org/10.11627/jkise.2017.40.3.018
  5. Tobit 모형을 활용한 개방형 R&D 효율성 영향요인 분석 vol.43, pp.3, 2012, https://doi.org/10.11627/jkise.2020.43.3.087