Korean Management Science Review (경영과학)

The Korean Operations Research and Management Science Society (한국경영과학회)
권호 표지
DOI QR코드

DOI QR Code

Performance Evaluation of Private R&D Projects using BSC/DEA

BSC/DEA를 활용한 기업 연구개발 프로젝트 성과평가

  • Jeon, IkJin (Graduate School of Public Policy and Information Technology, Seoul National University of Science and Technology) ;
  • Lee, Hakyeon (Department of Industrial and Systems Engineering, Seoul National University of Science and Technology)
  • 전익진 (서울과학기술대학교 IT정책전문대학원) ;
  • 이학연 (서울과학기술대학교 글로벌융합산업공학과)
  • Received : 2017.03.06
  • Accepted : 2017.05.16
  • Published : 2017.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a R&D project performance measurement model for private firms combining balanced scorecard (BSC) and data envelopment analysis (DEA). The efficiency of R&D projects is measured in terms of each of the three perspectives of BSC by using DEA : the internal process perspective (DEA-P), the customer perspective (DEA-C), and the financial perspective (DEA-F). The performance indicators of the three perspectives of BSC are considered as outputs of the corresponding DEA models. To provide strategic implications for R&D planning, we also propose the R&D project performance matrices composed of two different types of efficiency dimensions. The proposed model is expected to be fruitfully utilized for R&D performance measurement of private firms.

Keywords

References

  1. 김현정, "공공기관의 유형별 효율성평가와 비 효율성 원인의 규명에 관한 연구", 한국경영과학회지, 제40권, 제1호(2015), pp.75-89. https://doi.org/10.7737/JKORMS.2015.40.1.075
  2. 이성희, 김태수, 이학연, "DEA 윈도우 분석을 이용한 정부출연연구기관의 연구개발 사업화 동태적 효율성 분석", 경영과학, 제32권, 제4호(2015), pp.193-207. https://doi.org/10.7737/KMSR.2015.32.4.193
  3. 전 훈, 이학연, "DEA 윈도우 분석을 이용한 국내 온라인 게임 기업의 운영 효율성 평가", 한국경영과학회지, 제39권, 제3호(2014), pp.23-40. https://doi.org/10.7737/JKORMS.2014.39.3.023
  4. Amado, C.A., S.P. Santos, and P.M. Marques, "Integrating the Data Envelopment Analysis and the Balanced Scorecard approaches for enhanced performance assessment," Omega, Vol.40, No.3(2012), pp.390-403. https://doi.org/10.1016/j.omega.2011.06.006
  5. Andersen, P. and N.C. Petersen, "A procedure for ranking efficient units in data envelopment analysis," Management Science, Vol.39, No.10 (1993), pp.1261-1264. https://doi.org/10.1287/mnsc.39.10.1261
  6. Banker, R.D., H. Chang, S.N. Janakiraman, and C. Konstans, "A balanced scorecard analysis of performance metrics," European Journal of Operational Research, Vol.154, No.2(2004), pp. 423-436. https://doi.org/10.1016/S0377-2217(03)00179-6
  7. Bremser, W.G. and N.P. Barsky, "Utilizing the balanced scorecard for R&D performance measurement," R&D Management, Vol.34, No.3 (2004), pp.229-238. https://doi.org/10.1111/j.1467-9310.2004.00335.x
  8. Chen, T.Y. and L.H. Chen, "DEA performance evaluation based on BSC indicators incorporated: The case of semiconductor industry," International Journal of Productivity and Performance management, Vol.56, No.4(2007), pp. 335-357. https://doi.org/10.1108/17410400710745333
  9. Chen, T.Y., C.B. Chen, and S.Y. Peng, "Firm operation performance analysis using data envelopment analysis and balanced scorecard : A case study of a credit cooperative bank," International Journal of Productivity and Performance Management, Vol.57, No.7(2008), pp. 523-539. https://doi.org/10.1108/17410400810904010
  10. Chun, H. and H. Lee, "A DEA-Based Portfolio Model for Performance Management of Online Games," Journal of the Korean Institute of Industrial Engineers, Vol.39, No.4(2013), pp.260-270. https://doi.org/10.7232/JKIIE.2013.39.4.260
  11. Chiang, C.Y. and B. Lin, "An integration of balanced scorecards and data envelopment analysis for firm's benchmarking management," Total Quality Management, Vol.20 No.11(2009), pp.1153-1172. https://doi.org/10.1080/14783360903248286
  12. Co, H.C. and K.S. Chew, "Performance and R&D expenditures in American and Japanese manufacturing firms," International Journal of Production Research, Vol.35, No.12(1997), pp. 3333-3348. https://doi.org/10.1080/002075497194101
  13. Cooper, W.W., L.M. Seiford, and K. Tone, Data Envelopment Analysis : Theory, Methodology, and Applications, References and DEA-Solver Software, Kluwer Academic, Boston, 2000.
  14. Cooper, W.W., L.M. Seiford, and K. Tone, Data envelopment analysis : A comprehensive text with models, applications, references and DEA-Solver Software, Second editions, 490, Springer, 2007.
  15. Dyson, R.G., R. Allen, A.S. Camanho, V.V. Podinovski, C.S. Sarrico, and E.A. Shale, "Pitfalls and protocols in DEA," European Journal of Operational Research, Vol.132, No.2(2001), pp.245-259. https://doi.org/10.1016/S0377-2217(00)00149-1
  16. Eilat, H., B. Golany, and A. Shtub, "Constructing and evaluating balanced portfolios of R&D projects with interactions : A DEA based methodology," European Journal of Operational Research, Vol.172, No.3(2006), pp.1018-1039. https://doi.org/10.1016/j.ejor.2004.12.001
  17. Eilat, H., B. Golany, and A. Shtub, "R&D project evaluation : An integrated DEA and balanced scorecard approach," Omega, Vol.36, No.5(2008), pp.895-912. https://doi.org/10.1016/j.omega.2006.05.002
  18. Garcia-Valderrama, T., E. Mulero-Mendigorri, and D. Revuelta-Bordoy, "Relating the perspectives of the balanced scorecard for R&D by means of DEA," European Journal of Operational Research, Vol.196, No.3(2009), pp.1177-1189. https://doi.org/10.1016/j.ejor.2008.05.015
  19. Ittner, C.D. and D.F. Larcker, "Are nonfinancial measures leading indicators of financial performance? An analysis of customer satisfaction," Journal of Accounting Research, Vol.36(1998), pp.1-35.
  20. Jeon, I.J. and H.Y. Lee, "Performance evaluation of R&D commercialization : A DEA-based three-stage model of R&BD performance," Journal of the Korean Institute of Industrial Engineers, Vol.41, No.5(2015), pp.425-438. https://doi.org/10.7232/JKIIE.2015.41.5.425
  21. Kaplan, R.S. and D.P. Norton, "Putting the balanced scorecard to work," Harvard Business Review, Vol.71, No.5(1993), pp.134-142.
  22. Kaplan, R.S. and D.P. Norton, Using the balanced scorecard as a strategic management system, 1996.
  23. Kaplan, R.S. and D.P. Norton, The Strategy-Focused Organisation, Harvard Business School Press, Boston, 2001.
  24. Kerssens-van Drongelen, I.C. and A. Cook, "Design principles for the development of measurement systems for research and development processes," R&D Management, Vol. 27, No.4(1997), pp.345-359. https://doi.org/10.1111/1467-9310.00070
  25. Kerssens-van Drongelen, I.C. and J. Bilderbeek, "R&D performance measurement : more than choosing a set of metrics," R&D Management, Vol.29, No.1(1999), pp.35-46. https://doi.org/10.1111/1467-9310.00115
  26. Kim, H.J. and J.W. Park, "An Empirical Study on the Effect of CRM System on the Performance of Pharmaceutical Companies," Journal of Inteligent Information System, Vol.16, No.4(2010), pp.43-65.
  27. Kwon I.S., S.M. Park, and W.S. Sul, "R&D Investment and Efficiency of the Manufacturing Industry : Focused on the Application of Two-staged DEA Model," Korean Society of Management Consulting, Vol.13, No.3(2013), pp.155-174.
  28. Lee, H., Y. Park, and H. Choi, "Comparative evaluation of performance of national R&D programs with heterogeneous objectives : A DEA approach," European Journal of Operational Research, Vol.196, No.3(2009), pp.847-855. https://doi.org/10.1016/j.ejor.2008.06.016
  29. Lee S.W. and J.Y. Shin, "Knowledge Assets and Value Creation through BSC-Evidences from BSC Introduction of Korean Listing Large Firms," Korean Management Review, Vol.35, No.2(2006), pp.579-607.
  30. Li, G. and D. Dalton, "Balanced scorecard for I+D," Pharmaceutical Executive, Vol.23, No.10(2003), pp.84-90.
  31. Linton, J.D., J. Morabito, and J.S. Yeomans, "An extension to a DEA support system used for assessing R&D projects," R&D Management, Vol.37, No.1(2007), pp.29-36.
  32. Linton, J.D., S.T. Walsh, and J. Morabito, "Analysis, ranking and selection of R&D projects in a portfolio," R&D Management, Vol.32, No.2 (2002), pp.139-148. https://doi.org/10.1111/1467-9310.00246
  33. Macedo, M.A., A.C. Barbosa, and G.T. Cavalcante, "Performance of bank branches in Brazil : applying data envelopment analysis (DEA) to indicators related to the BSC perspectives," E&G-Revista Economia e Gestao, Vol.19, No.19(2009), pp.65-84.
  34. Min, H., H. Min, and S.J. Joo, "A data envelopment analysis-based balanced scorecard for measuring the comparative efficiency of Korean luxury hotels," International Journal of Quality & Reliability Management, Vol.25, No.4(2008), pp.349-365. https://doi.org/10.1108/02656710810865249
  35. Neufeld, G.A., P.A. Simeoni, and M.A. Taylor, "High-performance research organizations," Research Technology Management, Vol.44, No.6(2001), pp.42-52.
  36. Oh, J.S. and J.S. Yang, "A Case Study of Implementation of a BSC Performance Evaluation System in Manufacturing Industry based on Product Data Management," Journal of the Korean Institute of Industrial Engineers, Vol. 23, No.4(2010), pp.275-285.
  37. Park, J.H., H.R. Bae, and S.M. Lim, "Method of Benchmarking Route Choice Based on the Input-similarity Using DEA and SOM," Journal of the Korean Institute of Industrial Engineers, Vol.36, No.1(2010), pp.32-41.
  38. Portela, M.S., E. Thanassoulis, and G. Simpson, "Negative data in DEA : A directional distance approach applied to bank branches," Journal of the Operational Research Society, Vol.55, No.10(2004), pp.1111-1121. https://doi.org/10.1057/palgrave.jors.2601768
  39. Rickards, R.C., "Setting benchmarks and evaluating balanced scorecards with data envelopment analysis," Benchmarking : An International Journal, Vol.10, No.3(2003), pp.226-245. https://doi.org/10.1108/14635770310477762
  40. Rouse, P., M. Putterill, and D. Ryan, "Integrated performance measurement design : insights from an application in aircraft maintenance," Management Accounting Research, Vol.13, No.2(2002), pp.229-248. https://doi.org/10.1006/mare.2002.0180
  41. Scheel, H., "Undesirable outputs in efficiency valuations," European Journal of Operational Research, Vol.132, No.2(2001), pp.400-410. https://doi.org/10.1016/S0377-2217(00)00160-0
  42. Thompson, R.G., L.N. Langemeier, C.T. Lee, E. Lee, and R.M. Thrall, "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Vol.46, No.1(1990), pp.93-108. https://doi.org/10.1016/0304-4076(90)90049-Y
  43. Wang, E.C. and W. Huang, "Relative efficiency of R&D activities : A cross-country study accounting for environmental factors in the DEA approach," Research Policy, Vol.36, No.2(2007), pp.260-273. https://doi.org/10.1016/j.respol.2006.11.004