STI Policy Review

Science & Technology Policy Institute (과학기술정책연구원)
권호 표지
DOI QR코드

DOI QR Code

Assessing the R&D Effectiveness and Business Performance: A Review of Their Mechanisms and Metrics

  • Cho, Yonghee (Department of Engineering and Technology Management, Portland State University)
  • Published : 2018.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

With the constant growth of R&D investment, it has been increasingly necessary to evaluate the effectiveness of R&D performance and there is a high emphasis on ensuring the accountability and effectiveness of R&D programs. The evaluation of performance of a firm is especially necessary in times of economic downturn to justify R&D investment. However, there is a marked shortage of clear guidelines as to where and how particular metrics are used to measure the output and outcome of R&D activity in firms. Many firms have difficulties in selecting appropriate indicators for their R&D and financial performances. To fill this gap, this article discusses and presents the findings from the literature in such a way that they become useful for researchers or managers who are in charge of measuring the R&D and business performances arising from innovation activities. Finally, based on the findings about metrics of R&D performance, this article proposes the hypothetical framework to investigate the relationship between technology forecasting, strategic technology planning, and business performance. The framework of this article will assist policy makers, universities, research institutes/national laboratories, and companies to enhance their decision making process in technology development.

Keywords

JCOGDN_2018_v9n1_1_f0001.png 이미지

FIGURE 1. The R&D Performance as a System

JCOGDN_2018_v9n1_1_f0001.png 이미지

FIGURE 1. The R&D Performance as a System

JCOGDN_2018_v9n1_1_f0002.png 이미지

FIGURE 2. The Overview of Technology to Business Management

JCOGDN_2018_v9n1_1_f0002.png 이미지

FIGURE 2. The Overview of Technology to Business Management

TABLE 1. The Summary of Output Indicators from the Literature

JCOGDN_2018_v9n1_1_t0001.png 이미지

TABLE 1. The Summary of Output Indicators from the Literature

JCOGDN_2018_v9n1_1_t0001.png 이미지

TABLE 2. The Summary of Outcome Indicators from the Literature

JCOGDN_2018_v9n1_1_t0002.png 이미지

TABLE 2. The Summary of Outcome Indicators from the Literature

JCOGDN_2018_v9n1_1_t0002.png 이미지

References

  1. Abernathy, W. J., & Utterback, J. M. (1978). Patterns of industrial innovation. Technology Review, 80(7), 41-47.
  2. Afuah, A. N., & Utterback, J. M. (1997). Responding to structural industry changes: a technological evolution perspective. Industrial and Corporate Change, 6(1), 183-202. https://doi.org/10.1093/icc/6.1.183
  3. Ahituv, N., Zif, J., & Machlin, I. (1998). Environmental scanning and information systems in relation to success in introducing new products. Information & Management, 33, 201-211. https://doi.org/10.1016/S0378-7206(98)00025-1
  4. Albert, M. B., Avery, D., Narin, F., & McAllister, P. (1991). Direct validation of citation counts as indicators of industrially important patents. Research Policy, 20(3), 251-259. https://doi.org/10.1016/0048-7333(91)90055-U
  5. American Chemical Society. (1995). The first nylon plant. Office of Public Outreach. Delaware.
  6. Anderson, C. R., & Paine, F. T. (1978). PIMS: a reexamination. The Academy of Management Review, 3(3), 602-612. https://doi.org/10.5465/amr.1978.4305787
  7. Andrews, K. R. (1971). The Concept of Corporate Strategy. Homewood, Ill.: Dow Jones-Irwin.
  8. Archibugi, D. (1992). Patenting as an indicator of technological innovation: a review. Science and Public Policy.
  9. Armstrong, J. S. (1982). The value of formal planning for strategic decisions: review of empirical research. Strategic Management Journal, 3(3), 197-211. https://doi.org/10.1002/smj.4250030303
  10. Artz, K. W., Norman, P. M., Hatfield, D. E., & Cardinal, L. B. (2010). A longitudinal study of the impact of R&D, patents, and product innovation on firm performance. Journal of Product Innovation Management, 27(5), 725-740. https://doi.org/10.1111/j.1540-5885.2010.00747.x
  11. Arundel, A., & Kabla, I. (1998). What percentage of innovations are patented? Empirical estimates for European firms. Research Policy, 27(2), 127-141. https://doi.org/10.1016/S0048-7333(98)00033-X
  12. Autio, E., & Laamanen, T. (1995). Measurement and evaluation of technology transfer: review of technology transfer mechanisms and indicators. International Journal of Technology Mangement, 10(7/8), 643-664.
  13. Azzone, G., & Maccarrone, P. (1997). The emerging role of lean infrastructures in technology transfer: The case of the Innovation Plaza project. Technovation, 17(7), 391-402. https://doi.org/10.1016/S0166-4972(96)00119-8
  14. Baker, G. A. (2003). Strategic planning and financial performance in the food processing sector. Review of Agricultural Economics, 25(2), 470-482. https://doi.org/10.1111/1467-9353.00150
  15. Baker, N. R., Green, S. G., & Bean, A. S. (1986). Why R&D projects succeed or fail. Research Management, 29(6).
  16. Baker, N. R., Siegman, J., & Rubenstein, A. H. (1967). The effects of perceived needs and means on the generation of ideas for industrial research and development projects. IEEE Transactions on Engineering Management, 14(4), 156-164. https://doi.org/10.1109/TEM.1967.6446983
  17. Balas, E. A., & Elkin, P. L. (2013). Technology transfer from biomedical research to clinical practice: measuring innovation performance. Evaluation & the Health Professions, 36(4), 505-517. https://doi.org/10.1177/0163278713508135
  18. Barney, J. B. (1986). Strategic factor markets: Expectations, luck, and business strategy. Management Science, 32(10), 1231-1241. https://doi.org/10.1287/mnsc.32.10.1231
  19. Barney, J. B. (1991). Firm resources and sustained competitive advantage. Journal of Management, 17(1), 99-120. https://doi.org/10.1177/014920639101700108
  20. Barney, J. B. (2001). Resource-based theories of competitive advantage: a ten-year retrospective on the resource-based view. Journal of Management, 27(6), 643-650. https://doi.org/10.1016/S0149-2063(01)00115-5
  21. Barras, R. (1986). Towards a theory of innovation in services. Research Policy, 15(4), 161-173. https://doi.org/10.1016/0048-7333(86)90012-0
  22. Bayona-Saez, C., & Garcia-Marco, T. (2010). Assessing the effectiveness of the Eureka Program. Research Policy, 39(10), 1375-1386. https://doi.org/10.1016/j.respol.2010.07.007
  23. Beat, R. M. (2000). Competing Effectively : Environmental Scanning , Competitive Strategy , and Organizational Performance in Small Manufacturing Eirms. Journal of Small Business Management, 38(1), 27.
  24. Betz, F. (2003). Managing Technological Innovation: Competitive Advantage from Change (2nd ed.). New Jersey: John Wiley & Sons, Inc.
  25. Boler, E. A., Moxnes, A., & Ulltveit-Moe, K. H. (2015). R&D, international sourcing, and the joint impact on firm performance. American Economic Review, 105(12), 3704-3739. https://doi.org/10.1257/aer.20121530
  26. Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & MacKenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: a meta-analysis. Personnel Psychology, 48(3), 587-605. https://doi.org/10.1111/j.1744-6570.1995.tb01772.x
  27. Boulding, W., & Staelin, R. (1995). Identifying generalizable effects of strategic actions on firm performance: the case of demand-side returns to R&D spending. Marketing Science, 14(3 Supplement), G222-G236. https://doi.org/10.1287/mksc.14.3.G222
  28. Bound, J., Cummins, C., Griliches, Z., Hall, B. H., & Jaffe, A. B. (1982). Who does R&D and who patents? NBER Working Papar Series.
  29. Bourgeois, L. J. (1980). Performance and consensus. Strategic Management Journal, 1(3), 227-248. https://doi.org/10.1002/smj.4250010304
  30. Bozeman, B., & Melkers, J. (1993). Evaluating R&D Impacts: Methods and Practice. (B. Bozeman & J. Melkers, Eds.). Kluewer Academic Publishers.
  31. Bracker, J. S., & Pearson, J. N. (1986). Planning and financial performance of small, mature firms. Strategic Management Journal, 7(6), 503-522. https://doi.org/10.1002/smj.4250070603
  32. Branch, B. (1974). Research and development activity and profitability: a distributed lag analysis. Journal of Political Economy, 82(5), 999-1011. https://doi.org/10.1086/260252
  33. Bremser, W. G., & Barsky, N. P. (2004). Utilizing the balanced scorecard for R&D performance measurement. R&D Management, 34(3), 229-238. https://doi.org/10.1111/j.1467-9310.2004.00335.x
  34. Brenner, M. S., & Rushton, B. M. (1989). Sales growth and R&D in the chemical industry. Research Technology Management, 32(2), 8-15. https://doi.org/10.1080/08956308.1989.11670580
  35. Brinckmann, J., Grichnik, D., & Kapsa, D. (2010). Should entrepreneurs plan or just storm the castle? A meta-analysis on contextual factors impacting the business planning-performance relationship in small firms. Journal of Business Venturing, 25(1), 24-40. https://doi.org/10.1016/j.jbusvent.2008.10.007
  36. Brown, M. G., & Svenson, R. A. (1998). Measuring R&D productivity. Research Technology Management, 41(6), 30-35. https://doi.org/10.1080/08956308.1998.11671246
  37. Brown, W. B., & Gobeli, D. (1992). Observations on the measurement of R&D productivity: a case study. Engineering Management, IEEE Transactions On, 39(4), 325-331. https://doi.org/10.1109/17.165414
  38. Buzzell, R. D., Gale, B. T., & Sultan, R. G. (1975). Market share: key to profitability? Harvard Business Review, 53(1), 97-106.
  39. Capon, N., Farley, J. U., & Hoenig, S. (1990). Determinants of financial performance: a meta-analysis. Management Science, 36(10), 1143-1159. https://doi.org/10.1287/mnsc.36.10.1143
  40. Cardinal, L. B., & Hatfield, D. E. (2000). Internal knowledge generation: The research laboratory and innovative productivity in the pharmaceutical industry. Journal of Engineering and Technology Management, 17(3), 247-271. https://doi.org/10.1016/S0923-4748(00)00025-4
  41. Carpenter, M. P., Cooper, M., & Narin, F. (1980). Linkage between basic research literature and patents. Research Management, 23(2), 30-35.
  42. Chakrabarti, A. K. (1991). Competition in high technology: analysis of patents of US, Japan, UK, France, West Germany, and Canada. IEEE Transactions on Engineering Management, 38(1), 78-84. https://doi.org/10.1109/17.65763
  43. Chiesa, V., Frattini, F., Lazzarotti, V., & Manzini, R. (2009). Performance measurement in R&D: Exploring the interplay between measurement objectives, dimensions of performance and contextual factors. R&D Management, 39(5), 488-519.
  44. Cho, H.-J., & Pucik, V. (2005). Relationship between innovativeness, quality, growth, profitability, and market value. Strategic Management Journal, 26(6), 555-575. https://doi.org/10.1002/smj.461
  45. Choudhury, V., & Sampler, J. L. (1997). Information specificity and environmental scanning: An economic perspective. MIS Quarterly, 21(1), 25-53. https://doi.org/10.2307/249741
  46. Christmann, P. (2007). IT Assets, Organizational Capabilities, and Firm Performance: How Resource Allocations and Organizational Differences Explain Performance Variation. Organization Science, 18(5), 763-780. https://doi.org/10.1287/orsc.1070.0306
  47. Chun, D., Chung, Y., & Bang, S. (2015). Impact of firm size and industry type on R&D efficiency throughout innovation and commercialisation stages: evidence from Korean manufacturing firms. Technology Analysis and Strategic Management, 27(8), 895-909. https://doi.org/10.1080/09537325.2015.1024645
  48. Coccia, M. (2001). A basic model for evaluating R&D performance: theory and application in Italy. R&D Management, 31(4), 453-464. https://doi.org/10.1111/1467-9310.00231
  49. Comanor, W. S., & Scherer, F. M. (1969). Patent statistics as a measure of technical change. Journal of Political Economy, 77(3), 392-398. https://doi.org/10.1086/259522
  50. Coombs, R., Narandren, P., & Richards, A. (1996). A literature-based innovation output indicator. Research Policy, 25, 403-413. https://doi.org/10.1016/0048-7333(95)00842-X
  51. Cooper, R. G. (1986). New product performance and product innovation strategies. Research Management, 29(3), 17-25.
  52. Damanpour, F., & Gopalakrishnan, S. (2001). The dynamics of the adoption of product and process innovations in organizations. Journal of Management Studies, 38(1), 45-65. https://doi.org/10.1111/1467-6486.00227
  53. Davenport, T. H. (1993). Process Innovation: Reengineering Work Through Technology. Boston, MA: Harvard Business School Press.
  54. Deshpande, R., Farley, J. U., & Webster, F. E. (1993). Corporate culture, customer orientation, and innovativeness in Japanese firms: a quadrad analysis. Journal of Marketing, 57(1), 23-37. https://doi.org/10.1177/002224299305700102
  55. Dess, G. G., & Robinson, R. B. (1984). Measuring organizational performance in the absence of objective measures: the case of the privately-held firm and conglomerate business unit. Strategic Management Journal, 5(3), 265-273. https://doi.org/10.1002/smj.4250050306
  56. Dollinger, M. J. (1984). Environmental boundary spanning and information processing effects on organizational performance. Academy of Management Journal, 27(2), 351-368. https://doi.org/10.2307/255929
  57. Donald C. Hambrick. (1981). Specialization of Environmental Scanning Activities among Upper Level Executives. Journal of Management Studies, 18(3).
  58. Drongelen, I. C. K., & Bilderbeek, J. (1999). R&D performance measurement: more than choosing a set of metrics. R&D Management, 29(1), 35-46. https://doi.org/10.1111/1467-9310.00115
  59. Drucker, P. F. (1959). Long-range planning: challenge to management science. Management Science, 5(3), 238-249. https://doi.org/10.1287/mnsc.5.3.238
  60. Ellis, L. W. (1980). Optimum research spending reexamined. Research Management, 23(3), 22-24.
  61. Ernst, H. (1995). Patenting strategies in the German mechanical engineering industry and their relationship to company performance. Technovation, 15(4), 225-240. https://doi.org/10.1016/0166-4972(95)96605-S
  62. Faber, J., & Hesen, A. B. (2004). Innovation capabilities of European nations: cross-national analyses of patents and sales of product innovations. Research Policy, 33(2), 193-207. https://doi.org/10.1016/S0048-7333(03)00122-7
  63. Fahey, L., King, W. R., & Narayanan, V. K. (1981). Environmental scanning and forecasting in strategic planning-The state of the art. Long Range Planning, 14(1), 32. https://doi.org/10.1016/0024-6301(81)90148-5
  64. Flor, M. L., & Oltra, M. J. (2004). Identification of innovating firms through technological innovation indicators: an application to the Spanish ceramic tile industry. Research Policy, 33(2), 323-336. https://doi.org/10.1016/j.respol.2003.09.009
  65. Foster, R. N. (1982). Boosting the payoff From R&D. Research Management, 25(1), 22-27.
  66. Francis, P. H. (1992). Putting quality into the R&D process. Research Technology Management, 35(4), 16-. https://doi.org/10.1080/08956308.1992.11670830
  67. Franko, L. G. (1989). Global corporate competition: who's winning, who's losing, and the R&D factor as one reason why. Strategic Management Journal, 10(5), 449-474. https://doi.org/10.1002/smj.4250100505
  68. Fredrickson, J. W., & Mitchell, T. R. (1984). Strategic decision processes: comprehensiveness and performance in an industry with an unstable environment. Academy of Management Journal, 27(2), 399-423. https://doi.org/10.2307/255932
  69. French, S. J., Kelly, S. J., & Harrison, J. L. (2004). The role of strategic planning in the performance of small, professional service firms: A research note. Journal of Management Development, 23(8), 765-776. https://doi.org/10.1108/02621710410549611
  70. Frohman, A. L. (1982). Technology as a competitive weapon. Harvard Buiness Review, 60(1), 97-104.
  71. Fulmer, R. M., & Rue, L. W. (1974). The practice and profitability of long-range planning. Managerial Planning, 22(6), 1-7.
  72. Fusfeld, A. R. (1989). Formulating technology strategies to meet the global challenges of the 1990s. International Journal of Technology Management, 4(6), 601-612.
  73. Gale, B. T. (1972). Market share and rate of return. The Review of Economics and Statistics, 54(4), 412-423. https://doi.org/10.2307/1924568
  74. Galloway, E. C. (1971). Evaluating R&D performance - keep it simple. Research Management, 14(2), 50-58.
  75. Gambardella, A. (1992). Competitive advantages from in-house scientific research: the US pharmaceutical industry in the 1980s. Research Policy, 21(5), 391-407. https://doi.org/10.1016/0048-7333(92)90001-K
  76. Geisler, E. (1994). Key output indicators in performance evaluation of research and development organizations. Technological Forecasting and Social Change, 47(2), 189-203. https://doi.org/10.1016/0040-1625(94)90028-0
  77. Gold, B. (1989). Some key problems in evaluating R&D performance. Journal of Engineering and Technology Management, 6(1), 59-70. https://doi.org/10.1016/0923-4748(89)90014-3
  78. Gopalakrishnan, S., & Damanpour, F. (1997). A review of innovation research in economics, sociology and technology management. Omega, 25(I), 15-28. https://doi.org/10.1016/S0305-0483(96)00043-6
  79. Grabowski, H. G. (1968). The determinants of industrial research and development: a study of the chemical, drug, and petroleum industries. Journal of Political Economy, 76(2), 292-306. https://doi.org/10.1086/259401
  80. Grabowski, H. G., & Mueller, D. C. (1978). Industrial research and development, intangible capital stocks, and firm profit rates. The Bell Journal of Economics, 9(2), 328-343. https://doi.org/10.2307/3003585
  81. Griffin, A., & Page, A. L. (1993). An interim report on measuring product development success and failure. Journal of Product Innovation Management, 10(4), 291-308. https://doi.org/10.1016/0737-6782(93)90072-X
  82. Griliches, Z. (1981). Market value, R&D, and patents. Economics Letters, 7(2), 183-187. https://doi.org/10.1016/0165-1765(87)90114-5
  83. Griliches, Z. (1990). Patent statistics as economic indicators: a survey. Journal of Economic Literature, 28(4), 1661-1707.
  84. Grinyer, P. H., & Norburn, D. (1975). Planning for existing markets: perceptions of executives and financial performance. Journal of the Royal Statistical Society. Series A (General), 138(1), 70-97. https://doi.org/10.2307/2345251
  85. Guellec, D., & Van Pottelsberghe De La Potterie, B. (2001). The internationalisation of technology analysed with patent data. Research Policy, 30(8), 1253-1266. https://doi.org/10.1016/S0048-7333(00)00149-9
  86. Halperin, M. R., & Chakrabarti, A. K. (1987). Firm and industry characteristics influencing publications of scientists in large American companies. R&D Management, 17(3), 167-173. https://doi.org/10.1111/j.1467-9310.1987.tb00051.x
  87. Hambrick, D. C. (1982). Environmental scanning and organizational strategy. Strategic Management Journal, 3(2), 159-174. https://doi.org/10.1002/smj.4250030207
  88. Hambrick, D. C., & Macmillan, I. C. (1985). Efficiency of product R&D in business units: the role of strategic context. Academy of Management Journal, 28(3), 527-547. https://doi.org/10.2307/256112
  89. Harling, K. F., & Funk, T. F. (1987). Competitive strategy for farm supply and grain elevator business. American Journal of Agricultural Economics, 69(5), 1047-1055. https://doi.org/10.2307/1242259
  90. Hausman, J. a., Hall, B. H., & Griliches, Z. (1984). Econometric models for count data with an application to the patents-R&D relationship. Econometrica.
  91. Herold, D. M. (1972). Long-range planning and organizational performance: a cross-valuation study. Academy of Management Journal, 15(1), 91-102. https://doi.org/10.2307/254803
  92. Hodge, M. H. (1963). Rate your company's research productivity. Harvard Business Review, 41(6), 109-122.
  93. Hofer, C. W., & Schendel, D. (1978). Strategy Formulation: Analytical Concepts. New York, Los Angeles, San Francisco: West Publishing Company.
  94. Hogarth, R. M., & Makridakis, S. (1981). Forecasting and planning: an evaluation. Management Science, 27(2), 115-138. https://doi.org/10.1287/mnsc.27.2.115
  95. Holak, S. L., Parry, M. E., & Song, X. M. (1991). The relationship of R&D/sales to firm performance: an investigation of marketing contingencies. Journal of Product Innovation Management, 8(4), 267-282. https://doi.org/10.1016/0737-6782(91)90048-4
  96. Hoskisson, R. E., Hitt, M. A., Johnson, R. A., & Moesel, D. D. (1993). Construct validity of an objective (entropy) categorical measure of diversification strategy. Strategic Management Journal, 14(3), 215-235. https://doi.org/10.1002/smj.4250140305
  97. Jaffe, A. B. (1986). Technological opportunity and spillovers of R&D: evidence from firms' patents, profits and market value. American Economic Review, 76(5), 984-1001.
  98. Jantsch, E. (1969). Technological Forecasting in Corporate Planning. In and B. T. Gordon Wills, David Ashton (Ed.), Technological Forecasting and Corporate Strategy (pp. 17-38). New York: American Elsevier Publishing Company Inc.
  99. Karger, D. W., & Malik, Z. A. (1975). Long range planning and organizational performance. Long Range Planning, 8(6), 60-64. https://doi.org/10.1016/0024-6301(75)90027-8
  100. Karlsson, M., Trygg, L., & Elfström, B. O. (2004). Measuring R&D productivity: Complementing the picture by focusing on research activities. Technovation, 24(3), 179-186. https://doi.org/10.1016/S0166-4972(03)00111-1
  101. Kleinschmidt, E. J., & Cooper, R. G. (1991). The impact of product innovativeness on performance. Journal of Product Innovation Management, 8(4), 240-251. https://doi.org/10.1016/0737-6782(91)90046-2
  102. Kline, S. J. (1985). Innovation is not a linear process. Research Management, 28(4), 36-45.
  103. Krajewski, K. (2003). Five steps to effective strategic technology initiatives. Association Management, 55(9), 46-47.
  104. Kudla, R. J. (1980). The effects of strategic planning on common stock returns. Academy of Management Journal, 23(1), 5-20. https://doi.org/10.2307/255493
  105. Lazzarotti, V., Manzini, R., & Mari, L. (2011). A model for R&D performance measurement. International Journal of Production Economics, 134(1), 212-223. https://doi.org/10.1016/j.ijpe.2011.06.018
  106. Leonard, W. N. (1971). Research and development in industrial growth. Journal of Political Economy, 79(2), 232-256. https://doi.org/10.1086/259741
  107. Leontiades, M., & Tezel, A. (1980). Planning perceptions and planning results. Strategic Management Journal, 1(1), 65-75. https://doi.org/10.1002/smj.4250010107
  108. Li, M., & Richard Ye, L. (1999). Information technology and firm performance: linking with environmental, strategic and managerial contexts. Information and Management, 35, 43-51. https://doi.org/10.1016/S0378-7206(98)00075-5
  109. Linstone, H. A. (1989). Twenty years of TF&SC. Technological Forecasting and Social Change, 36(1), 1-13. https://doi.org/10.1016/0040-1625(89)90002-4
  110. Loch, C. H., & Tapper, U. A. S. (2002). Implementing a strategy-driven performance masurement system for an applied research group. Journal of Product Innovation Management, 19(3), 185-198. https://doi.org/10.1111/1540-5885.1930185
  111. Lockett, A., Thompson, S., & Morgenstern, U. (2009). The development of the resource-based view of the firm: a critical appraisal. International Journal of Management Reviews, 11(1), 9-28. https://doi.org/10.1111/j.1468-2370.2008.00252.x
  112. Luwel, M., Noyons, E., & Moed, H. F. (1999). Bibliometric assessment of research performance in Flanders: policy background and implications. R&D Management, 29(2), 133-141. https://doi.org/10.1111/1467-9310.00124
  113. Mansfield, E. (1986). Patents and innovation: an empirical study. Management Science, 32(2), 173-181. https://doi.org/10.1287/mnsc.32.2.173
  114. Mansfield, E. (1992). Academic research and industrial innovation: a further note. Research Policy, 21(3), 295-296. https://doi.org/10.1016/0048-7333(92)90021-U
  115. Martino, J. P. (2003). A review of selected recent advances in technological forecasting. Technological Forecasting and Social Change, 70(8), 719-733. https://doi.org/10.1016/S0040-1625(02)00375-X
  116. McGaughey, N. W. (1990). Corporate technology planning. Industrial Management, 32(2), 1-2.
  117. McGrath, M. E., & Romeri, M. N. (1994). The R&D effectiveness index: a metric for product development performance. Journal of Product Innovation Management, 11(3), 213-220. https://doi.org/10.1111/1540-5885.1130213
  118. McGuire, J. B., Schneeweis, T., & Branch, B. (1990). Perceptions of firm quality: A cause or result of firm performance. Journal of Management, 16(1), 167-180. https://doi.org/10.1177/014920639001600112
  119. Mechlin, G. F., & Berg, D. (1980). Evaluating research-ROI is not enough. Harvard Business Review, 58(5), 93-99.
  120. Mendigorri, E. M., Valderrama, T. G., & Cornejo, V. R. (2016). Measuring the effectiveness of R&D activities: Empirical validation of a scale in the Spanish pharmaceutical sector. Management Decision, 54(2), 321-362. https://doi.org/10.1108/MD-06-2014-0378
  121. Metz, P. D. (1996). Integrating technology planning with business planning. Research Technology Management, 39(3), 19-22. https://doi.org/10.1080/08956308.1996.11671059
  122. Michelino, F., Lamberti, E., Cammarano, A., & Caputo, M. (2015). Open innovation in the pharmaceutical industry: An empirical analysis on context features, internal R&D, and financial performances. IEEE Transactions on Engineering Management, 62(3), 421-435. https://doi.org/10.1109/TEM.2015.2437076
  123. Miller, C. C., & Cardinal, L. B. (1994). Strategic planning and firm performance: a synthesis of more than two decades of research. Academy of Management Journal, 37(6), 1649-1665. https://doi.org/10.2307/256804
  124. Millett, S. M. (1990). The strategic management of technological R&D: an ideal process for the 1990s. International Journal of Technology Management, 5(1).
  125. Mitchell, G. R. (1990). Alternative frameworks for technology strategy. European Journal of Operational Research, 47(2), 153-161. https://doi.org/10.1016/0377-2217(90)90274-F
  126. Mogee, M. E., & Kolar, R. G. (1994). International patent analysis as a tool for corporate technology analysis and planning. Technology Analysis & Strategic Management, 6(4), 485-503. https://doi.org/10.1080/09537329408524188
  127. Moorman, C. (1995). Organizational market information processes: cultural antecedents and new product outcomes. Journal of Marketing Research, 32(3), 318-335. https://doi.org/10.1177/002224379503200307
  128. Morbey, G. K. (1988). R&D: its relationship to company performance. Journal of Product Innovation Management, 5(3), 191-200. https://doi.org/10.1016/0737-6782(88)90022-7
  129. Morbey, G. K. (1989). R&D expenditures and profit growth. Research Technology Management, 32(3), 20-23. https://doi.org/10.1080/08956308.1989.11670595
  130. Morbey, G. K., & Reithner, R. M. (1990). How R&D affects sales growth, productivity and profitability. Research Technology Management, 33(3), 11-14. https://doi.org/10.1080/08956308.1990.11670656
  131. Narin, F., & Breitzman, A. (1995). Inventive productivity. Research Policy, 24(4), 507-519. https://doi.org/10.1016/S0048-7333(94)00780-2
  132. Narin, F., Carpenter, M. P., & Woolf, P. (1984). Technological performance assessments based on patents and patent citations. IEEE Transactions on Engineering Management, EM-31(4), 172-183. https://doi.org/10.1109/TEM.1984.6447534
  133. Narin, F., & Noma, E. (1985). Is technology becoming science? Scientometrics, 7(3-6), 369-381. https://doi.org/10.1007/BF02017155
  134. Narin, F., Noma, E., & Perry, R. (1987). Patents as indicators of corporate technological strength. Research Policy, 16(2-4), 143-155. https://doi.org/10.1016/0048-7333(87)90028-X
  135. Neely, a, Gregory, M., & ... (2005). Performance measurement system design: a literature review and research agenda. International Journal of Operations & Production Management, 15(4), 80-116. https://doi.org/10.1108/01443579510083622
  136. Nelson, R. R. (1991). Why do firms differ, and how does it matter? Strategic Management Journal, 12(S2), 61-74. https://doi.org/10.1002/smj.4250121006
  137. Nilsson, S., & Ritzen, S. (2014). Exploring the use of innovation performance measurement to build innovation capability in a medical device company. Creativity and Innovation Management, 23(2), 183-198. https://doi.org/10.1111/caim.12054
  138. Ojanen, V., & Vuola, O. (2006). Coping with the multiple dimensions of R&D performance analysis. International Journal of Technology Management, 33(2/3), 279-290.
  139. Pakes, A. (1985). On patents, R & D, and the stock market rate of return. Journal of Political Economy, 93(2), 390-409. https://doi.org/10.1086/261305
  140. Pakes, A., & Griliches, Z. (1980). Patents and R&D at the firm level: a first report. Economics Letters, 5(4), 377-381. https://doi.org/10.1016/0165-1765(80)90136-6
  141. Pappas, R. A., & Remer, D. S. (1985). Measuring R&D productivity. Research Management, 31(4), 15-22.
  142. Parasuraman, A., & Zeren, L. M. (1983). R&D's relationship with profits and sales. Research Management, 26, 25-28.
  143. Patterson, W. C. (1983). Evaluating R&D performance at Alcoa laboratories. Research Management, 26(2), 23-27.
  144. Pavitt, K. (1985). Patent statistics as indicators of innovative activities: possibilities and problems. Scientometrics, 7(1-2), 77-99. https://doi.org/10.1007/BF02020142
  145. Pavitt, K. (1991). What makes basic research economically useful? Research Policy, 20(2), 109-119. https://doi.org/10.1016/0048-7333(91)90074-Z
  146. Penrose, E. (1959). The Growth of the Firm. New York: John Wiley.
  147. Poensgen, O. H., & Hort, H. (1983). R&D management and financial performance. IEEE Transactions on Engineering Management, 30(4), 212-222.
  148. Priem, R. L., & Butler, J. E. (2001). Is the resource-based "view" a useful perspective for strategic management research? Academy of Management Review, 26(1), 22-40. https://doi.org/10.2307/259392
  149. Quinn, J. B. (1959). Yardsticks for Industrial Research: The Evaluation of Research and Development Output. The Ronald Press Company.
  150. Quinn, J. B. (1961). Long-range planning of industrial research. Harvard Business Review, 39(4), 88-102.
  151. Quinn, J. B., & Mueller, J. A. (1963). Transferring research results to operations. Harvard Business Review, 41(1), 49-66.
  152. Reynard, E. L. (1979). A method for relating research spending to net profits. Research Management, 22, 12-14.
  153. Rhyne, L. C. (1986). The relationship of strategic planning to financiaI performance. Strategic Management Journal, 7(5), 423-436. https://doi.org/10.1002/smj.4250070504
  154. Robb, W. L. (1991). How good is our research? Research Technology Management, 34(2), 16-21. https://doi.org/10.1080/08956308.1991.11670725
  155. Roberts, P. W., & Amit, R. (2003). The dynamics of innovative activity and competitive advantage: The case of Australian retail banking, 1981 to 1995. Organisation Science, 14(2), 107-122. https://doi.org/10.1287/orsc.14.2.107.14990
  156. Robinson, R. B., & Pearce II, J. A. (1983). The impact of formalized strategic planning on financial performance in small organizations. Strategic Management Journal, 4(3), 197-207. https://doi.org/10.1002/smj.4250040302
  157. Robinson, R. B., & Pearce II, J. A. (1988). Planned patterns of strategic behavior and their relationship to business-unit performance. Strategic Management Journal, 9(1), 43-60. https://doi.org/10.1002/smj.4250090105
  158. Romer, P. M. (1990). Endogenous technological change. Journal of Political Economy, 98(S5), S71. https://doi.org/10.1086/261725
  159. Rosenberg, J. B. (1976). Research and market share: a reappraisal of the Schumpeter hypothesis. The Journal of Industrial Economics, 25(2), 101-112. https://doi.org/10.2307/2098260
  160. Rothaermel, F. T., & Hess, A. M. (2007). Building dynamic capabilities: Innovation driven by individual-, firm-, and network-level effects. Organization Science, 18(6), 898-921. https://doi.org/10.1287/orsc.1070.0291
  161. Rothwell, R. (1986). Innovation and re-innovation: a role for the user. Journal of Marketing Management, 2(2), 109-123. https://doi.org/10.1080/0267257X.1986.9964004
  162. Roussel, P. A., Saad, K. N., & Erickson, T. J. (1991). Third Generation R&D: Managing The Link to Corporate Strategy. Boston, MA: Harvard Business Press.
  163. Rubenstein, A. H., & Geisler, E. (1991). Evaluating the outputs and impacts of R&D/innovation. International Journal of Technology Management, 6(3), 181-204.
  164. Rubin, P. H. (1973). The expansion of firms. Journal of Political Economy, 81(4), 936-949. https://doi.org/10.1086/260089
  165. Schainblatt, A. H. (1982). How companies measure the productivity of engineers and scientists. Research Management, 25(3), 10-18.
  166. Scherer, F. M. (1965a). Corporate inventive output, profits, and growth. Journal of Political Economy, 73(3), 290-297. https://doi.org/10.1086/259017
  167. Scherer, F. M. (1965b). Firm size, market structure, opportunity, and the output of patented inventions. The American Economic Review, 55(5), 1097-1125.
  168. Scherer, F. M. (1983). The propensity to patent. International Journal of Industrial Organization, 1(1), 107. https://doi.org/10.1016/0167-7187(83)90026-7
  169. Schoeffler, S., Buzzell, R. D., & Heany, D. F. (1974). Impact of strategic planning on profit performance. Harvard Business Review, 7(4), 137-145.
  170. Sher, I. H., & Garfield, E. (1965). New tools for improving and evaluating the effectiveness of research. In Research Program Effectiveness, Proceedings of the Conference sponsored by the Office of Naval Research (pp. 135-146). Washington, DC.
  171. Sher, P. J., & Yang, P. Y. (2005). The effects of innovative capabilities and R&D clustering on firm performance: The evidence of Taiwan's semiconductor industry. Technovation, 25(1), 33-43. https://doi.org/10.1016/S0166-4972(03)00068-3
  172. Slaughter, R. A. (1999). A new framework for environmental scanning. Foresight, 1(5), 441-451. https://doi.org/10.1108/14636689910802331
  173. Solow, R. M. (1956). A contribution to the theory of economic growth. The Quarterly Journal of Economics, 70(1), 65-94. https://doi.org/10.2307/1884513
  174. Solow, R. M. (1957). Technical change and the aggregate production function. The Review of Economics and Statistics, 39(3), 312-320. https://doi.org/10.2307/1926047
  175. Steele, L. W. (1988). Evaluating the technical operation. Research Technology Management, 31(5), 11-18. https://doi.org/10.1080/08956308.1988.11670543
  176. Steensma, H. K., & Corley, K. G. (2000). On the performance of technology-sourcing partnerships: The interaction between partner interdependence and technology attributes. Academy of Management Journal, 43(6), 1045-1067. https://doi.org/10.2307/1556334
  177. Swager, W. L. (1972). Strategic planning I: the roles of technological forecasting. Technological Forecasting & Social Change, 4, 85-99. https://doi.org/10.1016/0040-1625(72)90049-2
  178. Szakonyi, R. (1994). Measuring R&D effectiveness-I. Research Technology Management, 37(2), 27. https://doi.org/10.1080/08956308.1994.11670966
  179. Teece, D. J. (1980). Economies of scope and the scope of the enterprise. Journal of Economic Behavior & Organization, 1(3), 223-247. https://doi.org/10.1016/0167-2681(80)90002-5
  180. Teece, D. J. (1982). Towards an economic theory of the multiproduct firm. Journal of Economic Behavior & Organization, 3(1), 39-62. https://doi.org/10.1016/0167-2681(82)90003-8
  181. Teece, D. J., & Pisano, G. (1994). The dynamic capabilities of firms: an introduction. Industrial and Corporate Change, 3(3), 537-556.
  182. Teece, D. J., Pisano, G., & Shuen, A. (1997). Dynamic capabilities and strategic management. Strategic Management Journal, 18(7), 509-533. https://doi.org/10.1002/(SICI)1097-0266(199708)18:7<509::AID-SMJ882>3.0.CO;2-Z
  183. Tennenhouse, D. (2004). Intel's open collaborative model of industry-university research. Research Technology Management, 47(4), 19-26. https://doi.org/10.1080/08956308.2004.11671637
  184. Thomas, P. S. (1974). Environmental Analysis for Corporate Planning. Business Horizons, 17(5), 27. https://doi.org/10.1016/0007-6813(74)90035-4
  185. Thomas, V. J., Sharma, S., & Jain, S. K. (2011). Using patents and publications to assess R&D efficiency in the states of the USA. World Patent Information, 33(1), 4-10. https://doi.org/10.1016/j.wpi.2010.01.005
  186. Thune, S. S., & House, R. J. (1970). Where long-range planning pays off: findings of a survey of formal, informal planners. Business Horizons, 13(4), 81-87. https://doi.org/10.1016/0007-6813(70)90162-X
  187. Tushman, M. L. (1997). Winning through innovation. Strategy and Leadership, 25(4), 14-19. https://doi.org/10.1108/eb054591
  188. Utterback, J. M. (1994). Mastering the Dynamics of Innovation. Cambridge, MA: Harvard Business School Press.
  189. Utterback, J. M., & Abernathy, W. J. (1975). A dynamic model of process and product innovation. Omega, 3(6), 639-656. https://doi.org/10.1016/0305-0483(75)90068-7
  190. Voros, J., Choo, C. W., & Slaughter, R. A. (2003). Reframing Environmental Scanning: A reader on the art of scanning the environment (Monograph Series No. 4). Australia.
  191. Wagner, H. M. (1984). Profit wonders, investment blunders. Harvard Business Review, 62(5), 121-135.
  192. Wall, T. D., Michie, J., Patterson, M., Wood, S. J., Sheehan, M., Clegg, C. W., & West, M. (2004). On the validity of subjective measures of company performance. Personnel Psychology, 57(1), 95-118. https://doi.org/10.1111/j.1744-6570.2004.tb02485.x
  193. Werner, B. M., & Souder, W. E. (1997). Measuring R&D performance-state of the art. Research Technology Management, 40(2), 34. https://doi.org/10.1080/08956308.1997.11671115
  194. Wernerfelt, B. (1984). A resource-based view of the firm. Strategic Management Journal, 5(2), 171-180. https://doi.org/10.1002/smj.4250050207
  195. Whiteley, R., Parish, T., Dressler, R., & Nicholson, G. (1998). Evaluating R&D performance using the new sales ratio. Research Technology Management, 41(5), 20-22. https://doi.org/10.1080/08956308.1998.11671232
  196. Wiesenthal, T., Mercier, A., Schade, B., Petric, H., & Dowling, P. (2012). A model-based assessment of the impact of revitalised R&D investments on the European power sector. Renewable and Sustainable Energy Reviews, 16(1), 105-112. https://doi.org/10.1016/j.rser.2011.07.139
  197. Wood Jr, D. R., & LaForge, R. L. (1979). The impact of comprehensive planning on financial performance. Academy of Management Journal, 22(3), 516-526. https://doi.org/10.2307/255741
  198. Zahra, S. A. (1996). Technology strategy and financial performance: examining the moderating role of the firm's competitive environment. Journal of Business Venturing, 11(3), 189-219. https://doi.org/10.1016/0883-9026(96)00001-8
  199. Zahra, S. A., & Covin, J. G. (1993). Business strategy, technology policy and firm performance. Strategic Management Journal, 14(6), 451-478. https://doi.org/10.1002/smj.4250140605