• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.6 no.3
• /
• pp.191-201
• /
• 2010

The Korean central government has been investing a lot of efforts to promote performance of local governments. For example, the Ministry of Public Administration and Security (MOPAS) supported the local governments to develop and provide with a 'balanced score card' and a 'customer satisfaction innovation. ' Many other central ministries also conducted individual evaluations for local governments in their substantive policy areas. These evaluation systems of 78 appraisals for local governments conducted by the MOPAS and other ministries had made the local governments to work harder. However, most local governments have appealed their 'reform fatigue' caused by the overlapping evaluation systems. In this context, the MOPAS initiated merging the evaluations into a co-evaluation system under the new Government Performance Evaluation Act of 2006. In this process of introduction of new evaluation system, there are two significant movements. Firstly, as Korean Government has strong information technology, MOPAS has developed 'Virtual Policy Studio (VPS)' which evaluates the performance of each local government with on line. In other words, in the co-evaluation system for local government performance most evaluation steps are implemented by computer and Internet. So most stakeholder can access and work on the VPS in real time when they want to. And the other thing is that cooperation among stakeholders has been occurred in the co-evaluation system. Furthurmore the cooperative governance is systemized and sustain for a long time because MOPAS made IT based co-evaluation system. Therefore this paper intends to illustrate the process of introduction of VPS, main process of co-evaluation system based on VPS and analyze collaborative governance of the co-evaluation system.

• Journal of Information Technology Services
• /
• v.10 no.4
• /
• pp.171-189
• /
• 2011

KAs information and knowledge are increasingly becoming more important in the knowledge-driven society, knowledge management, as a very important management paradigm, is securing firm position in private and public sectors. Complying with this paradigm, government-funded research institutes in science-technology sector are actively utilizing knowledge management by employing knowledge management system and evaluating its applications' performance. The purpose of this study is to develop evaluation items and measurement indices to rationally measure knowledge management performance of the government-funded research institutes and to verify the feasibility of applying these evaluation items and indices. To achieve this research goal, the evaluation model of knowledge management performance was constructed by reviewing and integrating the existing studies, and subsequently, evaluation areas, evaluation items, measurement indices were derived from this evaluation model. Also, the feasibility analysis on the evaluation items and measurement indices was performed by means of FGI(Focus Group Interview) with the knowledge management experts belonging to Korean government-funded institutions in science-technology sector. The implications of this study are as follows : in theoretical perspective, this study has proposed a criterion frame to evaluate knowledge management performance, and has rationally drawn evaluation items and measurement indices from the criterion frame. And in practical perspective, this study has improved the validity and practicality of the measurement indices, which can lead to more reasonable and easier evaluation of knowledge management performance of the government-funded research institutes.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.43 no.4
• /
• pp.84-92
• /
• 2020

In order to analyze the organizational performance of government-funded research institutes, four independent variables (organization size, organization age, evaluation system, organization location) and goal ambiguity were empirically analyzed. Although there are existing studies on institutional evaluation, which is the organizational performance of government-funded research institutes, there are differences in research in that it is an empirical analysis analyzed from the perspective of goal ambiguity and that the evaluation system, which is the specificity of institutional evaluation, is included in the analysis. As a result of the analysis, organizational location was the only independent variable that had a direct significant effect on organizational performance, and goal ambiguity showed a significant mediating effect for all independent variables. This indicates that goal ambiguity plays an important role in the organizational performance of government-funded research institutes, and to reduce this, increase the size of the organization, pay attention to establishment of the organization for organizational age, and that it is desirable to have an independent research group in the government department for the organization location. In addition, it was supported that the improvement effect of the evaluation system is proceeding in a desirable direction in terms of goal ambiguity.

• 한국디지털정책학회:학술대회논문집
• /
• 2006.06a
• /
• pp.87-109
• /
• 2006

The purpose of this paper is to examine the present performance evaluation methods and to make Monte Carlo Simulation Model for the IT-based Government innovation project. It is suggested the proper ways in applying of Monte Carlo Simulation Model by integration of present evaluation methods. It develops the theoretical framework for this paper, examining the existing literature on proposing an approach to the key concepts of the economic impact analysis methods. It examines the actual conditions of performance evaluation focusing on the It-based Government Innovation project. It considers how the simulation model is applied to the performance management in the public innovation project focusing on the framework, process and procedure of performance management.

• Journal of Technology Innovation
• /
• v.14 no.3
• /
• pp.117-154
• /
• 2006

This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.10 no.4
• /
• pp.872-876
• /
• 2009

The government has funded various types of projects to promote small and medium companies' computerization for several years. Most of these government-supported funds have been free and given small and medium firms good opportunities. The government has made various effects to manage results of these government-supported projects. We have not seen any noticeable research on the performance evaluation of government-supported projects for small and medium companies' computerization. This research proposes an approach that performance evaluations are made in different time based on evaluation area of government-supported information policy. The empirical study has been made by correlation analysis and has shown that the correlations among measurement factors are significant enough. The performance evaluation for government-supported information policy has been made differently in time depending on evaluation subjects such as organizational strategies, internal operations, supporting processes. Th experimental study shows that performance evaluations on organizational strategies, internal operations, supporting processes should be made respectively in long term(step3), mid term(step2), and short term(step1).

• Journal of Technology Innovation
• /
• v.13 no.3
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• Journal of Technology Innovation
• /
• v.13 no.1
• /
• pp.265-293
• /
• 2005

This research examines the relationship between the characteristics of Government S&T Research Institutes (GRI) and their institutional performance evaluation system. First, based on Kaplan & Norton (1992) Balanced Scorecard Model, six perspectives suitable to Korean GRI are derived. Second, personnel who works on evaluation job classified current performance measures into the six perspectives. Analyzing comparative weights of individual perspectives, the characteristics of performance evaluation systems among institutes are derived and compared with their missions. The results are as follows: First, GRI evaluation systems put most weight on the customer perspective and least weight on the financial perspective. This result complies with Korean GRI's missions and strategies as well as findings of foreign cases. Second, Basic-technology GRI group relatively more priotizes long-term customer perspective, while Applied-technology GRI Group relatively more priotizes short-term customer perspective. Public-technology GRI Group is located in the middle in terms of priority of customer perspectives. Third, for three yews (2000-2002), performance measure weights of Basic-technology Group are changed much less than those of the other two groups. Further research are needed for reasons of drastic changes for Applied-technology and Public-technology groups and some abnormally high and low measure weights.

• The Journal of Society for e-Business Studies
• /
• v.9 no.2
• /
• pp.33-50
• /
• 2004

This paper presents the evaluation model which is included in a quantitative evaluation methodology for evaluation processes of validity and effectiveness of information budget investment and improving conformance of ROI(Return On Investment). That is, the right efficiency targets of information investment for the development project to GDOC (Government electronic Document Distribution Center), and KPls(Key Performance Indexes) which enable to evaluate objectively effectiveness in the preliminary and post evaluation phases are developed, and then the results were come out by practical investigation study using quantitative evaluation methodology.