• Journal of Information Processing Systems
• /
• 제14권4호
• /
• pp.916-925
• /
• 2018

The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting the citation quality to some extent. However, these frequency-based indicators are usually carried out based on the assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of the citing objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, we review various citation quality-based evaluation indicators, and categorize them considering the algorithms being applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.

• 상하수도학회지
• /
• 제34권6호
• /
• pp.495-502
• /
• 2020

The 37 indicators for performance evaluation of public sewage management agencies are divided into four major categories (agency manpower management ability, wastewater treatment plant operation and management, sludge and water reuse, service quality) in the first stage, and the necessity and score acquisition for the detailed indicators by each major category in the second stages. Priority was investigated through the Analytic Hierarchy Process (AHP) analysis technique for ease and relevance of company efforts. Also, based on the results of this analysis, integrated type weighting and relative importance were analyzed. As a result of the analysis, the weight and relative importance of the first stage classification were in the order of wastewater treatment plant operation and maintenance, operation agency manpower management ability, sludge and water reuse, and service quality. As a result of analyzing the weights and priorities of the detailed performance indicators in the second stage, it was found that operator's career years, the percentage of certification holding rate in operators, compliance with the effluent water quality standards, training times for operators, and efforts to manage hazardous chemicals were important. Some of the indicators of operation agency performance evaluation may include indicators in which the performance of the company's efforts is underestimated or overestimated. In order to improve this, it is necessary to give weights in consideration of the necessity of the indicator, the relevance of the company's efforts, and the ease of obtaining scores.

• 한국문헌정보학회지
• /
• 제42권4호
• /
• pp.113-139
• /
• 2008

오늘날과 같이 급변하는 환경에서 공공도서관은 다양한 변화에 대응하기 위해서 통합적 관점에서 성과를 측정할 필요가 있다. 그러나 대부분의 성과평가연구는 특정 영역과 특정 분석방법에 치중하고 있는 한계가 있다. 이에 도서관의 활동 영역(투입, 과정, 산출, 결과)을 평가할 수 있는 다면적인 성과지표의 개발이 필요하다. 현재 국제표준화기구와 IFLA는 BSC(균형성과지표)에 기초한 통합성과평가체제의 도입을 시도하고 있다. 이에 본 연구는 선행연구를 통해 도서관의 성과평가영역(투입, 과정, 산출, 결과)과 성과지표(투입지표, 산출지표, 결과지표)의 유형을 도출하고 국내 외 공공도서관 평가사례를 대상으로 평가영역과 성과지표의 유형을 비교 분석하였다. 비교 분석결과에 따라 국내 외 평가사례에 기초한 공공도서관의 통합적 성과지표를 제안하였다. 구체적으로 국제표준화기구 평가사례로부터 4개의 평가관점과 인력자원, 이용, 장서, 시설 등의 세부적 평가영역을 선정하였고 평가영역별 성과지표와 성과측정방법을 제안하였다. 마지막으로 제안된 평가영역과 성과지표에 대한 적합성 검증 방법을 제안하였다.

• 통상정보연구
• /
• 제16권3호
• /
• pp.141-158
• /
• 2014

본 연구는 중소기업의 해외시장 개척을 돕기 위한 "중소기업 수출역량강화사업"의 성과관리가 적정하게 이루어지고 있는지를 살펴보고 개선방안을 모색함에 연구 목적을 두고 있다. 동 사업은 중소기업이 해당 사업을 통해 해외 진출의 기반을 갖추고 궁극적으로 홀로 설 수 있도록 하는 것을 정책목표로 하고 있다. 이에 논리모델을 기반으로 현행 수출역량강화사업에 대한 성과관리 평가 지표들을 분석한 결과 정량지표중심으로 구성되어 정성지표가 부족하며, 과정에 대한 평가가 부족하고 단기적 결과에만 중점을 두고 있는 것으로 나타났다. 따라서 향후 성과측정을 위한 지표는 결과와 과정에 대한 평가가 균형을 맞추고 중장기적 결과도 함께 포함하는 방향으로 개선해야 할 것이다.

• 공학교육연구
• /
• 제26권6호
• /
• pp.62-70
• /
• 2023

The purpose of this study is to derive implications for improving related policies and evaluation criteria in the future by analyzing trends of evaluation criteria for industry-university cooperation in Korea. For this purpose, five surveys on industry-university cooperation by government departments, major general university evaluations, and evaluation indicators of specialized industry-university evaluations by the Ministry of Education were analyzed. As a result, most of the evaluation criteria for domestic industry-university cooperation have been composed of quantitative indicators and have a limited character as quantitative performance management for government projects. Although the Ministry of Education's evaluation criteria for industry-university cooperation projects has gradually changed to a segmented index considering universities, industries, and regions, it needs to be supplemented for sustainability of industry-university cooperation. In order to promote sustainable industry-university cooperation in the future, it was suggested that first, it is necessary to supplementation of qualitative Indicators considering each university's characteristics, second, the composition of indicators related to reflect on demand in the process of the cooperation, and third, to build a virtuous cycle system for future operation of evaluation criteria.

• 산업경영시스템학회지
• /
• 제35권2호
• /
• pp.1-8
• /
• 2012

The primary goal of this study is to develop proper performance indicators for evaluating the results of industrial R&D program. We define R&D results include output, transfer, outcome, and impact in the performance of R&D program. Performance indicators are focused on the results of R&D commercialization, building the industrial foundations as performance proxy of R&D program of Ministry of Knowledge Economy. And we first try to design the coupled structure as logical model between R&D program goals and performance indicators. The coupled structure is represented with objectives of group unit of R&D program, implementation process, R&D practical stage, and the ultimate goal of R&D program.

• 한국도서관정보학회지
• /
• 제32권3호
• /
• pp.91-115
• /
• 2001

오늘날 대학도서관은 공룡의 화신 내지 예산의 블랙홀로 인식되고 있다. 그럼에도 불구하고 대학 도서관은 디지털시대의 다양한 학술정보를 수집·보존하고 이용시키는 주체가 되어야 한다. 이것은 실물자료의 소장패러다임과 전자출판물의 접근패러다임을 동시에 수용하고 강화해야 한다는 의미이다. 이처럼 대학의 예산부담과 도서관의 기능강화 사이의 간극을 좁히려면 총체적 평가작업이 선행되어야 하고, 그 요체는 평가지표의 개발이다. 그래서 본 연구는 대학도서관 평가지표 또는 성과지표 (척도)의 다의성을 체계적으로 고찰하고, 그 바람직한 지향성을 모색하였다.

• 대한영양사협회학술지
• /
• 제18권4호
• /
• pp.326-343
• /
• 2012

This study has attempted to collect actual spot's opinions and analyze importance-performance of indicators for the evaluation of hospital nutrition department. The results of this research were as follows: first, the average score of self-estimated performance was 3.75 based on a 5-point scale. The degrees of importance of hospital foodservice and nutrition department management were in the range of 3.71~4.85 out of 5.0 and the mean importance degree score was 4.37. Second, the average score of self-estimated performance in each category was significantly higher in the case of general special hospital compared to general hospital. Especially average performance score of nutrition management in the general special hospital was higher than that of general hospital (P<0.001). The average performance score of the hospital with more beds was significantly higher than that with less beds. Contract managed hospital's score was significantly higher than that of self-operated hospital in two categories, "facilities management" and "nutrition management" (P<0.05, P<0.01). In foodservice and nutrition management of task-separated hospitals, the average performance scores were significantly higher than those of not-separated hospitals (P<0.01, P<0.001). Third, according to the importance-performance analysis of recognition about indicators for the hospital nutrition department's operations evaluation, 'foodservice facilities management' and 'foodservice sanitation management' were in 'doing great', 'nutritional management' and 'operational management' were in 'low priority', and 'other foodservice management' was in 'overdone'. In conclusion, there's a need for institutional specific standards of sanitation for Korean hospital foodservice.

• International Journal of Quality Innovation
• /
• 제8권3호
• /
• pp.156-172
• /
• 2007

The high-tech industry is the economic lifeline for Taiwan. Its characteristics are short product life cycle, rapid changes in the market, and a high obsolescence rate for new products. Under globalization, the high-tech industry has adopted Information Technology (IT) to shorten the manufacturing process, reduce costs and conduct product research and development (R&D) to increase the core competence of enterprises and achieve the goal of sustainable operations. Enterprises should actively strengthen their integration with internal and external resources and lead in R&D management to increase industrial operating performance. Effectively managing operations and R&D management evaluation in Taiwan's High-tech Industry has become a critical subject. This study adopted 4 major Balanced Scorecard (BSC) perspectives to establish the Total Performance Evaluation Indicators for the R&D management department in Taiwan's High-tech Industry. The Analytic Network Process (ANP) was applied to evaluate the overall performance of the R&D management department. The research framework is divided into 2 phases. The first phase is combined with the 4 major perspectives, Financial, Customer, Internal Business Process and Learning and Growth, as the related indicators for each measurement perspective. The Key Performance Indicators (KPI) were selected using Factor Analysis to identify the key factor from the complicated indicators. The relationship between the characteristics of each BSC's evaluation perspective is dependence and feedback. This study applied ANP to conduct the calculation and adjustment of correlation between each KPI, and determine on their relative weights for the objective KPI. The "Financial Perspective" for R&D management department in Taiwan's High-tech Industry focused on the budget achievement rate of R&D management. The weight indicator value is (0.05863). The "Customer Perspective" focused on problem-solving satisfaction. The weight value of this indicator is (0.17549). The "Internal Business Process Perspective" focused on the quantity and quality of R&D. The weight value of this indicator is (0.13506). The "Learning and Growth Perspective" focused on improving competence in the research personnel's professional techniques. The weight value of this indicator is (0.02789). From the total weighting indicators, the order of the Performance Indicators for the R&D management department in Taiwan's High-tech Industry is: (1) Customer Perspective; (2) Internal Business Process Perspective; (3) Financial Perspective; and (4) Learning and Growth Perspective.

• 한국경영과학회지
• /
• 제40권1호
• /
• pp.185-198
• /
• 2015

This study drew performance management factors analyzed a causal link between acceptance and satisfaction of performance management to present the method for promoting acceptance on the performance management system that most of the public enterprises, government-affiliated organizations are implementing. To achieve this, qualitative analysis and quantitative analysis were conducted in parallel through in-depth case studies and surveys. The results of this study are as follows. First, the analysis of the performance management factors with preceding studies shows that performance management indicators, performance management operations and performance management communications. Second, from the causal relationship of performance management factors affecting performance management acceptance reveals that performance management operation has statistical significance. Third, the analysis of the effect of performance management factors on the management satisfaction shows that operation and indicator of the performance management have statistical significance and reflecting the performance indicators to business, adequacy of target level, training, system support and CEO's Leadership have been revealed as important variables to the management satisfaction. Fourth, the result of the analysis on casual connection between acceptance and satisfaction of the performance management shows that improving management acceptance has a direct impact on satisfaction because performance management receptiveness were deemed statistically significant. Fifth, the result of the in-depth case studies on improving performance management acceptance shows that public enterprises have been putting in an effort to design indicators and try to encourage internal member's involvement during the monitoring and evaluation. The quantitative analysis based on survey has turned out that performance management operation and performance management indicators have statistical significance. The qualitative analysis by in-depth analysis shows that public enterprises put a lot of effort to performance management indicators and communication between internal members. As a result, commitment to performance management operation is required to improve the performance management acceptance. In other words, a detailed implementation plan for training, information system support, and CEO's leadership has to be established and ought to be pushed.