• Title/Summary/Keyword: performance evaluation indicators

Search Result 432, Processing Time 0.022 seconds

Development of Formative Constructs and Measurements for Performance Evaluation of Information Systems (정보시스템 성과평가를 위한 형성적 구성변수(Constructs) 및 측정지표 개발)

  • Kim, Sanghoon;Kim, Changkyu
    • Journal of Information Technology Services
    • /
    • v.11 no.4
    • /
    • pp.135-151
    • /
    • 2012
  • Traditionally in IS studies, the relationship between construct and its measurement items tends to be assumed to be reflective, meaning that the measurements are a reflection of the construct. In reality, however, the nature of the construct can be often formative, which means that its measurement items describe and define the construct rather than vice versa. The purpose of this study was to investigate theoretical and empirically-analysed differences between formative construct and reflective construct through comprehensive interdisciplinary literature review. And then on the basis of these differences, we intended to derive the rule of specifying whether the construct is formative or reflective and propose the methodology of testing the validity(content validity, construct validity, internal consistency and external construct) of formative construct and its measurements, differentiated from that in the case of reflective construct. Also, we suggested the concrete statistical testing methods such as VTT(Vanishing Tetrad Test), MIMIC(Multiple Indicators and Multiple Causes) test and multi-collinearity test. In order to examine the applicability of this methodology to developing the constructs for performance evaluation of IS(Information Systems), we tried to identify its attribute(formative or reflective) and test the validity for the construct arbitrarily chosen among them which had been derived in our previous IS performance evaluation study by using this methodology. The result of the examination was that the methodology proposed in this study was significantly valid and effective in the area of IS performance evaluation.

Structural Dashboard Design for Monitoring Job Performance of Internet Web Security Diagnosis Team: An Empirical Study of an IT Security Service Provider

  • Lee, Jung-Gyu;Jeong, Seung-Ryul
    • Journal of Internet Computing and Services
    • /
    • v.18 no.5
    • /
    • pp.113-121
    • /
    • 2017
  • Company A's core competency is IT internet security services. The Web diagnosis team analyzes the vulnerability of customer's internet web servers and provides remedy reports. Traditionally, Company A management has utilized a simple table format report for resource planning. But these reports do not notify the timing of human resource commitment. So, upper management asked its team leader to organize a task team and design a visual dashboard for decision making with the help of outside professional. The Task team selected the web security diagnosis practice process as a pilot and designed a dashboard for performance evaluation. A structural design process was implemented during the heuristic working process. Some KPI (key performance indicators) for checking the productivity of internet web security vulnerability reporting are recommended with the calculation logics. This paper will contribute for security service management to plan and address KPI design policy, target process selection, and KPI calculation logics with actual sample data.

A Study on Detection Performance Comparison of Bone Plates Using Parallel Convolution Neural Networks (병렬형 합성곱 신경망을 이용한 골절합용 판의 탐지 성능 비교에 관한 연구)

  • Lee, Song Yeon;Huh, Yong Jeong
    • Journal of the Semiconductor & Display Technology
    • /
    • v.21 no.3
    • /
    • pp.63-68
    • /
    • 2022
  • In this study, we produced defect detection models using parallel convolution neural networks. If convolution neural networks are constructed parallel type, the model's detection accuracy will increase and detection time will decrease. We produced parallel-type defect detection models using 4 types of convolutional algorithms. The performance of models was evaluated using evaluation indicators. The model's performance is detection accuracy and detection time. We compared the performance of each parallel model. The detection accuracy of the model using AlexNet is 97 % and the detection time is 0.3 seconds. We confirmed that when AlexNet algorithm is constructed parallel type, the model has the highest performance.

A Study on Development of Balanced Scorecard System of Reverse Logistics Industry (회수물류업의 BSC(Balanced Scorecard) 시스템 개발)

  • Yun, Jun-Seop;Seo, Byeong-Ryun;Yang, Gwang-Mo;Gang, Gyeong-Sik
    • Proceedings of the Safety Management and Science Conference
    • /
    • 2008.04a
    • /
    • pp.333-337
    • /
    • 2008
  • The Balanced scorecard has been evolved in various function. In the various functional Balanced scorecard, this paper focuses on the reverse logistics BSC, and the decision the weights of Key Performance Indicators. In this paper, a combination of Balanced scorecard and value evaluation based approach proposed multi-criteria provides a more accurate representation of the problem for measuring company.

  • PDF

A Study on the Development Model and Establishment of KPIs for the Realization of Social Value in Port Authority (항만공사의 사회적 가치 실현을 위한 추진모델과 평가지표 구축연구)

  • Kim, Seung-Chul;Pyo, Hee-Dong
    • Korea Trade Review
    • /
    • v.43 no.6
    • /
    • pp.193-214
    • /
    • 2018
  • The role of social value in public institutions has recently been emphasized. The purpose of this paper is to present key performance indicators(KPIs) and a development model for the realization of social value for port authorities. KPIs that could be quantitatively measured are presented with the five social value assessment indicators of the government management evaluation system for public institutions. Through the analysis of vision, mission and social value promotion strategies and stakeholders for each port authority, the concept of a customer-specific social value model is presented.

The Applicability Evaluation of UV Indicators in the Exhibition Environment (전시환경에 대한 자외선 지시카드 적용성 평가)

  • Lim, BoA;Shin, EunJeong;Kim, MyoungNam;Lee, SunMyung
    • 보존과학연구
    • /
    • s.33
    • /
    • pp.85-97
    • /
    • 2012
  • In this study, reliability assessment was carried out on UV(ultraviolet) indicators for the application of the indicator method on cultural heritages. As a result, some UV indicators(L, K, and M) proved to be unsuitable due to their low reactivity to UV and high reactivity to RH(relative humidity). On the other hand, indicator S showed considerable color changes and fading due to UV-B and UV-C according to the integral amount of UV irradiation. Indicator S showed the most distinct reaction to UV and a remarkable applicability to exhibition light, which are used in museums. Therefore, UV indicator S is an easy and useful monitoring tool for light environment management in cultural- property conservation facilities.

  • PDF

Comparison of Image Classification Performance in Convolutional Neural Network according to Transfer Learning (전이학습에 방법에 따른 컨벌루션 신경망의 영상 분류 성능 비교)

  • Park, Sung-Wook;Kim, Do-Yeon
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.12
    • /
    • pp.1387-1395
    • /
    • 2018
  • Core algorithm of deep learning Convolutional Neural Network(CNN) shows better performance than other machine learning algorithms. However, if there is not sufficient data, CNN can not achieve satisfactory performance even if the classifier is excellent. In this situation, it has been proven that the use of transfer learning can have a great effect. In this paper, we apply two transition learning methods(freezing, retraining) to three CNN models(ResNet-50, Inception-V3, DenseNet-121) and compare and analyze how the classification performance of CNN changes according to the methods. As a result of statistical significance test using various evaluation indicators, ResNet-50, Inception-V3, and DenseNet-121 differed by 1.18 times, 1.09 times, and 1.17 times, respectively. Based on this, we concluded that the retraining method may be more effective than the freezing method in case of transition learning in image classification problem.

A Study on Economic Measurement Model of R&D Project Performance (R&D 프로젝트 성과의 경제적 가치 측정 모델 연구)

  • Kim, Young-Myoung;Sung, Hankyu
    • Journal of Technology Innovation
    • /
    • v.21 no.1
    • /
    • pp.229-252
    • /
    • 2013
  • The aim for this study is to suggest a practical model to measure the financial values of the achievements from corporate research and development(R&D) projects. Performance indicators for R&D projects were identified from the extensive literature reviews and the evaluation methods to convert them into financial values were proposed to overcome the problems of excessive predictions and subjective expert assessments in existing methods. The proposed model was applied to R&D projects of an IT company in Korea for its validity test. The model is expected to be a turning point in economic evaluation of corporate R&D projects in general due to its practical and reasonable scheme.

  • PDF

A Study on Informatization Performance Management: A Case of Defense Informatization Policy Evaluation (정보화 성과관리방안 연구: 국방정보화 정책평가 사례를 중심으로)

  • Lee, Hanjun;Kim, Sungtae
    • The Journal of Society for e-Business Studies
    • /
    • v.25 no.2
    • /
    • pp.29-48
    • /
    • 2020
  • For the visualization of outcome is relatively limited in informatization filed especially, systematic and quantifiable performance management of IT projects and policies is needed. Thus, the government developed its informatization evaluation system and has reinforced it. And Ministry of National Defense (MND) continues to strive for the settlement of the informatization performance evaluation system as well. According to Defense Informatization Law which was legislated in 2011, informatization policies should be assessed annually through informatization policy evaluation system in terms of their enforcement and outcome. However, informatization policy evaluation has not carried out since its pilot enforcement just after the legislation of the law. Hence, we conducted informatization policy evaluation aimed at performance investigation of 31 policies in '14~'18 Defense Informatization Master Plan. We sophisticated the current informatization policy system and we provide guidelines and tools to support the development of performance goal and indicators for each of the policies. Then, the policies were assessed by the evaluation committee we organized for our study, and we analyzed the problems we tackled in the whole process of evaluation and provided proposals for effectiveness enhancement of defense informatization evaluation system. The proposals will be meaningful for performance management in defense informatization sector and in public informatization sector as well.

A Performance Evaluation Framework for e-Clinical Data Management (임상시험 전자자료 관리를 위한 평가 프레임웍)

  • Lee, Hyun-Ju
    • Journal of Internet Computing and Services
    • /
    • v.13 no.1
    • /
    • pp.45-55
    • /
    • 2012
  • Electronic data management is getting important to reduce overall cost and run-time of clinical data management with the enhancement of data quality. It also critically needs to meet regulated guidelines for the overall quality and safety of electronic clinical trials. The purpose of this paper is to develop the performance evaluation framework in electronic clinical data management. Four key metrics in the area of infrastructure, intellectual preparation, study implementation and study completion covering major aspects of clinical trial processes are proposed. The performance measures evaluate the extent of regulation compliance, data quality, cost and efficiency of electronic data management process. They also provide measurement indicators for each evaluation items. Based on the key metrics, the performance evaluation framework is developed in three major areas involved in clinical data management - clinical site, monitoring and data coordinating center. As of the initial attempt how to evaluate the extent of electronic data management in clinical trials by Delphi survey, further empirical studies are planned and recommended.