• International conference on construction engineering and project management
• /
• 2009.05a
• /
• pp.1453-1462
• /
• 2009

It is very important for performance of information system that we make an effort to raise user's satisfaction by continuously grasping user's requirement by evaluation of PMIS based on ASP service quality and reflecting this to information system. However, It is lack that developments of suitable evaluation index of PMIS based on ASP service quality. Hereupon, In this study, we propose the evaluation indicators. First, The evaluation area is classified by form the foundation of D & M IS Success Model (2003); system quality, information quality, service quality. Second, The detail evaluation item which include considerations which are gotten through investigation of the construction industry and PMIS based on ASP is grouping by form the foundation SERVQUAL which is a service quality evaluation tool proposed PZB(1988). It is suitable to evaluate PMIS based on ASP service quality in construction industry and able to evaluate various aspects.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.8
• /
• pp.527-535
• /
• 2016

In the information systems literature from Korea, there has not been much research on formative constructs. It is crucial to establish a proper relationship between constructs and indicators. In other words, it is fundamental to specify reflective or formative constructs in evaluating performance as closely as possible to reality, and in testing the appropriateness of a proper causal model. One purpose of this study is that, through a comprehensive literature review, reflective and formative indicators are accurately understood, and a proper specification and development methodology is applied to the information system evaluation field. In addition, this study provides a useful guideline for developing formative indicators for performance evaluation of informatization programs. The following activities were undertaken to achieve the aforementioned purposes. First, the basic theories and preceding study models on successful factors of informatization programs and performance evaluations were reviewed, and a comprehensive interdisciplinary literature review was conducted to better understand the formative constructs. Lastly, we provide a construct for performance evaluation of informatization programs and evaluation indicators, as well as guidelines for specifying them. Therefore, by systematically specifying proper constructs, future domestic researchers can develop better constructs for performance evaluation of informatization programs.

• Journal of Practical Engineering Education
• /
• v.16 no.3_spc
• /
• pp.309-325
• /
• 2024

The purpose of this study was to develop self-evaluation criteria for objective verification and performance analysis of LINC 3.0. To achieve this goal, evaluation indicators in the fields of human resources development and skill development and commercialization were developed and their validity was verified. We investigated previous evaluation-related studies and similar cases to construct an evaluation model and system and develop indicators. The validity of the developed evaluation indicators was secured through two round Delphi surveys. As a result of the research, LINC 3.0 evaluation indicators can be divided into the field of human resources development and skill development and commercialization. A total of 66 evaluation indicators were developed. CIPP in the field of human resources development was developed with 13 categories and 38 evaluation indicators, and CIPP in the field of skill development and commercialization was developed with 12 categories and 28 evaluation indicators. The significance of this study is that it suggests a way to increase the objective verification and validity of the university industry-academia cooperation model by developing self-evaluation indicators for the LINC 3.0 project. The evaluation indicators developed in the research need to be continuously upgraded based on field usability, and it is necessary to improve the quality and competitiveness of university education by sharing and spreading excellent affairs.

• Journal of the Korean Society for Library and Information Science
• /
• v.48 no.3
• /
• pp.303-334
• /
• 2014

This study aims to develop standard indicators and methodology for college & university libraries' evaluation based on the agreement among various stake-holders, then suggests a new evaluation system. For the goal, we identify purposes and required conditions, then develop indicators for the evaluation through open-ended interviews, a questionnaire survey, and focus group for reaching an agreement on the included indicators among the stake-holders, finally we construct the overall evaluation structure and weighting system. The overall structure is developed based on process-centered approach, then both the internal and functional viewpoint and external and service-oriented viewpoint are considered. The weighting system is based on the balance among the process categories, such as resources, process, and output elements. Additionally, we suggest methodology for the evaluation and annual improvement process for ongoing improvement of the evaluation system. We expect that the results from this study will contribute not only to the evaluation activities but also to active discussions on library performance and its predictor factors.

• Journal of IKEEE
• /
• v.24 no.3
• /
• pp.743-753
• /
• 2020

In this paper, we propose a set of robustness indicators for immersive 360-degree video. With the full-fledged service of mobile carriers' 5G networks, it is possible to use large-capacity, immersive 360-degree videos at high speed anytime, anywhere. Since it can be illegally distributed in web-hard and torrents through DRM dismantling and various video modifications, however, evaluation indicators that can objectively evaluate the filtering performance for copyright protection are required. In this paper, a robustness indicators is proposed that applies the existing 2D Video robustness indicators and considers the projection method and reproduction method, which are the characteristics of Immersive 360-degree Video. The performance evaluation experiment has been carried out for a sample filtering system and it is verified that an excellent recognition rate of 95% or more has been achieved in about 3 second execution time.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.31 no.4
• /
• pp.763-777
• /
• 2021

Information security started as an IT operation process and is now recognized as an important issue of information technology, and each international organization is newly defining the concept. Information security itself is a new combination of IT technologies, a set of technologies and a technology area. As IT outsourcing becomes common in many public sectors, SLAs are introduced to evaluate the level of IT services. In the area of information security, many studies have been conducted on the derivation and selection of SLA performance indicators, but it is difficult to find a way to apply the performance indicators to service level evaluation and performance systems. This thesis conducted a study on the application of a service evaluation system for information security performance indicators based on the public sector and a performance system including compensation regulations. It presents standards and rewards(incentive and penalty) that define expectation and targets of performance indicators that take into account the environment and characteristics of a specific public sector, and defines appropriate SLA costs. It proposes a change plan for the organizational structure for practical SLA application and service level improvement.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.19 no.1
• /
• pp.113-130
• /
• 2008

Performance indicators for academic libraries in Korea suggested in this research cover three areas, that is, collection, budget, and human resources, which consists of three subdivisions, respectively. Performance indicators and action plans in this research were prepared, based on the official documents which universities in Korea formally submitted to the Ministry of Education and Human Resources, and the data published by the related institutions. Performance indicators and action plans are intended to draw attentions of university administrators and headquarters, but do not require librarians to prepare for evaluation. The better results would be expected with the development and application of both quantitative and qualitative indicators for information services by standardizing and unifying the process of collecting statistics. It is also expected that periodic and continuing evaluation of academic libraries could help government and universities have a better understanding of and appreciate the significance of academic libraries.

• Journal of Information Science Theory and Practice
• /
• v.4 no.1
• /
• pp.21-29
• /
• 2016

Given the difference in research performance in various scientific fields, this study aims to weight and valuate current indicators used for evaluation of scientific productions (publications), in order to adjust these indicators in comparison to each other and make possible a more precise evaluation of scientific productions. This is a scientometrics study using documentary, evaluative, and survey techniques. The statistical population consisted of 106 top Iranian researchers, scientists, and scientific and research managers. Then their research résumé information was gathered and analyzed based on research questions. In order to compare values, the data gathered from research production performance of the population was weighted using Shannon entropy method. Also, the weights of each scientific production importance according to expert opinions (extracted from other works) was analyzed and after adjustment the final weight of each scientific production was determined. A pairwise matrix was used in order to determine the ratios. According to the results, in the area of engineering sciences, patents (0.142) in the area of science, international articles (0.074) in the area of humanities and social sciences, books (0.174), and in the area of medical sciences, international articles (0.111) had the highest weight compared to other information formats. By dividing the weights for each type of publication, the value of each scientific production compared to other scientific productions in the same field and productions of other fields was calculated. Validation of the results in the studied population resulted in very high credibility for all investigated indicators in all four fields. By using these values and normalized ratios of publication indicators it is possible to achieve precise and adjusted results, making it possible to feasibly use these results in realistic policy making.

• Korean Journal of Construction Engineering and Management
• /
• v.19 no.2
• /
• pp.83-95
• /
• 2018

The aim of this paper is to develop a performance evaluation model for PPP (Public-Private Partnership) projects that appropriately reflects the important traits that are unique to PPP projects. To this end, 1) it defines a set of distinct perspectives involved in the PPP projects and their associated success factors that might differ amongst the perspectives; 2) it identifies the key performance indicators and suggests the performance evaluation criteria for each indicator; and 3) it builds a performance evaluation model by matching the success factors from each perspective with performance measure criteria as well as applies the model to the two selected BTO road projects in Korea. The process of model construction and its application confirms significant differences between the main stakeholder perspectives typically involved in PPP projects, which highlights the need for an evaluation model tailored for PPP projects by taking into account the distinct perspectives. The results from the PPP evaluation model developed in the study is compared against the results from the existing ex-post evaluation model for construction projects in general. The former shows a closer match with the results from the user satisfaction survey conducted. This new evaluation framework and the performance indicators entailed in it permits a balanced evaluation of PPP projects as it takes into account different perspectives involved in PPP projects as well as an understanding of the factors affecting the success of PPP projects. While the construction of the model is based on transport projects, it is applicable to different types of PPP projects through variation with the weight allocation amongst different success factors and/or additions or other adjustments to the performance evaluation criteria as required.

• Journal of Korean Society for Quality Management
• /
• v.50 no.2
• /
• pp.183-197
• /
• 2022

Purpose: The purpose of this study is to develop a quantitative evaluation model for the defense quality management system and suggest institutionalization plans. To this end, another existing evaluation model was reviewed and analyzed to develop a quantitative evaluation model applicable to military institutions. Methods: In this study, in order to establish a DQMS quantitative evaluation model, a military product quality level survey model and a defense quality model operated in the defense field were analyzed. In addition, evaluation models and indicators were analyzed by investigating evaluation models operated by other institutions and private sectors. Results: As a result of the study, the total score of the DQMS model was 1,000 points, 600 points for maturity level indicators and 400 points for operation performance indicators, and the evaluation items consisted of 7 major categories and 25 middle categories. The maturity level index 600 points are 70 points for organizational situation, 60 points for leadership, 40 points for planning, 100 points for support, 180 points for operation, 90 points for performance evaluation, and 60 points for improvement. Conclusion: It will be easy to quantify and evaluate the operating level of DQMS certified companies through the application of the DQMS quantitative evaluation model and evaluation criteria presented in this study. As a result, it will be possible to grasp the level of quality management system and the areas of improvement, and the overall level of improvement can be expected by inducing voluntary improvement activities through sharing of best practices and identifying improvement cases.