• Title/Summary/Keyword: Ex-post Evaluation System

Search Result 18, Processing Time 0.023 seconds

A Case Study of the Discrepancy between Ex Ante and Ex Post Evaluation of IS Performance (정보화 성과의 사전-사후평가 차이에 관한 사례연구)

  • Lee, Kuk-Hie;Park, So-Hyun;Gu, Bon-Jae;Lee, Mi-Young
    • Journal of Information Technology Applications and Management
    • /
    • v.19 no.2
    • /
    • pp.59-78
    • /
    • 2012
  • The purpose of this longitudinal case study is to shed light on the reliability problems of IS performance evaluation by analyzing the discrepancy between ex ante evaluation in 2011 and ex post evaluation in 2012. Through an information system development project of a public enterprise, the gap between ex ante and ex post evaluation was ascertained and the causes as to why such gap occurs and the success factors that can solve the problems were derived. The ex ante evaluation of IS performance was performed based on both IS success model and BSC model and the ex post evaluation was carried out at the time after the target system has been built up by applying the evaluation measures and process that are similar to the ex ante evaluation. In the ex ante evaluation the business performance improved by the target system was estimated to 18.2%. On the other hand, it was seen as being low at 15.2% in the ex post evaluation and the differences were found to be statistically significant in 6 out of 10 measures. The reasons as to why such gap occurs were diagnosed as being of 2 types : (1) changes in the evaluation psychology according to the differences in the evaluation objectives; and (2) excessive expectation levels of the target system that is formed at the time of the ex ante evaluation. In other words, the users who have excessive expectations tend to overestimate in the ex ante evaluation and, in the ex post evaluation, tend to underestimate lower than the actual performance mainly due to disappointment on the results that do not meet the early expectations. As solutions to overcome the reliability problem of ex ante evaluation, 3 factors were derived : (1) the temperance of excessive expectation levels of the users; (2) a clear definition of the scope and functionality of the target system; and (3) actual commitments for the evaluations of IT performance.

Evaluation Criteria of IT Business Value : The Difference Between Ex Ante and Post Implementation Evaluation (IT 비즈니스 가치 평가관점 : 사전-사후 평가시점 및 정보시스템 유형별 차이)

  • Park, So-Hyun;Lee, Kuk-Hie
    • Journal of Information Technology Applications and Management
    • /
    • v.15 no.1
    • /
    • pp.203-224
    • /
    • 2008
  • The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

  • PDF

A Study on Improvement Evaluation of Reliability of Ex-post (사후평가의 평가체계 개선방안에 관한 연구)

  • Jo, Chang-Hee;Kim, Si-Gon;Ahn, Chan-Gi
    • Proceedings of the KSR Conference
    • /
    • 2011.10a
    • /
    • pp.2182-2191
    • /
    • 2011
  • Postmortem evaluation through the dictionary and the lack of points for the wrong strategy to respond to the avoid the prediction is important. However, the prevailing system of ex post facto assessment of postmortem simply does not have statistical figures to be provided only for the conditions. Thus, in this study, rail business is mainly evaluation procedures and evaluation of the verification system of ex post facto evaluation as to the issue, do not improve.

  • PDF

A Study on Establishing the Evaluation System of the Stock Enhancement Program (수산자원조성사업의 합리적인 평가체계 도입 방안에 관한 연구)

  • Kim, Dae-Young;Ryu, Jeoung-Gon;Lee, Jeoung-Sam
    • The Journal of Fisheries Business Administration
    • /
    • v.41 no.1
    • /
    • pp.1-24
    • /
    • 2010
  • The main goal of the study is to propose an objective and standardized evaluation system of stock enhancement programs. In order to achieve this goal, the study first suggested the need for stock enhancement program evaluation system through the review of current status and problems. Second, the study identified possible problems of the existing stock enhancement program evaluation by reviewing domestic and foreign evaluation systems. Finally the study proposed a new evaluation system and implementation plan of it. This study also classified the program evaluation criteria into ex-ante evaluation and ex-post evaluation according to the evaluation point in time, and applied the economic, political and technical feasibility tests into the evaluation of the stock enhancement program in order to solve the current problems of the evaluation. The evaluation process of the stock enhancement program is composed of an evaluation system design, estimation of weights using the analytical hierarchy process, design of estimation standard, conversion of scores and final summary of the evaluation. The central government takes the lead in the evaluation of the regional (metropolitan city or province) projects and the regional government is in charge of the evaluation of the local (city or county) projects. For the implementation of the ex-ante evaluation, either the regional or local governments ask for the evaluation and then submit an evaluation plan and other necessary documents to the upper level governments. The ex-post evaluation is then carried out by the upper level governments.

An Analysis Of The Importance Of The Evaluation Criteria Of The Real Estate Financial Consumer Protection System - Utilizing The AHP Technique (부동산 금융소비자 보호 체계의 평가 기준 간 중요도 분석: AHP 기법을 활용하여)

  • Lee, Yeon-Jae;Shin, Seung-Woo
    • Asia-Pacific Journal of Business
    • /
    • v.13 no.3
    • /
    • pp.227-243
    • /
    • 2022
  • Purpose - This study surveyed real estate financial consumers and financial company staff regarding the components of the financial consumer protection system to seek detailed improvement plans for the Financial Consumer Protection Act. Design/methodology/approach - The Analytic Hierarchy Process (AHP) technique is applied. Findings - Both consumers and staff highly evaluated the importance of the preventive measures in the main classification factors. Regarding the sub-classification factors of preventive measures, consumers emphasized the responsible management of investment staff and financial institutions; however, the staff stressed the principle of effectiveness and efficiency. Regarding the elements of ex-post remedies, consumers answered that fast remedy would have a significant effect. At the same time, staff believed that punitive measures hinder free trading and investment activities. Regarding the sub-sub classification factors of prevention measures, the consumers value responsible management of staff and financial companies, while the staff tend to prefer the importance of the self-regulatory governance. Research implications or Originality - Based on the above results, financial regulatory authorities should find a balance between preventive and ex-post components once focusing on preventative measures. Our paper is one of the first research findings in this field of financial consumer protection system in Korea.

A Study on Adopting an Ex Post Facto Management System and Reforming the Maritime Traffic Safety Audit Scheme (해상교통안전진단 사후관리제도의 도입 및 제도개선에 관한 고찰)

  • Kim, Inchul
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.22 no.7
    • /
    • pp.807-813
    • /
    • 2016
  • The Maritime Traffic Safety Audit Scheme was institutionalized in 2009 to provide for professional surveys, measurement and the evaluation of navigational hazards that might occur in coastal waters in the course of marine work. Related researches that dealt with the reform of the Maritime Traffic Safety Audit Scheme found that there were no rules or regulations for verifying whether marine work conformed to audit results and reviewing the exactitude of ship handling simulations which were a crucial part of the scheme. According to the necessity of adopting an ex post facto management system in the field of maritime traffic, this study analyzed the similar audit acts such as the Natural Environment Impact Audit Scheme and the Road Traffic Safety Audit Scheme, and proposed specific articles for revising Maritime Safety Act in order to break out from the institutional inertia of the current Maritime Traffic Safety Audit Scheme. It is expected that a newly proposed legal system for verifying the performance of audit results and the exactitude of audits will help improve maritime traffic safety by eradicating potentially hidden hazards related to marine work.

A Study on the Improvement of the Effectiveness of Feedback of Government Performance Evaluation (정부업무평가의 환류 효용성 제고방안에 관한 연구)

  • Yuiryong Jung
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.3
    • /
    • pp.541-550
    • /
    • 2024
  • The aim of this study is to find a way to improve the effectiveness of feedback that can contribute to the development of government work evaluation through comparison of systems between Korea and the United States. To this end, this study compared and analyzed the cases of Korea and the United States in relation to the feedback system of political affairs evaluation. In the case of the United States, it was confirmed that it was linked to a relatively high level of the learning dimension of the feedback system of achieving and improving policy goals, while in Korea, such linkage was segmented and controlled. In the case of Korea, it was confirmed that the government work evaluation system was in power, and its purpose was to improve policies and to control the evaluation target rather than learning for it. In the case of the United States, it is noteworthy that the autonomy of its own ministries is guaranteed as much as possible, the clarity and achievement of the goals presented by the ministries are prioritized, and the feedback also has a support and learning system as a regular system, not an ex post system. It is necessary to focus on policy improvement that can be linked to the achievement of policy goals in government work evaluation. It is also necessary to take a quarterly monitoring system, but to transform the ex post evaluation system into a learning and supportive system that can achieve policy goals, not control.

Study on DQI Process of User Involved in U.K. (영국의 사용자 참여형 DQI 프로세스에 관한 연구)

  • Kim, Seung-Je;Kang, Tae-Woong;So, Kab-Soo;Yun, Yong-Gib;Kim, Jong-Hun
    • Journal of the Korean Institute of Educational Facilities
    • /
    • v.17 no.2
    • /
    • pp.23-30
    • /
    • 2010
  • At present, the necessity of new design guidelines, evaluation and operation system for school facilities are on the rise according to re-edition of school curriculum in Korea. Moreover, it is necessary to procedure of the design, an institutional device and an ex post facto evaluation system for school facilities as a public building with the space planning that is suitable for various situations, which are able to collect users' various demands and opinions. Under the present situation, England has introduced and operated DQI system for the users' participation design of its. The present study will derive the meaning DQI system of England and how to operate it, and percuss the possibility of the application of design procedure of the education facilities in Korea.

Directions for Linkages between Policy Measures and the OECD Agricultural Environmental Indicators (OECD 농업환경지표와 정책연계 방안)

  • Kim, Chang-Gil;Kim, Tae-Young
    • Korean Journal of Environmental Agriculture
    • /
    • v.24 no.3
    • /
    • pp.303-313
    • /
    • 2005
  • Agricultural environmental indicators (AEIs) are useful tool for evaluating environmental performance induced by agri-environmental policy measures. General and specific criteria have been set to assess the linkages between policy measures and environmental states. In addition, a number of specific AEIs such as nutrient balance indicators and farm management indicators have been posit to review environmental performance associated with agri-environmental policy measures. The proposed environmental subjects encompass soil quality, qualities of underground and surface water, water resource preservation, species and genetic diversity, diversity for wildlife habitats, and agricultural landscapes. The developed AEIs may contribute to establishment or adjustment of environmental targets and ex-ante or ex-post evaluation for environmental performance associated with policy measures. In addition, the AEIs may be useful to consider introduction of new agri-environmental measures and enhance policy efficiency by assessing environmental performance, considering specific locality, and harmonizing support measures.

Evaluation of different media for ex vivo porcine lung culture model

  • Yang, Myeon-Sik;Zhou, Zixiong;Khatun, Amina;Nazki, Salik;Jeong, Chang Gi;Kim, Won Il;Lee, Sang Myeong;Kang, Seog-Jin;Lim, Chae Woong;Kim, Bumseok
    • Korean Journal of Veterinary Service
    • /
    • v.41 no.4
    • /
    • pp.263-269
    • /
    • 2018
  • Developing drugs targeting respiratory pathogen is essential to control respiratory diseases. Many experiments have been performed under in vivo situation. However, in vivo experiments have economical and ethical issues. The objective of this study was to determine the possibility of developing an ex vivo lung culture system with possible application for respiratory infection studies. After isolating lungs from naïve pigs, agarose-inflated lung tissues were prepared and sliced manually. These sliced lung tissues were then subsequently placed on 24-well plates. Eight different combinations of media were used to determine the optimum ex vivo lung culture condition. In addition, lung tissues were infected with porcine reproductive and respiratory syndrome (PRRS) virus at a titer of $1{\times}10^4\;TCID_{50}/mL$. Virus growth was confirmed by titration in MARC-145 cells at 2, 4, 6 days post infection (dpi). We found that ex vivo lung culture in physiological environment was not media specific based on histopathology and cytotoxicity. However, under virus-infected condition, thickened alveolar walls in the lung tissues and stable virus titers at 2, 4, 6 dpi were shown in F12K medium suggesting that it was useful for tissue maintenance and virus infection using PRRS virus infected lung tissues. The present study shows the possibility of using porcine ex vivo lung model for respiratory infection studies.