• Title/Summary/Keyword: evaluation analysis

Search Result 25,729, Processing Time 0.052 seconds

Quality Analysis of the Request for Proposals of Public Information Systems Project : System Operational Concept (공공정보화사업 제안요청서 품질분석 : 시스템 운영 개념을 중심으로)

  • Park, Sanghwi;Kim, Byungcho
    • Journal of Information Technology Services
    • /
    • v.18 no.2
    • /
    • pp.37-54
    • /
    • 2019
  • The purpose of this study is to present an evaluation model to measure the clarification level of stakeholder requirements of public sector software projects in the Republic of Korea. We tried to grasp the quality of proposal request through evaluation model. It also examines the impact of the level of stakeholder requirements on the level of system requirements. To do this, we analyzed existing research models and related standards related to business requirements and stakeholder requirements, and constructed evaluation models for the system operation concept documents in the ISO/IEC/IEEE 29148. The system operation concept document is a document prepared by organizing the requirements of stakeholders in the organization and sharing the intention of the organization. The evaluation model proposed in this study focuses on evaluating whether the contents related to the system operation concept are faithfully written in the request for proposal. The evaluation items consisted of three items: 'organization status', 'desired changes', and 'operational constraints'. The sample extracted 217 RFPs in the national procurement system. As a result of the analysis, the evaluation model proved to be valid and the internal consistency was maintained. The level of system operation concept was very low, and it was also found to affect the quality of system requirements. It is more important to clearly write stakeholders' requirements than the functional requirements. we propose a news classification methods for sentiment analysis that is effective for bankruptcy prediction model.

Influence of Goal Ambiguity in Institutional Evaluation of Government-funded Research Institutes (정부출연연구기관의 기관평가에서 목표 모호성의 영향에 관한 연구)

  • Koo, Hoonyoung
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.43 no.4
    • /
    • pp.84-92
    • /
    • 2020
  • In order to analyze the organizational performance of government-funded research institutes, four independent variables (organization size, organization age, evaluation system, organization location) and goal ambiguity were empirically analyzed. Although there are existing studies on institutional evaluation, which is the organizational performance of government-funded research institutes, there are differences in research in that it is an empirical analysis analyzed from the perspective of goal ambiguity and that the evaluation system, which is the specificity of institutional evaluation, is included in the analysis. As a result of the analysis, organizational location was the only independent variable that had a direct significant effect on organizational performance, and goal ambiguity showed a significant mediating effect for all independent variables. This indicates that goal ambiguity plays an important role in the organizational performance of government-funded research institutes, and to reduce this, increase the size of the organization, pay attention to establishment of the organization for organizational age, and that it is desirable to have an independent research group in the government department for the organization location. In addition, it was supported that the improvement effect of the evaluation system is proceeding in a desirable direction in terms of goal ambiguity.

Comparative Analysis on the Evaluation Systems of the Public R&D Programs in the Developed Countries (선진국공공연구개발프로그램 평가시스템의 비교분석)

  • 홍형득
    • Journal of Korea Technology Innovation Society
    • /
    • v.4 no.3
    • /
    • pp.275-290
    • /
    • 2001
  • The frameworks for evaluation of national R&D programs reflect their various political and administrative cultures(Gibbons & Georghiou, 1987), and the structure of national R&D system. In this research the core research questions are : what is god evaluation\ulcorner What is being evaluated, by whom, by which criteria, for whom and what purpose\ulcorner In order to examine these general aims and answer these questions, in detail several objectives can be proposed on the process of this research. In this research, the national R&D programs will be considered in terms of the interface between evaluation and the wider policy-making process. The programs for case study are the Alvey program(UK), the Advanced Technology Program (US) and the Framework program(EU) . One of the characteristics of these programs is the well established evaluation systems they have. From the comparative analysis, we can withdraw some useful implication for Korean evaluation practice for national R&D programs. Evaluation system is social process and the way in which it is organized is critical to its outcome.

  • PDF

Developing an Evaluation Model of Webcasting Sites (웹캐스팅 사이트 평가모델 개발)

  • Suh, Yung-Ho;Lee, Hyun-Soo
    • Asia pacific journal of information systems
    • /
    • v.11 no.3
    • /
    • pp.43-62
    • /
    • 2001
  • The purpose of this research is to develop a webcasting site evaluation model, to estimate the relative importance of factors affecting the performance of webcasting sites, and to derive the CSFs of the sites. Evaluation model consists of 6 first-level evaluation factors and 23 second-level evaluation factors. This study compares the evaluation scores of website with those of the customer satisfaction. We inspect seven hypotheses. Hypothesis)(H1) tests correlation of the evaluation scores of website and those of the customer satisfaction. Hypothesis2(H2)$\sim$Hypothesis7(H7) tests if 6 first-level factors(planning, program & form, design, technology, interface, content) have an impact on customer satisfaction. In order to test the hypotheses, correlation analysis and regression analysis are performed. As a result of empirical tests, all Hypotheses$(H1){\sim}H7)$ are accepted and its implications are discussed.

  • PDF

Application of the Analytic Hierarchy Process (AHP) on the National Nuclear R&D Projects (원자력연구개발사업의 사후평가를 위한 계층화 분석법(AHP)의 적용)

  • 곽승준;유승훈;신철오
    • Proceedings of the Korea Technology Innovation Society Conference
    • /
    • 2001.05a
    • /
    • pp.369-385
    • /
    • 2001
  • A R&D project evaluation method has been applied for the national nuclear R&D projects in a developing-country setting. In the methodology, Saaty's analytic hierarchy process model is used to evaluate and rank of the selected nuclear R&D project which have a wide range of objectives and characteristics. The criteria used for evaluation related specifically to the Korea's evaluation needs and culture, and they are weighted according to their relative importance as perceived by the evaluator of the R&D project. As a real-world case of evaluation, we elicited and reproduced the evaluation process of the nuclear R&D projects which is going under the research process. As the results of the paper suggests, the methodology can be applied to the evaluation of the R&D projects and has much potential.

  • PDF

The Credit Evaluation System for Micro-small Sized Individual Firms Using the Analytic Hierarchy Process (AHP 모형을 활용한 소상공인 신용평가시스템 구축)

  • Lee, Ju-Min;Kim, Seung-Yeon;Ha, Eun-Ho;Roh, Tae-Hyup
    • The Journal of Information Systems
    • /
    • v.16 no.3
    • /
    • pp.109-132
    • /
    • 2007
  • In the paper, we builds an advanced new credit evaluation system for Micro-small sized individual firms through appropriate evaluation factors derived by logistic regression analysis for credit evaluation model using in Korean Federation of Credit Guarantee Foundations, and the weights of factors computed by analytic hierarchy process(AHP). Industry characteristics are more applied to previous credit model with the additional the financial fact-information and non-financial judgement-information. Our results show that the financial factors have become more important than three years ago. Moreover, in the non-financial factors, the fact-information factors consider more important then the judgement-information factors. A new credit evaluation system is developed based on this credit evaluation model.

  • PDF

A Comparative Analysis of Evaluation Methodologies for Railway Investments of China and Korea

  • Sun Sunduck D.
    • Proceedings of the KOR-KST Conference
    • /
    • 1998.09a
    • /
    • pp.65-70
    • /
    • 1998
  • Economic evaluation methodologies for railway investments of China and Korea are comparatively analyzed. Chinese procedures specified in the new economic evaluation manual of 1997 were compared with those of Korea based on the economic evaluation manual of 1982. As expected those procedures reflect general economic requirements of the respective countries. Several differences in the specification are also noted. Details of the specification of Chinese procedure far exceed Korean specification, while Korean manual is rich of explanation on the fundamental theory. Differences in the procedure of calculating benefits of investments are most conspicuous, and specific requirements of carrying out a optimum opening year analysis in Korean procedure is notable. Despite of these differences in the procedure, two methodologies share same objective of ensuring selection of economically and financially sound railway projects. Both procedures of China and Korea, however, limit their evaluation scope on railways alone. Therefore, they are needed to expand scope of evaluation to encompass the idea of multi-modal or inter-modal evaluation, which will eventually contribute to build truly efficient national comprehensive transportation system.

  • PDF

A study on performance-based evaluation system for NATM tunnels in use: development of evaluation model and validation (공용중인 NATM 터널의 성능중심 평가체계 연구: 평가모형 개발 및 검증)

  • Moon, Joon-Shik;Kim, Hong-Kyoon;An, Jai-Wook;Lee, Jong-Gun
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.22 no.1
    • /
    • pp.107-120
    • /
    • 2020
  • In a performance-based evaluation of structures in use, the current performance is assessed by summing up the weighting of the evaluation indices for each performance. In this study, to suggest a performance-based evaluation technique for NATM tunnels in use, the performance evaluation indices were derived by examining the characteristics and similarities of each index developed from previous study. The weighting of the evaluation indices was derived by calculating the relative importance of each evaluation indices from the AHP analysis. In order to develop a quantitative evaluation model, grading criteria for each performance index was derived through literature review, and performance evaluation tables for road and railway tunnels were presented. In order to verify the significance of the proposed performance evaluation model, the correlation analysis was performed between each evaluation index and the final evaluation result. In the correlation analysis, the survey data measured through precision safety diagnosis in the tunnel in use was applied. It may be said that the proposed evaluation indices, weighting, criteria and evaluation models for tunnels in use can be applied to the performance-based maintenance system of tunnels.

Seismic Performance Evaluation According to Seismic Retrofit Techniques of Existing School Buildings (기존 학교건축물의 내진보강기법에 따른 내진성능평가)

  • Kang, Jong
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.15 no.1
    • /
    • pp.29-36
    • /
    • 2012
  • Reinforced concrete shear walls and X-type steel braces were applied in seismic retrofit techniques for seismic performance evaluation of school buildings constructed in accordance with standard design announced by the ordinance of the ministry of construction in 1980s. Seismic performance evaluation was based on FEMA 356 using response spectrum as elastic analysis and conducted to pushover analysis with nonlinear static analysis. The maximum displacement ratio between floors in 4th and 3rd floors of the existing school buildings was less than 1.0%, which was functioning level in FEMA 356. However, because plastic hinge occurs somewhat in structural members according to the results of pushover analysis, partial reinforcement will be required. X-direction of the maximum lateral displacement of reinforced concrete shear walls than X-type steel braces was 45% and 32% in 4th and 3rd floors of school buildings, and Y-direction was 18% and 17%, respectively.

Construction of Scientific Impact Evaluation Model Based on Altmetrics

  • Li, Jiapei;Shin, Seong Yoon;Lee, Hyun Chang
    • Journal of information and communication convergence engineering
    • /
    • v.15 no.3
    • /
    • pp.165-169
    • /
    • 2017
  • Altmetrics is an emergent research area whereby social media is applied as a source of metrics to evaluate scientific impact. Recently, the interest in altmetrics has been growing. Traditional scientific impact evaluation indictors are based on the number of publications, citation counts and peer reviews of a researcher. As research publications were increasingly placed online, usage metrics as well as webometrics appeared. This paper explores the potential benefits of altmetrics and the deep relationship between each metrics. Firstly, we found a weak-to-medium correlation among the 11 altmetrics and visualized such correlation. Secondly, we conducted principal component analysis and exploratory factor analysis on altmetrics of social media, divided the 11 altmetrics into four feature sets, confirming the dispersion and relative concentration of altmetrics groups and developed the altmetrics evaluation model. We can use this model to evaluate the scientific impact of articles on social media.