• Title/Summary/Keyword: indicators for model evaluation

Search Result 321, Processing Time 0.028 seconds

Development of an Evaluation Model for the Implementation of IMO Instruments (IMO 협약이행에 대한 평가모델 개발)

  • Choi, Choong-Jung;Jung, Jung-Sik;An, Kwang
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.28 no.4
    • /
    • pp.542-548
    • /
    • 2022
  • In order to reduce marine accidents, each contracting Government needs to implement the instruments enacted and amended by the International Maritime Organization (IMO). The III Code requires each administration of the government to have a system for improvement through periodic review and evaluation and to include performance indicators in its evaluation methods. Thus, each IMO Member State needs to develop its own performance indicators. The purpose of this paper is to develop and present an evaluation model using the Balanced Scorecard (BSC) and Key Performance Indicators (KPI) in order to quantify and evaluate the level of implementation of the instruments by the administrations. From the perspective of 'III-BSC', which applies the BSC concept to the III code requirements, the Critical Success Factors (CSF) that must be secured to achieve the established vision were drawn up, and candidate KPIs for each evaluation area were developed to measure the derived key success factors and an initial study model was designed composed of four levels. The validity of the KPIs was verified and the study model was finalized using the survey design using the SMART technique. Furthermore, based on the developed study model, an evaluation model for the implementation of the BSC-based IMO instruments was developed by deriving the weights of elements for each level through AHP analysis. The developed evaluation model is expected to contribute toward improving the administrations' level of implementation of the IMO instruments as a tool for quantitatively grasping the level of performance of the implementation.

Development of Methodology for Evaluation Performance Model of Information Systems (정보시스템 성과 평가 모형 방법론 개발에 관한 연구)

  • Kim, Changkyu;Park, Wonhee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.8
    • /
    • pp.527-535
    • /
    • 2016
  • In the information systems literature from Korea, there has not been much research on formative constructs. It is crucial to establish a proper relationship between constructs and indicators. In other words, it is fundamental to specify reflective or formative constructs in evaluating performance as closely as possible to reality, and in testing the appropriateness of a proper causal model. One purpose of this study is that, through a comprehensive literature review, reflective and formative indicators are accurately understood, and a proper specification and development methodology is applied to the information system evaluation field. In addition, this study provides a useful guideline for developing formative indicators for performance evaluation of informatization programs. The following activities were undertaken to achieve the aforementioned purposes. First, the basic theories and preceding study models on successful factors of informatization programs and performance evaluations were reviewed, and a comprehensive interdisciplinary literature review was conducted to better understand the formative constructs. Lastly, we provide a construct for performance evaluation of informatization programs and evaluation indicators, as well as guidelines for specifying them. Therefore, by systematically specifying proper constructs, future domestic researchers can develop better constructs for performance evaluation of informatization programs.

A Study on Technology Evaluation Models and Evaluation Indicators focusing on the Fields of Marine and Fishery (기술력 평가모형 및 평가지표에 대한 연구: 해양수산업을 중심으로)

  • Kim, Min-Seung;Jang, Yong-Ju;Lee, Chan-Ho;Choi, Ji-Hye;Lee, Jeong-Hee;Ahn, Min-Ho;Sung, Tae-Eung
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.10
    • /
    • pp.90-102
    • /
    • 2021
  • Technology evaluation is to assess the ability of technology commercialization entities to generate profits by using the subject technology, and domestic technology evaluation agencies have established and implemented their own evaluation systems. In particular, the recently developed technology evaluation model in the fields of marine and fishery does not sufficiently reflect the poor environment for technology development compared to other industries, so it does not pass the level of T4 rating, which is considered appropriate for investment. This is recognized as a challenge that occurs when the common evaluation indicators and evaluation scales used in other industries, and when the scoring system for T1 to T10 grading is similarly or identically utilized. Therefore, through this study, we intend to secure the appropriateness and reliability of the results of the comprehensive rating calculation by developing technology evaluation models and indicators that well explain the nine marine and fisheries industry classification systems. Based on KED and technology evaluation case data, AHP-based index weighting and Monte Carlo simulation-based rating system are applied and the results of case studies are verified. Through the proposed model, we aim to enhance the usability of R&D and commercialization support programs based on fast, convenient and objective evaluation results by applying to upcoming technology evaluation cases.

A Study on the Design of Sustainability Evaluation Model Applied to Systems Engineering Technical Process : Focused on the Mobile Industry (시스템엔지니어링 기술 프로세스를 적용한 지속 가능 평가모델 설계 연구 : 모바일 산업 중심으로)

  • Kim, Sang Jin;Cha, Woo Chang
    • Journal of the Korean Society of Systems Engineering
    • /
    • v.17 no.2
    • /
    • pp.9-22
    • /
    • 2021
  • A study on the sustainability evaluation of the requirements of the mobile industry closely related to the human factor was needed. We conducted the sustainability evaluation of the mobile industry using a quantitative evaluation method with the AHP tool and a qualitative evaluation method reflecting the technological age flow of the philosophical thoughts to improve the reliability of the evaluation results of the model verification. And this evaluation is to evaluate the consistency of the connection between the national sustainability and the mobile industry. In order to draw the conclusion of the relevance, the team member Delphi 5-point scale was used. As a result, the priority was confirmed in the national sustainable development indicator and mobile industry indicator. Quantitative and qualitative evaluation was applied to the discontinued model of mobile to derive insufficient indicators, and it was confirmed that if the indicators were improved and reflected, it would be sustainable. And in order to secure reliability and accuracy, we made a proposal to apply the systems engineering process to the development of the model evaluation field. The systems engineering technology process meets the needs and requirements of stakeholders throughout the lifecycle and it is suitable for the development model of the industry's sustainability assessment.

Development of Evaluation Indicators for Determining the Reconstruction of Retired School Facilities (노후학교시설 개축 판별을 위한 평가지표 개발)

  • Meang, Joon-Ho;Kim, Sung-Joon;Song, Byung-Joon;Kim, Jae-Young
    • The Journal of Sustainable Design and Educational Environment Research
    • /
    • v.21 no.4
    • /
    • pp.1-12
    • /
    • 2022
  • The main purpose of this study was to propose an objective basis model for determining business types through renovation and remodeling by quantifying and comprehensively reviewing functional, performance, structural safety, and economic indicators for rational renovation and remodeling of deteriorated school facilities. Delphi analysis and AHP analysis were applied as the main methodologies for setting evaluation indicators, and scores for each evaluation item was allocated based on 34 points in the function and performance fields, 51 points in the structural safety field, and 15 points in the economic field. In the future, judgment on the execution of objective and reasonable reconstruction can be expected, focusing on the evaluation indicator index model, and it is necessary to determine the business type for each target school teacher building through a multi-faceted review of the current status of the target school.

Formalizing the Design, Evaluation, and Analysis of Quality of Protection in Wireless Networks

  • Lim, Sun-Hee;Yun, Seung-Hwan;Lim, Jong-In;Yi, Ok-Yeon
    • Journal of Communications and Networks
    • /
    • v.11 no.6
    • /
    • pp.634-644
    • /
    • 2009
  • A diversity of wireless networks, with rapidly evolving wireless technology, are currently in service. Due to their innate physical layer vulnerability, wireless networks require enhanced security components. WLAN, WiBro, and UMTS have defined proper security components that meet standard security requirements. Extensive research has been conducted to enhance the security of individual wireless platforms, and we now have meaningful results at hand. However, with the advent of ubiquitous service, new horizontal platform service models with vertical crosslayer security are expected to be proposed. Research on synchronized security service and interoperability in a heterogeneous environment must be conducted. In heterogeneous environments, to design the balanced security components, quantitative evaluation model of security policy in wireless networks is required. To design appropriate evaluation method of security policies in heterogeneous wireless networks, we formalize the security properties in wireless networks. As the benefit of security protocols is indicated by the quality of protection (QoP), we improve the QoP model and evaluate hybrid security policy in heterogeneous wireless networks by applying to the QoP model. Deriving relative indicators from the positive impact of security points, and using these indicators to quantify a total reward function, this paper will help to assure the appropriate benchmark for combined security components in wireless networks.

Development of Evaluation Model on Greenspace for Sustainability of Site-scale Development Projects (단지규모 개발사업의 지속가능성 확보를 위한 녹지 평가 모형 개발)

  • 양병이;이관규
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.28 no.2
    • /
    • pp.97-107
    • /
    • 2000
  • This study aims to develop the model of evaluation on greenspace to increase the sustain ability of the planning and management for site-scale development projects. The results of this study can be summarized as follows: (1) The comprehensive principles of sustainable development projects were established, which include coexistence of man and nature, reflection of ecological principles, minimization of environmental pollution and damage, recycling and reuse of materials. (2) According to established principles, the evaluation criteria were classified into seven categories as follows: retention of ample greenspace, formation of greenspace as a habitat, species diversity of vegetation, consideration of indigenous plants, construction of green network, conservation of greenspace, and reuse of plant materials. (3) As a result of the analysis of questionnaire of experts, evaluation model was worked out with which we can evaluate environmental friendliness greenspace. And, the final evaluation indicators for greenspace are the rate of greeneries volume, securing habitat, indigenous plants, reuse of plant materials, and species diversity of vegetation, and the indicator of greenspace conservation.

  • PDF

A Study on Application and Development of Evaluation Indicator for Parking Environments in Residential Areas Using AHP (AHP분석기법을 이용한 주거지역의 주차환경 평가지표 개발 및 적용에 관한 연구)

  • WON, Donguk;KIM, Young Jun;LEE, Jinkak
    • Journal of Korean Society of Transportation
    • /
    • v.35 no.5
    • /
    • pp.375-384
    • /
    • 2017
  • The aim of this study is to develop evaluation indicators for parking environment in residential areas. Recently, lots of local governments in korea are implementing projects for parking environment improvement. However, there are no indicators for parking environment evaluation except for the rate of parking supply by registered cars. So, it is really difficult to prioritize projects and monitor the result of projects. Therefore, this study presents six indicators for parking environment evaluation and its weights using AHP through the survey. The result of this study proposed the assessment model for parking environment based on indicators and it was found that actual data in Incheon can be simulated in reality. And this result also is expected to help monitoring and selecting projects.

Activity Capability Level-based Maturity Evaluation Model for Public Data Quality Management (활동능력수준 기반의 공공데이터 품질관리 성숙수준 평가 모델)

  • Kim, Sun-Ho;Lee, Jin-Woo;Lee, Chang-Soo
    • Informatization Policy
    • /
    • v.24 no.1
    • /
    • pp.30-47
    • /
    • 2017
  • The Korean government developed an organizational maturity model for public data quality management based on international standards to evaluate the data quality management level of public organizations, However, as the model has too many indicators to apply on the site, a new model with reduced number of indicators is proposed in this paper. First, the number of processes is reduced by integrating and modifying the processes of the previous model. Second, a new maturity evaluation method is proposed based on capability levels focused on the activity, not on the process. Third, the maturity level of public data quality management is represented by five discrete levels or real values of 1 through 5. Finally, characteristics of the proposed model are compared with those of the previous model.

The Service Evaluation of Connection and Transfer Facilities in the High-speed Railway Stations (고속철도역의 연계환승시설 서비스 수준 평가)

  • Han, Sung-Yoeb;Kim, Kang-Seob;Park, Min-Kyu;Kim, Si-Gon
    • Proceedings of the KSR Conference
    • /
    • 2009.05a
    • /
    • pp.761-772
    • /
    • 2009
  • The introduction of KTX (Korea Train eXpress) provided passengers with a much faster mode of transport, and KTX has become a model railway system. Express railway stations are emphasized as public transit transfer centers, but their service evaluations were not performed appropriately so far. It is possible to know the level of service by developing valuation criteria for their evaluations. The evaluation of transfer centers mainly consists of two parts; connective service with other travel m odes, and transfer service inside transfer stations. Connection is defined as the inter-connection of multi-transportation vehicles, and transfer means that a passenger changes his travel mode to another. Such connective service and transfer service are evaluated by the level of service in terms of transfer facilities, the appropriateness of station layout and the quality of information throughout the facilities. We developed the service evaluation indicators of connective facilities and referred to the indicators of transfer facilities. We examined the 7 stations in Korea that are currently in operation and standardized the methodology of the evaluation process by applying the indicators suggested in this study.

  • PDF