• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.35 no.2
• /
• pp.1-8
• /
• 2012

The primary goal of this study is to develop proper performance indicators for evaluating the results of industrial R&D program. We define R&D results include output, transfer, outcome, and impact in the performance of R&D program. Performance indicators are focused on the results of R&D commercialization, building the industrial foundations as performance proxy of R&D program of Ministry of Knowledge Economy. And we first try to design the coupled structure as logical model between R&D program goals and performance indicators. The coupled structure is represented with objectives of group unit of R&D program, implementation process, R&D practical stage, and the ultimate goal of R&D program.

• Journal of Platform Technology
• /
• v.11 no.6
• /
• pp.3-12
• /
• 2023

In today's system operation, it is difficult to detect failures and take immediate action in the case of a shortage of manpower compared to the number of equipment or failures in vulnerable time zones, which can lead to delays in failure recovery. In addition, various algorithms exist to detect abnormal symptom data, and it is important to select an appropriate algorithm for each problem. In this paper, an ensemble-based isolation forest model was used to efficiently detect multivariate point anomalies that deviated from the mean distribution in the data set generated to predict system failure and minimize service interruption. And since significant changes in memory space usage are observed together with changes in CPU usage, the problem is solved by using LSTM-Auto Encoder for a collective anomaly in which another feature exhibits an abnormal pattern according to a change in one by comparing two or more features. did In addition, evaluation indicators are set for the performance evaluation of the model presented in this study, and then AI model evaluation is performed.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.1
• /
• pp.1-10
• /
• 2018

Current evaluation practices for IT projects suffer from several problems, which include the difficulty of self-explanation for the evaluation results and the improperly scaled scoring system. This study aims to develop a methodology of opinion mining to extract key factors for the causal relationship analysis and to assess the feasibility of quantifying evaluation scores from text comments using opinion mining based on big data analysis. The research has been performed on the domain of publicly procured IT proposal evaluations, which are managed by the National Procurement Service. Around 10,000 sets of comments and evaluation scores have been gathered, most of which are in the form of digital data but some in paper documents. Thus, more refined form of text has been prepared using various tools. From them, keywords for factors and polarity indicators have been extracted, and experts on this domain have selected some of them as the key factors and indicators. Also, those keywords have been grouped into into dimensions. Causal relationship between keyword or dimension factors and evaluation scores were analyzed based on the two research models-a keyword-based model and a dimension-based model, using the correlation analysis and the regression analysis. The results show that keyword factors such as planning, strategy, technology and PM mostly affects the evaluation result and that the keywords are more appropriate forms of factors for causal relationship analysis than the dimensions. Also, it can be asserted from the analysis that evaluation scores can be composed or calculated from the unstructured text comments using opinion mining, when a comprehensive dictionary of polarity for Korean language can be provided. This study may contribute to the area of big data-based evaluation methodology and opinion mining for IT proposal evaluation, leading to a more reliable and effective IT proposal evaluation method.

• The Korean Journal of Air & Space Law and Policy
• /
• v.27 no.2
• /
• pp.167-192
• /
• 2012

Aviation industry is known as the knowledge-based one and as an advanced nations' exclusive property having a large capacity for creating job and added value. Considering the current status of the aviation industry as aforesaid, it is natural for all countries to turn their attention to such promising aviation industry. At the time of rapid growth in aviation market, the importance of securing managerial experts and technicians is being under the spotlight as the aviation profession is increasingly in demand. To meet such dire needs that have already become an ever-greater part of the industry, collaboration among governmental, educational and industrial parties has formed in preparation for putting us into so-called an era of globalization. Having recognized the significance of the program, carried forward by The Ministry of Land, Transport and Maritime Affairs, fostering human resources in civil aviation, the objective of this study lies on deloping indicators for the programofficially designed to produce men of expertise in international air transport, the market of which forms nowadays a large part of national economy, and the technology of which develops so quickly. In this paper, an effort is made to develop the appraisal indicators and to set up standards thereof in order for the program to be systematically and expertly assessed on the basis of Quinn and Rohrbaugh's the competing values model. Firstly, this paper designs appraisal indicators, taking into account the peculiarity and environment of air transport industry, for developing human resources in civil aviation by utilizing advanced research on educational assessment in general due to the absence of applicable preceding studies regarding the development of human resources in civil aviation. Secondly, investigations into the necessity and validity of the appraisal are committed by analyzing answers from 100 respondents to questionaires and oral surveys in order to verify appraisal indicators designed in accordance with the competing values model. Lastly, the paper analyzes in a demographical way discrepancy in the recognitions among institutions for which the respondents work, on the basis of the outcome of the survey. As a result, the discrepancy is found not significant, which indicate that the aviation experts favour the indicators as appraisal standards. Prospective studies on the same issue may need an in-depth analysis, empowered by sufficient sampling in balance, of correlation between independent variables, then hopefully serve as a momentum for advancement of study in civil aviation.

• Journal of the Korean Society of Environmental Restoration Technology
• /
• v.22 no.6
• /
• pp.97-114
• /
• 2019

This study aims to analyze the effect of urban ecosystem restoration projects by evaluating the short-term restoration performance of the project sites, from both qualitative and quantitative evaluations. In this study, for the qualitative evaluation, we derived the evaluation frame from previous studies and literature. For the quantitative evaluation, the changes in ecological connectivity after the restoration project were described using landscape permeability and network analysis. In addition, changes in habitat quality after the restoration project were evaluated by using InVEST Habitat Quality Model. These evaluations were applied to the three natural madang (ecological restoration) projects and two ecosystem conservation cooperation projects. As a result, three categories, 10 indicators, and 13 sub-indicators were derived from literature as the evaluation frame for this study. In the case of quantitative evaluation of restoration performance, habitat quality increased by 45% and ecological connectivity by 37% in natural-madang, and habitat quality by about 12% and ecological connectivity by about 19% in ecosystem conservation cooperation projects. This implies that the ecological restoration project can increase the ecological connectivity and the habitat quality of degraded sites even in a short period of time by improving the land-cover and land use. The results by applying the evaluation frame indicated that ecological and environmental factors and the ecological functions were improved by the restoration works, even though the magnitude of performances were diverse depending on the specific evaluation items, project type, and site characteristics. This study clarified that the success of ecological restoration project should be assessed by both of the short-term and long-term goals, which can be achieved by the maintenance and sustainable management, respectively.

• Journal of Korean Library and Information Science Society
• /
• v.39 no.4
• /
• pp.51-69
• /
• 2008

This study tired to develop the web credibility evaluation model by calculating weighted values and sensitivities of indicators which presented on preceding researches using Analytic Hierarchy Process. "Expert Choice 2000" was used as the tool for analysing AHP. 25 experts are answered for this questionnaire who are selected by judgement sampling method, one of the non-probability sampling method. Also, sensitivity analyses was performed to graphically see how the alternatives change with respect to the importance of the indicators or sub-indicators. The main results are summarized as followings; i) importance analysis in first level factors: trust-worthiness(0,606), expertness(0.222), safety(0.173), ii) importance analysis in second level factors: trustfulness (0.519), reputation(0.087), usefulness (0.102), timeliness(0,093), competency(0.027), security(0.115), reliability(0,058). iii) some of the importance analysis in third level factors: the site provides comprehensive information that is attributed to a specific source(0.252), the site has articles that list citations and references(0.153), the site contains user opinions and reviews(0.072), etc. iv) sensitivity analyses showed that the importance of the indicators or sub-indicators are slightly changed with respect to the alternatives change.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.39 no.5
• /
• pp.57-75
• /
• 2011

The purpose of this study is to find ways of evaluating the suitability of sites being considered for development of different types of parks in the vicinity of yangmock-myun kyoung buk, where a large project(as large as about14.0$km^2$) has been planned. The results are as follows. Three surveys for selecting the assessment indicators were performed. ${\cdot}$ The first survey analyzed the importance of 23 selected assessment indicators based on a review of existing literature review and an on-the-spot research. ${\cdot}$ The second survey selected assessment indicators for each park type. ${\cdot}$ The third survey computed additive values of selected assessment indicators by the park types. It used a method of standardizing the average importance of indicators by making their sum equal to 10. These additive values were then multiplied by each grade of indicators to make a final evaluation. An evaluation of the site-suitability of park types was performed twice. The purpose of the first evaluation was to figure out how much each type met the minimum requirements targeted for all landscape types. The minimum requirements were derived by using a relative comparison between the standard of value rating of the assessment indicators, which was over the medium magnitude on the importance analysis, and the result of field research. A second evaluation estimated the targeted sites that met the minimum requirements. Value ratings of second assessment indicators were quantitatively divided as 1 to 3 grade and the evaluation scores were added, giving an additive value for each assessment indicator. The evaluation score on each park type was rated on a scale of 1 to 3 according to their averages, (from lowest to highest). Since this evaluation model of the site suitability on park types only focused on the 'face' of space in this study, additional analysis is necessary for setting the evaluation model and incorporating the overall impact of space, network connection and other factors, considering 'spot', 'line' and 'face' aspects of space.

• Korea Journal of Hospital Management
• /
• v.10 no.4
• /
• pp.98-112
• /
• 2005

The purpose of this study is to develop a framework for evaluating security levels in hospitals. We classify security indicators into administrative, technical and physical safeguards. The security evaluation model for hospital information systems was applied to three general hospitals. The analysis of the results showed a low security level in information systems. In particular, requirements for administrative and physical safeguards were very low. Hospitals need strict security policies more than other organizations because their information systems contain patients' highly confidential data. The evaluation model developed in this study can be used for guidelines and as a checklist for hospitals. The security evaluation in hospital informational systems needs to be an essential element of hospital evaluation.

• Architectural research
• /
• v.21 no.2
• /
• pp.41-48
• /
• 2019

The purpose of this study is to research and development of 'Korea B(Benefit)-impact Model' for Sustainable Development. A concept evaluation model is 'B(Benefit)-impact model' in U.S.A. We use the results of surveys that examined the importance of social value issues to stakeholders in Korea to implement the benefit-impact model in Korea. In particular, in this paper, we use the KSI(Korean Sustainability Index) survey data conducted by the Korea Standards Association to evaluate the social value of the construction industry for representative stakeholders in the construction industry. The social value pool and the activity indicator pool used for the survey are created based on relevant International Standards; ISO 26000, ISO 14001, ISO 37001. As a result, Korea B-impact model for construction industry included the following five core social value issues; Strengthen transparency of corporate management, Ensure fair employment and employment relations, Efforts to prevent corruption, Conduct fair competition, Efforts to prevent environmental pollution. In addition, the US B-impact model has three limitations. First, it is unclear whether the key indicators have been derived while considering all issues of social value. Second, US B-impact model indicators are developed by the social responsibility experts, so it is necessary to review by stakeholders in each industry. Finally, it would be more effective for companies to use the B-impact model index as a more detailed activity indicator. When developing a Korea B-impact model, the following methods are used to supplement it. First, we reviewed all social value issues using international standards. Secondly, we used the KSI(Korean Sustainability index) survey results to derive the importance of the social value issue of construction industry in Korea. Finally, we have clearly matched the activity indicators by social value core issues based on the GRI Standard so that companies can actually use the Korea B-impact model for the construction sector. The detailed development stages and results of this study are as follows;.

• Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
• /
• v.17 no.1
• /
• pp.47-58
• /
• 2019

The paper presents the results of a multi-criteria comparative evaluation of 12 feasible Russian nuclear energy deployment scenarios with thermal and fast reactors in a closed nuclear fuel cycle. The comparative evaluation was performed based on 6 performance indicators and 5 different MCDA methods (Simple Scoring Model, MAVT / MAUT, AHP, TOPSIS, PROMETHEE) in accordance with the recommendations elaborated by the IAEA/INPRO section. It is shown that the use of different MCDA methods to compare the nuclear energy deployment scenarios, despite some differences in the rankings, leads to well-coordinated and similar results. Taking into account the uncertainties in the weights within a multi-attribute model, it was possible to rank the scenarios in the absence of information regarding the relative importance of performance indicators and determine the preference probability for a certain nuclear energy deployment scenario. Based on the results of the uncertainty/sensitivity analysis and additional analysis of alternatives as well as the whole set of graphical and attribute data, it was possible to identify the most promising nuclear energy deployment scenario under the assumptions made.