• 산업경영시스템학회지
• /
• 제46권4호
• /
• pp.229-237
• /
• 2023

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.

• 산업공학
• /
• 제23권4호
• /
• pp.275-285
• /
• 2010

In complex industrial world, many companies make every effort to analyze their competition capability through various performance evaluation tools to cope with rapidly changing business environment. Among evaluation tools the balanced scorecard (BSC), put forward by Kaplan and Norton in 1992, is a strategic performance management tool for measuring whether the smaller-scale operational activities of a company are aligned with its larger-scale objectives in terms of vision and strategy. The BSC tool offers a comparative advantage over others to evaluate the objective achievement of a company by linking its strategic objectives with operational KPI. In this paper, we introduce a case that the BSC performance evaluation system was implemented based on product data management and applied it to the business process. Specially, we shows a implementation procedure to derive discipline-specific topics and key performance metrics.

• Industrial Engineering and Management Systems
• /
• 제14권4호
• /
• pp.347-371
• /
• 2015

A hybrid procedure based on multi-Criteria Satisfaction Analysis (MUSA) and a Network Data Envelopment Analysis (NDEA) is proposed to evaluate the relative efficiency of customer services in bank branches. First, a three-stage process including sub-processes such as customer expectations, customer satisfaction, and customer loyalty, is defined to model the banking customer services. Then, fulfillment of customer expectations, customer loyalty level, and the customer satisfaction degree are measured and quantified through a multi-dimensional questionnaire based on customers' perceptions analysis and MUSA method, respectively. The customer services scores and the other criteria such as mean of employee evaluation score, operation costs, assets, deposits, loans, number of accounts are considered in network three-stage DEA model. The proposed NDEA model is formed based on multipliers perspective, output-oriented, and constant return to scale assumptions. The proposed NDEA model quantifies and assesses the total efficiency of main process and assigns the efficiency to customer expectations, customer satisfactions, and customer loyalties sub-processes in bank branches. The whole procedure is applied on 30 bank branches in IRAN. The proposed approach can be used in other organizations such as airports, airline agencies, urban transportation systems, railway organizations, chain stores, chain restaurants, public libraries, and entertainment centers.

• 경영과학
• /
• 제18권2호
• /
• pp.25-38
• /
• 2001

The well-known back-propagation algorithm for multi-layered neural network has successfully been applied to pattern c1assification problems with remarkable flexibility. Recently. the multi-layered neural network is used as a powerful data mining tool. Nevertheless, in many cases with complex boundary of classification, the successful learning is not guaranteed and the problems of long learning time and local minimum attraction restrict the field application. In this paper, an Improved learning procedure of multi-layered neural network is proposed. The procedure is based on the generalized delta rule but it is particular in the point that the architecture of network is not fixed but enlarged during learning. That is, the number of hidden nodes or hidden layers are increased to help finding the classification boundary and such procedure is controlled by entropy evaluation. The learning speed and the pattern classification performance are analyzed and compared with the back-propagation algorithm.

• Computers and Concrete
• /
• 제14권6호
• /
• pp.727-743
• /
• 2014

The management of existing concrete bridges has become a major social concern in many developed countries due to the large number of bridges exhibiting signs of significant deterioration. This problem has increased the demand for effective maintenance and renewal planning. In order to implement an appropriate management procedure for a structure, a wide array of corrective strategies must be evaluated with respect to not only the condition state of each defect but also safety, economy and sustainability. This paper describes a new performance evaluation system for existing concrete bridges. The system evaluates performance based on load carrying capability and durability from the results of a visual inspection and specification data, and describes the necessity of maintenance. It categorizes all girders and slabs as either unsafe, severe deterioration, moderate deterioration, mild deterioration, or safe. The technique employs an expert system with an appropriate knowledge base in the evaluation. A characteristic feature of the system is the use of neural networks to evaluate the performance and facilitate refinement of the knowledge base. The neural network proposed in the present study has the capability to prevent an inference process and knowledge base from becoming a black box. It is very important that the system is capable of detailing how the performance is calculated since the road network represents a huge investment. The effectiveness of the neural network and machine learning method is verified by comparing diagnostic results by bridge experts.

• 상하수도학회지
• /
• 제37권6호
• /
• pp.347-361
• /
• 2023

Water utilities are making various efforts to reduce water losses from water networks, and an essential part of them is to recognize the moment when a pipe burst occurs during operation quickly. Several physics-based methods and data-driven analysis are applied using real-time flow and pressure data measured through a SCADA system or smart meters, and methodologies based on machining learning are currently widely studied. Water utilities should apply various approaches together to increase pipe burst detection. The most intuitive and explainable water balance method and its procedure were presented in this study, and the applicability and detection performance were evaluated by applying this approach to water supply pipelines. Based on these results, water utilities can establish a mass balance-based pipe burst detection system, give a guideline for installing new flow meters, and set the detection parameters with expected performance. The performance of the water balance analysis method is affected by the water network operation conditions, the characteristics of the installed flow meter, and event data, so there is a limit to the general use of the results in all sites. Therefore, water utilities should accumulate experience by applying the water balance method in more fields.

• 산업경영시스템학회지
• /
• 제2권2호
• /
• pp.39-51
• /
• 1979

In introducing and applying the budget management system, the question of how to establish management structure(skelton) representing budget management responsible unit is significantly related to the degree of accuracy and analysis on the performance measurement of standard work unit. We have the following rational process of establishing performance measurement of budget management System ; 1) Standardization of work method 2) Establishment of management structure 3) Institution of budget management system. Especially, this system is based on a premise of efficiency of objectives management, it is assumed that performance measurement in the standard work unit must be enforced according to the basis and categories of performance evaluation based on the evaluating work unit. Therefore, most of all, the following three detail questions(subjects) are to be determined in order to rationalize these above principles to a maximum possible extent of performance measurement system. First, we established respective performance standard unit with respect to such detailed work unit, performance standard unit of which were accurately applicable directly from using the budget ana objectives account data and their supplementary data of the work measurement techniques. Second, by using the above mentioned question, over all evaluation and suggestion are made based on the study of the recording for each work unit development, budget management and production nit (volume of production) Third, the measurement of performance of budget management system is based on the principle of standard work unit, compared with the standard basis and actual work unit by period and activities unit and calculated percentage effectiveness according to the above procedure. and so evaluated the efficiency of performance measurement on the budget management system.

• 자동차안전학회지
• /
• 제9권1호
• /
• pp.19-24
• /
• 2017

This paper present a performance evaluation scenarios to assess the safety performance of autonomous emergency braking (AEB) system for cyclist collision. To guarantee the safety performance of AEB for cyclist, AEB system should be tested in various scenarios which can be occurred in real driving condition. For this, real-traffic car-to-cyclist collision data are analyzed to classify the real traffic collision scenarios. Using this information, typical car-to-cyclist collision scenarios are selected. Also, in order to develop the detail features of these collision scenarios, several accident cases related with these scenarios are explained. Based on these information, test scenarios which can describe the car-to-cyclist collisions occurred in Korea are proposed. For practicality and feasibility of the test scenarios, proposed scenarios should be designed to assess the safety performance of AEB system effectively. For this, some test scenarios are combined or removed based on the consideration about the effectiveness of each scenario to the assessment of the performance of AEB system. To confirm that the proposed test scenarios are realistic and physically meaningful, simulation is conducted using simple AEB system in proposed test scenarios.

• Journal of Information Technology Applications and Management
• /
• 제26권3호
• /
• pp.19-27
• /
• 2019

In this study, we propose a methodology for predicting the movie audience based on movie information that can be easily acquired before opening and effectively distinguishing qualitative variables. In addition, we constructed a model to estimate the number of movie audiences at the time of data acquisition through the configured variables. Another purpose of this study is to provide a criterion for categorizing success of movies with qualitative characteristics. As an evaluation criterion, we used information gain ratio which is the node selection criterion of C4.5 algorithm. Through the procedure we have selected 416 movie data features. As a result of the multiple linear regression model, the performance of the regression model using the variables selection method based on the information gain ratio was excellent.

• 한국전자통신학회논문지
• /
• 제12권5호
• /
• pp.817-828
• /
• 2017

단일 스트림 기준으로 10Gbps에 달하는 데이터 처리를 수행하는 시스템은 매우 제한적이고, 그에 관한 애플리케이션 역시 극소수에 불과한 실정이다. 하지만 이러한 시스템은 물리, 천문 등 과학연구 분야에서 더욱 그 중요성이 부각되고 있으며, 업그레이드 된 성능을 요구하고 있다. 이를 위해 해당 분야의 중소기업 지원을 위해 1년 전 10Gbps 수준으로 네트워크 입력되는 고속의 패킷 수신, 저장을 수행하는 초고속 스토리지가 개발되었다. 하지만 실제 연구 현장에서 사용되기 위해서는 객관화된 성능 평가가 수반되어야 하며 최적화가 이뤄져야 한다. 본 논문에서는 이에 필요한 시스템 환경을 구축한 것을 시작으로 객관화된 성능 지표를 얻기 위한 실험 과정 및 방법론에 대해 논의하였다.