• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.229-237
• /
• 2023

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.19 no.1
• /
• pp.16-25
• /
• 2016

In this paper, we suggest a quantitative management scheme to accomplish effective weapon systems test and evaluation service(T&E). The Capability Maturity Model Integration(CMMI) process model has been introduced and applied for that purpose by the 8th directorate, Agency for Defense Development(ADD). Although a CMMI process model was developed focusing on the software development, systematic approaching scheme in the CMMI process model can be utilized for the quantitative management implementation of a weapon systems T&E service. To manage a T&E service quantitatively, at first, organizational performance objectives and sub processes are established, and then each performance indicators and performance base lines are followed.

• Journal of the Society of Naval Architects of Korea
• /
• v.53 no.2
• /
• pp.127-134
• /
• 2016

This paper presents practical issues for test and evaluation(T&E) methods to develop defense systems. Our argument is motivated by several domestic defense cases and the cases lead us to discuss two main factors for reliable defense systems development: 1) statistical approaches and 2) technical schemes. Specifically, statistical approaches enable to provide credible interpretations about T&E results in the decision-making process. With practical T&E results of the “Red Shark” torpedo, we performed statistical hypothesis tests and suggest a minimum sample size to accept the hypothesis. Next, technical schemes have more direct effects on improving reliability of developed defense systems and we shortly introduce tools development for systems verification that is required to integrate several sub-systems, e.g., combat, sensor, weapon, and communication systems, within a defense system. We additionally summary some domain cases using modeling and simulation techniques for successful T&E. In closing, we expect that the paper shows empirical investigation and lessons learned with these two practical issues, which provides a guide those who desire to make decisions about reliable defense systems development.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.7 no.4 s.19
• /
• pp.44-52
• /
• 2004

The test and evaluation(T&E) of weapon systems is a significant activity in the decision-making process of defense acquisition program, providing the data of trade-off analysis, risk reduction and readiness to advance to next phase of development for the decision-maker. Currently, the modeling and simulation(M&S) is being a critical method in the test and evaluation of weapon systems. Therefore in this paper we review the current status of the test and evaluation for the defense acquisition program in Korea, and suggest an application of M&S in the T&E of weapon systems.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.13 no.6
• /
• pp.1019-1025
• /
• 2010

This paper describes on methods in test and evaluation of the guided rocket munitions of the domestic new generation multiple launcher rocket system. We modified and refer to the present model of air-to-air missile(AAM) and surface-to-air missile(SAM). Also we suggested a method of surface-to-surface missile(SSM) based on the characteristics of the guided rocket in test and evaluation(T&E). According to this study, the suggested activity of T&E should be observed methods compatible with each item on the established model. Therefore, we expect that the proposed research material will be a good guide to the study of a surface-to-surface missile(SSM) installed GPS/INS integration navigation guidance & control systems in the future.

• Journal of Applied Reliability
• /
• v.15 no.2
• /
• pp.108-123
• /
• 2015

Test and Evaluation (T&E) have been verifying the level of it's technological skill and the needed operational status of the development weapons. If the overall spectrum of test and evaluation is fulfilled substantially in the production & deployment, the needed level of the weapon system will be enhanced and also the reliability status will become higher considerably. We can know currently these issues through the mass media and all kinds of the news regarding the defense industry and programs. And so this article have studied the method of enhancing reliability of the test and evaluation, the 6 variables were selected through the discussion of the professional group. The the test and evaluation group needs consistently the professional training systems. After DT&E, we have to the event to verify the technical level of the development systems. We have to take the high level of the kinds of the environmental test. Scientific methods like system engineering will be adapted in process of the test and evaluation. The number of suitable test prototype in the test and evaluation is analysed more systematically. And we need to establish the standardization of the test and evaluation. If 6 variables are well analysed and adapted in the working field, the reliability of the test and evaluation will be considerably, the defense industry will take the chance to develope the future-oriented.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.19 no.4
• /
• pp.536-544
• /
• 2016

The study on the precipitation particle distribution models in Korea for the environmental test and evaluation (T&E) from huge amount of measuring and reanalysis data is presented. Instead of related specifications of MIL-HDBK-310, with these models it can be possible to realize more realistic and efficient design and environmental T&E for the military and civil products especially for the atmospheric flying vehicles using in Korea.

• Convergence Security Journal
• /
• v.13 no.2
• /
• pp.143-153
• /
• 2013

The objective of this study is to present improvement of Weapon System T&E(Test and Evaluation) correspond to future environment by analyzing restrictions such as change of future weapon system procurement environment, and present T&E management system, organization and resource etc. The results of this study will be aid of produ ction dicision making by timely risk management through early identification of deficiency on the process of weapon system development, and suitability of combat determination.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.97-107
• /
• 2015

Up until recently, Korea has ranked the first place in UN e-Government Survey for three consecutive years. In keeping with such accomplishment, the size of budget execution has been consistently growing in accordance with Korea's Government 3.0 policy and vision, leading to increase in big-sized informatization projects in the business. Especially in mission critical public sector's infrastructure where it affects many people, growing demand for establishing high-quality information system with new technologies being brought to attention in order to meet the complex needs of citizens. National defense information system, being one of representative domains examples in the concerned area, established high military competency by applying breakthrough technology. Network-oriented national defense knowledge informatization was set as the vision in order to implement core roles in making efficient national defense management; and effort has been made to materialize the vision by making advancement in national defense's information system and its informatization implementation system. This research studies new quality index relevant to test and evaluation (T&E)of informatization business in national defense which is the representative example of mission critical public sector's infrastructure. We studied international standards and guidelines, analyzed actual T&E cases, and applied them to the inspection items that are currently in use, complying with the e-government law (Act No. 12346, Official Announcement Date 2014. 1.28., Enforcement Date 2014. 7.29.) As a result of productivity analysis, based on hypothesis in which suggested model was applied to T&E of the national defense informatization business, we confirmed the possibility of enhancement in the T&E productivity by assessing reliability, expertise, and safety as evaluation factors.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.18 no.5
• /
• pp.558-565
• /
• 2015

The current methods, such as Binomial Probability Distribution or T-test, to calculate the number of samples of Precise Guided Missiles(PGMs) for test and evaluation are statistically problematic to make reasonable decisions thus use the budget efficiently. Also, the method to verify an accuracy rate of the PGMs using these old methods seems to be lack of objectiveness. This paper presents an effective, efficient solution adapted from the clinical medicine testing method of healthcare industry research, which may overcome our problems. This method considers and addresses both manufacturers' and consumers' risk simultaneously. By taking into account the weapon system project characteristics which take a relatively longer time and require higher-level budget, this approach also suggests a reasonable and feasible method to determine the amount of samples of the PGMs and making a criterion to verify an accuracy rate of the missiles that are required to test. Thus, this method is expected to contribute to acquisition and operations of high-reliability PGMs by MND and its field-users.