• Journal of The Korean Institute of Defense Technology
• /
• v.5 no.2
• /
• pp.1-9
• /
• 2023

The purpose of this study is to derive the need to improve the test and evaluation(T&E) performance system of the weapon systems to which advanced science and technology is applied, evaluate priorities, and present development plans. T&E of Al-based weapon systems through a literature research and case analysis on changes in the T&E environment for weapon system, 11 detailed evaluation items were derived from the in terms of the T&E system, structure, and technology. Al-based weapon system test evaluation should be performed in parallel with data-based performance evaluation and actual T&E, and performance measurement using a separate T&E data set is required for AI models performance evaluation. As a result of analyzing the importance of T&E through AHP analysis, the order of T&E system-technology-structure was evaluated, and the priority of detailed evaluation items was evaluated in the order of T&E result judgment-T&E organization and expert training-scientific T&E. For evaluation items with high priority, measures to improve the T&E performance system were presented.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.25 no.3
• /
• pp.259-266
• /
• 2022

This study aims to introduce missile live-fire during the ship operational test and evaluation(T&E) as a means of verifying the integrated combat capability(ICC) of various systems installed on naval ships. The research method identified domestic and foreign T&E systems and cases, and reports related to ICC, which were written during the ship's design stage. As a result of research, Republic of Korea is not conducting the missile live-fire at the ship T&E stage due to the lack of relevant systems, while the U.S. is conducting it based on the mission-based T&E and the end-to-end test system. As a way to improve within the current domestic ship acquisition systems, the reaction time analysis, a quantitative analysis result of ICC calculated at the ship basic design stage, was proposed to be verified by missile live-fire during ship operational T&E.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.229-237
• /
• 2023

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.

• Journal of the Korean Society of Systems Engineering
• /
• v.6 no.1
• /
• pp.25-32
• /
• 2010

The Test and Evaluation (T&E) process is an integral part of the Systems Engineering Process. The purpose of Test and Evaluation (T&E) in a system development is to identify the areas of risk to be reduced or eliminated. In this study, when develop aircraft of Civil Aviation with development experience of Military Aircraft, it is that establish Test and Evaluation process. Test and Evaluation for KC-100 small aircraft development can divide to certification test and development test. Certification test is proved compliance about Korea Airworthiness standard (KAS Part 23), through Development Test verify required performance of aircraft. These Test and Evaluation Process is more efficient and optimized.

• Journal of the Korea Society for Simulation
• /
• v.21 no.1
• /
• pp.89-96
• /
• 2012

Recent modeling and simulation technologies are being used in various fields, especially in the field of military simulation-based acquisition (Simulation Based Acquisition) is recognized as an essential policy. In test and evaluation phase of the SBA process, to build a simulation-based T&E(test and evaluation) environment is needed when T&E cannot be carried by real weapon system. To improve efficiency and reliability for T&E, interoperability, reusability and reliability for T&E equipments and systems are important. In this study, we propose applying simulation framework for efficienct test and applying VV&A process for reliable evaluation. We describes the characteristics of the development process, the actual test cases and the results of evaluation. Finally utilization plan and the future direction of research is described.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.14 no.6
• /
• pp.1138-1143
• /
• 2011

One of the critical items in radar testing is the ability to evaluate the performance of radar systems under real operational environments. But it takes lots of time and cost to operate real targets and analyze the test results due to a large amount of data based on these complicated environments. In this paper, the Radar Simulative T&E Lab. is introduced, and the test and analysis results of the developing radar for predicting the radar system performance are described in the Radar Simulative T&E Lab. This laboratory could be used to test the far-field characteristics of antenna radiation pattern and to perform an effective radar system test and evaluation using a simulative target generator under a low cost repeating test situation.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.7 no.4 s.19
• /
• pp.44-52
• /
• 2004

The test and evaluation(T&E) of weapon systems is a significant activity in the decision-making process of defense acquisition program, providing the data of trade-off analysis, risk reduction and readiness to advance to next phase of development for the decision-maker. Currently, the modeling and simulation(M&S) is being a critical method in the test and evaluation of weapon systems. Therefore in this paper we review the current status of the test and evaluation for the defense acquisition program in Korea, and suggest an application of M&S in the T&E of weapon systems.

• Convergence Security Journal
• /
• v.13 no.2
• /
• pp.143-153
• /
• 2013

The objective of this study is to present improvement of Weapon System T&E(Test and Evaluation) correspond to future environment by analyzing restrictions such as change of future weapon system procurement environment, and present T&E management system, organization and resource etc. The results of this study will be aid of produ ction dicision making by timely risk management through early identification of deficiency on the process of weapon system development, and suitability of combat determination.

• Journal of the Korea Society for Simulation
• /
• v.23 no.4
• /
• pp.211-218
• /
• 2014

The Test and Evaluation (T&E) system became more important due to its advancement and complexity of the weapon system. Time and cost saving T&E related studies are in progress mainly with advanced countries. By utilizing the Modeling and Simulation (M&S) technology recently, we may save time and money. Also, overcome security and safety limitations. There are many M&S based research activities in South Korea but it is way behind of the system that some countries already have developed. i.e.; United States. This area of study requires new way of developing strategies in the T&E system of Korea. This study is to design the Operational T&E system for weapon systems based on modeling of processes. And we modeled the processes of operational performance evaluation through utilizing resources and performance modules of weapon systems and combined it with the simulation engine for 3D visualization. Through this, we propose the Operational T&E system for weapon systems based on modeling of processes that represent operational performances visually.

• Journal of the Korea Safety Management & Science
• /
• v.16 no.2
• /
• pp.31-42
• /
• 2014

As weapon systems become complex in terms of the scale and functionality, the required time to complete the test and evaluation (T&E) process is inevitably getting longer. However, nowadays the reduction of T&E period becomes one of the core targets in the weapon systems acquisition programs. This is because the reduced time for T&E process can yield the reduction of defense budget and also faster deployment of the weapon systems, thereby having a competitive edge over rival countries. On the other hand, in weapon systems development the management of reliability, availability, maintainability and safety (RAMS), and risk is considered important to keep competitiveness and thus has been carried out separately. Thus, the objective of this paper is to study on improving the T&E process by integrating the RAMS and risk management process in it. To do so, the related processes are analyzed and modeled first. Then an integrated process model is developed. The resulting model is equipped with the traceability among the data and interfaces that are generated from the T&E and RAMS/risk processes. As a case study, the model developed is applied in tanks development. The effective use of the traceability is expected to reduce the time and cost required to complete T&E process.