Journal of The Korean Institute of Defense Technology (한국국방기술학회 논문지)

The Korean Institute of Defense Technology (한국국방기술학회)
권호 표지

A Study on the Improvement of Weapon System T&E performance System

국방 무기체계 시험평가 수행체계 개선방안 연구

  • BaekJung Kim (Department of Defense Aquisition Program, Kwangwoon University) ;
  • Sukjae Jeong (School of Business, Kwangwoon University)
  • 김백중 (광운대학교 방위사업학과 ) ;
  • 정석재 (광운대학교 경영학부 )
  • Received : 2023.04.03
  • Accepted : 2023.06.23
  • Published : 2023.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to derive the need to improve the test and evaluation(T&E) performance system of the weapon systems to which advanced science and technology is applied, evaluate priorities, and present development plans. T&E of Al-based weapon systems through a literature research and case analysis on changes in the T&E environment for weapon system, 11 detailed evaluation items were derived from the in terms of the T&E system, structure, and technology. Al-based weapon system test evaluation should be performed in parallel with data-based performance evaluation and actual T&E, and performance measurement using a separate T&E data set is required for AI models performance evaluation. As a result of analyzing the importance of T&E through AHP analysis, the order of T&E system-technology-structure was evaluated, and the priority of detailed evaluation items was evaluated in the order of T&E result judgment-T&E organization and expert training-scientific T&E. For evaluation items with high priority, measures to improve the T&E performance system were presented.

본 연구는 첨단 과학기술이 적용된 무기체계 시험평가 수행체계 개선 소요를 도출하고 우선순위를 평가하여 발전방안을 제시하는데 목적이 있다. 무기체계 시험평가 환경변화에 대한 문헌연구와 사례분석을 통해 AI 기반 무기체계의 시험평가 발전방안과 시험평가 제도·구조·기술적 측면에서 11개의 세부 평가항목을 도출하였다. AI 기반 무기체계 시험평가는 데이터 기반 성능평가와 실물에 의한 시험평가를 병행해야 하며, 별도의 데이터셋을 활용한 성능측정이 필요하다. AHP 분석을 통해 시험평가의 중요도를 분석한 결과, 시험평가 제도-기술-구조 순이며, 세부 평가항목의 우선순위는 시험평가 결과판정-시험평가 조직 및 전문가 양성-과학적 시험평가 순으로 평가되었다. 우선순위가 높은 평가항목에 대하여 시험평가 수행체계 개선방안을 제시하였다.

Keywords

References

  1. SangGuk Jang, "A study on the need to develop a next-generation K9 through opportunity-threat analysis", Journal of Advances in Military Studies Vol. 3 No. 3, p.27, 2020.
  2. JongHa Kim, "Current Status and Problems of Defense Acquisition System, and Improvement Direction," Science and Technology Policy Vol. 27 No. 11, p.46, 2017.
  3. Gyeom-bok Wi, Chul-soo Ha and 4 others, "Measures for Efficient Linkage between Weapon System Requirement Determination and Project Promotion Method", Korea Institute of Military Affairs, p.6, 2014.
  4. ROKA, "Acquisition System Improvement Direction", pp. 4~5, 2022.
  5. Joint Chiefs of Staff, "Weapon system test evaluation work regulations", Joint Chiefs of Staff Regulations-541-01, p.110, 2021.
  6. JongSoo Ryu, "A study on the development of test evaluation of company-led R&D projects," Defense & Technology(482), p.101, 2019.
  7. Ministry of National Defense, "Defense Electricity Development Work Order", No. 2568, pp.187~189, 2021.
  8. Jongwan Park, "The Action of the Reliability Enhancement in Test and Evaluation of the Weapon Systems", Reliability Application Research 15(2), 2015.
  9. WoongSeop Kang, "A Study on the Improvement of Reliability in Test Evaluation of Weapon Systems Adapting to Changes in the Defense Technology Environment", The Graduate School of Daejeon University, 2016.
  10. GyuOk Choi, Jae-Eun Song, Young-Min Yoo, "A Study on Adaptive Test Evaluation Applicable to Weapon Systems", Journal of Arts and Humanities and Social Convergence Multimedia, 2019.
  11. KangGyeong Lee, "A Study on the Derivation of Strategies for Improving the Operational Test and Evaluation of Weapons Systems Suitable for Changes in the Defense Acquisition Environment", The Graduate School Chungnam National University Daejeon, 2020.
  12. https://www.joongang.co.kr/article/, "Advanced technology is also an important means of war deterrence", Science and Technology and National Defense, Retrieved 18 April 2022.
  13. Joint Chiefs of Staff, "Research on AI weapon system T&E standards, methods, and procedures", National Defense University, pp.9~30, 2022.
  14. KyungSik Shin, Min-chae Song, Hyeon-seop Shin and 5 others, "Case Study Method", Han Kyung-sa, pp.25~56, 2023.
  15. Ohjung Kwon, "Multi-criteria decision making methodology Theory and Application", Bookshill, p.182, 2018.
  16. GeunTae Cho, Yong-Gon Cho, Hyeon-Soo Kang, "The Analysis Hierarchical Process Decision Making", Donghyun Publishing House, p.3, 2003.
  17. SeokYul Kang, "Trends and Implications of the 3rd Offset Strategy in the US," KIDA Brief, pp.1~4, 2021.
  18. https://www.army.mil/atec, U.S. Army Test and Evaluation Command, Retrieved 18 May 2022.
  19. YongBok Lee, IlKuk Jeon and 5 others, "Guide Book for Scientific Test Evaluation", Army T&E Group, pp.10-16, 2022.
  20. The Defense Acquisition University, "Test & Evaluation", 2012
  21. US Marine corps, "Operational Test & Evaluation Manual", 2013.