Journal of the military operations research society of Korea (한국국방경영분석학회지)

Military Operations Research Society of Korea (한국국방경영분석학회)
권호 표지

Comparisons of Experimental Designs and Modeling Approaches for Constructing War-game Meta-models

워게임 메타모델 수립을 위한 실험계획 및 모델링 방법에 관한 비교 연구

  • 유권태 (한국과학기술원 산업공학과) ;
  • 염봉진 (한국과학기술원 산업공학과)
  • Published : 2007.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Computer simulation models are in general quite complex and time-consuming to run, and therefore, a simpler meta-model is usually constructed for further analysis. In this paper, JANUS, a war-game simulator, is used to describe a certain tank combat situation. Then, second-order response surface and artificial neural network meta-models are developed using the data from eight different experimental designs. Relative performances of the developed meta-models are compared in terms of the mean squared error of prediction. Computational results indicate that, for the given problem, the second-order response surface meta-model generally performs better than the neural network, and the orthogonal array-based Latin hypercube design(LHD) or LHD using maximin distance criterion may be recommended.

컴퓨터 시뮬레이션 모델은 일반적으로 복잡할 뿐더러 운용 시 많은 시간이 소요된다. 따라서 분석의 편의를 위해 좀 더 간단한 메타모델을 수립할 필요가 있다. 본 논문에서는 워게임 모델 JANUS를 사용하여 전차 전투 상황을 묘사하고 이에 대한 메타모델을 수립하였다. 메타모델을 수립하기 위해, 데이터 수집방법으로는 8가지의 실험계획법을, 모델링 방법으로는 2차 반응표면분석과 인공신경망을 고려하였다. 수립된 메타모델의 상대적 성능은 예측치의 평균제곱오차를 기준으로 비교하였다. 본 논문에서 고려한 전투상황에 대해서는 대체적으로 2차 반응표면 모형이 인공신경망 모형보다 더 높은 정확도를 보였으며, 실험계획법으로는 직교배열이나 최대최소거리 기준을 적용한 라틴 하이퍼큐브 계획법이 우수한 성능을 보였다.

Keywords

References

  1. 김윤태, 고 원, 박혜련, '분석용 정밀 워게임 모형의 통계적 진단 및 활용', 2004 한국통계학회 추계 학술대회 논문집, 117-121, 2004
  2. Barton, R. R., 'Metamodels for simulation input-output relations', Proceedings of the 1992 Winter Simulation Conference, 289-299, 1992
  3. McKay, M. D., Beckman, R. J., and Conover, W. J., 'A Comparison of three methods for selecting values of input variables in the analysis of output from a computer code', Technometrics, 21(2), 239-245, 1979 https://doi.org/10.2307/1268522
  4. Stein, M., 'Large sample properties of simulation using Latin hypercube sampling', Technometrics, 29, 143-151, 1987 https://doi.org/10.2307/1269769
  5. Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P., 'Design and analysis of computer experiments', Statistical Science, 4(4), 409-435, 1989 https://doi.org/10.1214/ss/1177012413
  6. Shewry, M. and Wynn, H., 'Maximum entropy sampling', Journal of Applied Statistics, 14, 409-435, 1987
  7. Tang, B., 'Orthogonal array-based Latin hypercubes', Journal of the American Statistical Association, 88(424), 13921397, 1993
  8. Ye, K. Q., 'Orthogonal column latin hypercubes and their application in computer experiments', Journal of the American Statistical Association, 93(444), 1430-1439, 1998 https://doi.org/10.2307/2670057
  9. Owen, A. B., 'Controlling correlations in Latin hypercube samples', Journal of the American Statistical Association, 89(428), 1515-1522, 1994
  10. Tang, B., 'Selecting Latin hypercubes using correlation criteria', Statistica Sinica, 8, 965-977, 1998
  11. Morris, M. D., Mitchell, T. J., 'Exploratory designs for computational experiments', Journal of Statistical Planning and Inference, 43, 381-402, 1995 https://doi.org/10.1016/0378-3758(94)00035-T
  12. Joseph, V. R., Hung, Y., 'Orthogonalmaximin Latin hypercube designs', Statistica Sinica, to appear, 2006
  13. Lunani, M., Sudjianto, A., and Johnson, P. L., 'Generating efficient training samples for neural networks using Latin hypercube sampling', Intelligent Engineering Systems Through Artificial Neural Networks, 5, 209-214, 1995
  14. Alam, F. M., McNaught, K. R., and Ringrose, T. J., 'A comparison of experimental designs in the development of a neural network simulation metamodel', Simulation Modelling Practice and Theory, 12, 559-578, 2004 https://doi.org/10.1016/j.simpat.2003.10.006
  15. Simpson, T. W, Peplinski, J. D, Koch, P. N. and Allen, J. K., 'Metamodels for computer-based engineering design: Survey and recommendations', Engineering with Computers, 17, 129-150, 2001 https://doi.org/10.1007/PL00007198
  16. Allen, T. T., Kabiri-Bemshteyn, K., and Bamoradian, K. K, 'Constructing metamodels for computer experiments', Journal of Quality Technology, 35(3), 264-274, 2003 https://doi.org/10.1080/00224065.2003.11980220
  17. Davis, P. K., Bigelow, J. H., Motivated Metamodels, RAND, Santa Monica, CA, 2004
  18. 문형곤, 윤직석, 유승근, 01 육군 전투실험기술 지원 연구보고서, 한국국방연구원, 2001
  19. Box, G. E. P., Wilson, K. B., 'On the experimental attainment of optimum conditions', Journal of the Royal Statistic Society Ser. B(Methodological), 13(1), 1-45, 1951
  20. Montgomery, D. C., Design and Analysis of Experiments, 6th. ed., Chapter 11, John Wiley & Sons Inc., New York, 2005
  21. SAS/STAT 9.1 User's Guide, 2004
  22. Phadke, M. S., Quality Engineering Using Robust Design, p.293, PTR Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1989
  23. MATLAB v.7.0.1 Manual, Backpropagation in Neural Network Toolbox, 2004