DOI QR코드

DOI QR Code

Quality of Coverage Analysis on Distributed Stochastic Steady-State Simulations

분산 시뮬레이션에서의 Coverage 분석에 관한 연구

  • 이종숙 (한국과학기술정보연구원 슈퍼컴퓨팅연구실) ;
  • 박형우 (한국과학기술정보연구원 슈퍼컴퓨팅연구실) ;
  • 정해덕
  • Published : 2002.12.01

Abstract

In this paper we study the qualify of sequential coverage analysis under a scenario of distributed stochastic simulation known as MRIP(Multiple Replications In Parallel) in terms of the confidence intervals of coverage and the speedup. The estimator based in the F-distribution was applied to the sequential coverage analysis of steady-state means. in simulations of the $M/M/1/{\infty},\;M/D/I/{\infty}\;and\;M/H_{2}/1/{\infty}$ queueing systems on a single processor and multiple processors. By using multiple processors under the MRIP scenario, the time for collecting many replications needed in sequential coverage analysis is reduced. One can also easily collect more replications by executing it in distributed computers or clusters linked by a local area network.

본 논문에서는 분산 시뮬레이션 기법 중에 하나인 MRIP(Multiple Replications In Parallel) 시나리오에서 각종 순차적인 시뮬레이션 분석 방법들의 성능을 측정할 수 있는 포함범위(Coverage)에 대한 신뢰구간(confidence intervals) 및 속도향상(Speedup)에 대해 살펴보았다. F-분포를 기반으로 한 신뢰구간에 대한 추정기(estimator)를 단일 프로세서와 다중 프로세서 상에서 참조모델(reference model)로 $M/M/1/{\infty},\;M/D/I/{\infty}과\;M/H_{2}/1/{\infty}$큐잉 시스템을 활용하여 정상상태(steady-state)에서의 평균치를 추정하는 시뮬레이션에 적용하였다. 순차적인 포함범위 분석을 위해서는 수많은 시뮬레이션 실행(Run)들이 요구되는데, MRIP 분산 시뮬레이션 시나리오에서 다중 프로세서를 이용하여 시뮬레이션을 수행하여 최종 시뮬레이션 결과를 얻는데 걸리는 신간을 감소시켰다. 또한, LNA으로 연결된 분산 컴퓨팅 시스템에 시뮬레이션을 동시에 수행시킴으로써 쉽게 필요한 수의 시뮬레이션 실행결과(Run)를 수집할 수 있다. 이는 샘플의 수가 증가됨으로써 좀더 신뢰도가 높은 최종 신뢰구간을 시뮬레이션 수행자가 얻을 수 있게 해준다.

Keywords

References

  1. M. Abramowitz and I. A. Stegun, 'Handbook of Mathematical Functions,' Government Printing Office. New York: Dover Publications, Inc., 1964
  2. G. C. Ewing, K. Pawlikowski and D. McKickle, 'Akaroa-2 : Exploiting Network Computing by Distributing Stochastic Simulation,' 13th European Simulation Multiconferencc, Warsaw, Poland, pp.175-181, 1999
  3. B. Fox, 'Estimation and Simulation,' Management Science. Vol.24, pp.860-861, 1978
  4. P. W. Glynn, 'Coverage Error for Confidence Intervals Arising in Simulation Output Analysis,' Proceedings of the 1982 Winter Simulation Conference, pp.369-375, 1982
  5. A. Hald, 'Statistical Theory with Engineering Applications,' John Wiley and Sons, Inc., 1952
  6. P. Heidelberger and P. D. Welch, 'A Spectral Method for Confidence Interval Generation and RunLength Control in Simulations,' Communications of the ACM. Vol.25, pp.233-245, 1981 https://doi.org/10.1145/358598.358630
  7. J. Judge, H. W. P. Beadle and J. Chicharo, 'Correlation of HTTP Response Packet Size and Estimating Confidence intervals for Mean Packet Size and WWW Traffic Volume,' Proceedings of APCC 1997, Sydney, Australia, pp.382-386, 1997
  8. S. S. Lavenberg and C. H. Sauer, 'Sequential Stopping Rules for the Regenerative Method of Simulation,' IBM Journal of Research Development, pp.545-558, 1977
  9. A. M. Law and W. D. Kelton, 'Confidence Intervals for Steady-State Simulations, II : A Survey of Sequential Procedures,' Management Science. Vol.28 (5), pp.550-562, 1982 https://doi.org/10.1287/mnsc.28.5.550
  10. A. M. Law and W. D. Kelton, 'Simulation Modeling and Analysis,' McGraw-Hill, Inc., 2nd Ed., 1991
  11. J. R. Lee and D. McKickle and K. Pawlikowski, 'Quality of Sequential Regenerative Simulation,' 13th European Simulation Multiconference, Warsaw, Poland, pp.161-167, 1999
  12. J. R. Lee, K. Pawlikowski and D. McNickle, 'Do Not Trust Too Short Sequential Simulation,' Proceedings of the 1999 Summer Computer Simulation Conference, Chicago, Illinois, pp.97-102, 1999
  13. Jong-Suk Ruth Lee, 'On Automated Sequential Steady-State Simulation,' Ph. D. Dissertation, Department of Computer Science, University of Canterbury, New Zealand, 2001
  14. D. C. McKickle, K. Pawlikowski and G. Ewing, 'Experimental Evaluation of Confidence Interval Procedures in Sequential Steady-State Simulation,' Proceedings of the 1996 Winter Simulation Conference, pp.382-389, 1996 https://doi.org/10.1145/256562.256690
  15. D. S. Moore and G. P. McCabe, 'Introduction to the Practice of Statistics,' W. H. Freeman and Company, New York, 2nd Ed., 1996
  16. K. Pawlikowski, D. C. McNickle and G. Ewing, 'Coverage of Confidence Intervals in Sequential Steady-State Simulation,' Simulation Practice and Theory. Vol.6, pp.255-267, 1998 https://doi.org/10.1016/S0928-4869(96)00030-4
  17. K. Pawlikowski, V. Yau and D. C. McNickle, 'Distributed and Stochastic Discrete-event Simulation in Parallel Time Streams,' Proceedings of the 1994 Winter Simulation Conference, Lake Buena Vista, Florida, pp.723-730, 1994 https://doi.org/10.1109/WSC.1994.717420
  18. D. B. Rubin and K Schenker, 'Efficiently Simulating the Coverage Properties of Interval Estimates,' Applied Statisties. Vol.35 (2), pp.159-167, 1986 https://doi.org/10.2307/2347266
  19. C. H. Sauer. 'Confidence Intervals for Queueing Simulations of Computer Systems,' ACM Performance Evaluation Review. Vol.8 (1-2), pp.46-55, 1979 https://doi.org/10.1145/1041853.1041856
  20. L. W. Schruben, 'A Coverage Function for Interval Estimators of Simulation Response,' Management Science. Vol.26, pp.18-27, 1980 https://doi.org/10.1287/mnsc.26.1.18
  21. R. E. Walpole and R. H. Myers, 'Probability and Statistics for Engineers and Scientists,' Macmillan Publishing Co., Inc., New York, 2nd Ed., 1978