Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Component-Based System Reliability using MCMC Simulation

  • ChauPattnaik, Sampa (Department of Computer Science and Engineering, Siksha 'O' Anusandhan (Deemed to be) University) ;
  • Ray, Mitrabinda (Department of Computer Science and Engineering, Siksha 'O' Anusandhan (Deemed to be) University) ;
  • Nayak, Mitalimadhusmita (Department of Mathematics, Siksha 'O' Anusandhan (Deemed to be) University) ;
  • Patnaik, Srikanta (Department of Computer Science and Engineering, Siksha 'O' Anusandhan (Deemed to be) University)
  • Received : 2021.01.28
  • Accepted : 2022.05.10
  • Published : 2022.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

To compute the mean and variance of component-based reliability software, we focused on path-based reliability analysis. System reliability depends on the transition probabilities of components within a system and reliability of the individual components as basic input parameters. The uncertainty in these parameters is estimated from the test data of the corresponding components and arises from the software architecture, failure behaviors, software growth models etc. Typically, researchers perform Monte Carlo simulations to study uncertainty. Thus, we considered a Markov chain Monte Carlo (MCMC) simulation to calculate uncertainty, as it generates random samples through sequential methods. The MCMC approach determines the input parameters from the probability distribution, and then calculates the average approximate expectations for a reliability estimation. The comparison of different techniques for uncertainty analysis helps in selecting the most suitable technique based on data requirements and reliability measures related to the number of components.

Keywords

References

  1. R. C. Cheung, "A user-oriented software reliability model", IEEE transactions on Software Engineering, vol. SE-6, no. SE-2, pp. 118-125, Mar. 1980. DOI: 10.1109/TSE.1980.234477.
  2. B. Littlewood, "Software reliability model for modular program structure," IEEE Transactions on Reliability, vol. R-28, no. 3, pp. 241-246, Aug. 1979. DOI: 10.1109/TR.1979.5220576.
  3. J. -C. Laprie, "Dependability evaluation of software systems in operation," IEEE Transactions on software engineering, vol. SE-10, no. 6, pp. 701-714, Nov. 1984. DOI: 10.1109/TSE.1984.5010299.
  4. P. Kubat, "Assessing reliability of modular software," Operations research letters, vol. 8, no. 1, pp. 35-41, Feb. 1989. DOI: 10.1016/0167-6377(89)90031-X.
  5. S. S. Gokhale and K. S. Trivedi, "Reliability prediction and sensitivity analysis based on software architecture," in Proceedings of the 13th International Symposium on Software Reliability Engineering, Annapolis: MD, USA, pp. 64-75, 2002. DOI: 10.1109/ISSRE.2002.1173214.
  6. S. Yacoub, B. Cukic, and H. H. Ammar, "A scenario-based reliability analysis approach for component-based software," IEEE transactions on reliability, vol. 53, no. 4, pp. 465-480, Dec. 2004. DOI: 10.1109/TR.2004.838034.
  7. J. D. Musa, "Operational profiles in software-reliability engineering," IEEE software, vol. 10, no. 2, pp. 14-32, Mar. 1993. DOI: 10.1109/52.199724.
  8. A. L. Goel, "Software reliability models: Assumptions, limitations, and applicability," IEEE Transactions on software engineering, vol. SE-11, no, 12, pp. 1411-1423, Dec. 1985. DOI: 10.1109/TSE.1985.232177.
  9. K. Goseva-Popstojanova, A. P. Mathur, and K. S. Trivedi, "Comparison of architecture-based software reliability models," in Proceedings of the 12th International Symposium on Software Reliability Engineering, Hong Kong, China, pp. 22-31, 2001. DOI: 10.1109/ISSRE.2001.989455
  10. M. R. T. Lyu, "Software reliability theory," in Encyclopaedia of Software Engineering. DOI:10.1002/0471028959.sof329.
  11. J. D. Musa, A. Iannino and K. Okumoto, "Software reliability," in Advances in computers, vol. 30, Academic Press Inc., pp. 85-170, 1990.
  12. S. S. Gokhale, "Architecture-based software reliability analysis: Overview and limitations," IEEE Transactions on dependable and secure computing, vol. 4, no. 1, pp. 32-40, Jan-Mar. 2007. DOI: 10.1109/TDSC.2007.4.
  13. A. L. Goel and K. Okumoto, "A Markovian model for reliability and other performance measures of software systems," in 1979 International Workshop on Managing Requirements Knowledge (MARK), New York: NY, pp. 769-774, 1979. DOI: 10.1109/MARK.1979.8817248.
  14. S. K. Chandran, A. Dimov, and S. Punnekkat, "Modeling uncertainties in the estimation of software reliability-a pragmatic approach," in 2010 Fourth International Conference on Secure Software Integration and Reliability Improvement, Singapore, pp. 227-236, Jun. 2010. DOI: 10.1109/SSIRI.2010.22.
  15. L. Cheung, L. Golubchik, N. Medvidovic, and G. Sukhatme, "Identifying and addressing uncertainty in architecture-level software reliability modelling," in 2007 IEEE International Parallel and Distributed Processing Symposium, Long Beach: CA, USA, pp. 1-6. Mar. 2007. DOI: 10.1109/IPDPS.2007.370524.
  16. Y. S. Dai, M. Xie, Q. Long, and S. -H. Ng, "Uncertainty analysis in software reliability modeling by bayesian analysis with maximum-entropy principle," IEEE Transactions on Software Engineering, vol. 33 no. 11, pp. 781-795, Oct. 2007. DOI: 10.1109/TSE.2007.70739
  17. W. W. Everett, "Software component reliability analysis," in Proceedings 1999 IEEE Symposium on Application-Specific Systems and Software Engineering and Technology. ASSET'99 (Cat. No. PR00122), Richardson: TX, USA, pp. 204-211, 1999. DOI: 10.1109/ASSET.1999.756770.
  18. L. Yin, M. A. Smith, and K. S. Trivedi, "Uncertainty analysis in reliability modelling," in Annual Reliability and Maintainability Symposium. 2001 Proceedings. International Symposium on Product Quality and Integrity (Cat. No. 01CH37179), Philadelphia: PA, USA, pp. 229-234, 2021. DOI: 10.1109/RAMS.2001.902472.
  19. M. A. Haque and N. Ahmad, "Modified Goel-Okumoto Software Reliability Model Considering Uncertainty Parameter," in Mathematical Modeling, Computational Intelligence Techniques and Renewable Energy, vol. 1405, pp. 369-379, 2022. DOI: 10.1007/978-981-16-5952-2_32.
  20. Z. Liu, S. Yang, and R. Kang, "Software belief reliability growth model based on uncertain differential equation," IEEE Transactions on Reliability, pp. 1-13, Mar. 2022. DOI: 10.1109/TR.2022.3154770.
  21. R. Dhaka, B. Pachauri, and A. Jain, "Two-Dimensional Software Reliability Model with Considering the Uncertainty in Operating Environment and Predictive Analysis," in Data Engineering for Smart Systems, vol. 238, pp. 57-69, 2022. DOI: 10.1007/978-981-16-2641-8_6.
  22. C. Zhang and A. Mostashari, "Influence of component uncertainty on reliability assessment of systems with continuous states," International Journal of Industrial and Systems Engineering, vol. 7, no. 4, pp. 542-552, Apr. 2011. https://doi.org/10.1504/IJISE.2011.039674
  23. S. V. Dhople, Y. C. Chen, and A. D. Dominguez-Garcia, "A set-theoretic method for parametric uncertainty analysis in Markov reliability and reward models," IEEE Transactions on Reliability, vol. 62, no. 3, pp. 658-669, Sep. 2013. DOI: 10.1109/TR.2013.2270421.
  24. P. Ju, H. Li, X. Pan, C. Gan, Y. Liu, and Y. Liu, "Stochastic dynamic analysis for power systems under uncertain variability," IEEE Transactions on Power Systems, vol. 33, no. 4, pp. 3789-3799, Jul. 2018. DOI: 10.1109/TPWRS.2017.2777783.
  25. I. Meedeniya, I. Moser, A. Aleti, and L. Grunske, "Architecture-based reliability evaluation under uncertainty," in Proceedings of the joint ACM SIGSOFT conference--QoSA and ACM SIGSOFT symposium--ISARCS on Quality of software architectures--QoSA and architecting critical systems--ISARCS, pp. 85-94, Jun. 2011. DOI: 10.1145/2000259.2000275.
  26. L. Fiondella and S. S. Gokhale, "Software reliability with architectural uncertainties," in 2008 IEEE International Symposium on Parallel and Distributed Processing, Miami: FL, USA, pp. 1-5, 2008. DOI: 10.1109/IPDPS.2008.4536436.
  27. K. Go, M. Hamill, and X. Wang, "Adequacy, accuracy, scalability, and uncertainty of architecture-based software reliability: Lessons learned from large empirical case studies," in 2006 17th International Symposium on Software Reliability Engineering, Raleigh: NC, USA, pp. 197-203, 2006. DOI: 10.1109/ISSRE.2006.11.
  28. I. Gashi, P. Popov, and V. Stankovic, "Uncertainty explicit assessment of off-the-shelf software: A Bayesian approach," Information and Software Technology, vol. 51, no. 2, pp. 497-511, Feb. 2009. DOI:10.1016/j.infsof.2008.06.003.
  29. K. Goseva-Popstojanova and S. Kamavaram, "Assessing uncertainty in reliability of component-based software systems," in14th International Symposium on Software Reliability Engineering, ISSRE 2003, Denver: CO, USA, pp. 307-320.DOI:10.1109/ISSRE.2003.1251052.
  30. K. Goseva-Popstojanova and S. Kamavaram, "Uncertainty analysis of software reliability based on method of moments," in 13th Int'l Symp. Software Reliability Engineering, pp. 143-144, 2002.
  31. D. K. Mohanta and D. S. Roy, "Importance and uncertainty analysis in software reliability assessment of computer relay," in Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, vol. 225, no. 1, pp. 50-61, Jun. 2011. DOI: 10.1177/1748006XJRR341.
  32. Y. Wang, X. Gao, Y. Cai, M. Yang, S. Li, and Y. Li, "Reliability evaluation for aviation electric power system in consideration of uncertainty," Energies, vol. 13, no. 5, p. 1175, Mar. 2020. DOI: 10.3390/en13051175.
  33. A. K. Verma, S. Ajit, and D. R. Karanki, "Uncertainty analysis in reliability/safety assessment," in Reliability and Safety Engineering, pp. 457-491, Sep. 2015. DOI: 10.1007/978-1-4471-6269-8_13.
  34. K. Goseva-Popstojanova and K. S. Trivedi, "Architecture-based approach to reliability assessment of software systems," Performance Evaluation, vol. 45, no. 2-3, pp.179-204, Jul. 2001. DOI: 10.1016/S0166-5316(01)00034-7.
  35. C. -J. Hsu and C. -Y. Huang, "An adaptive reliability analysis using path testing for complex component-based software systems," IEEE Transactions on Reliability, vol. 60, no. 1, pp. 158-170, Mar. 2011. DOI: 10.1109/TR.2011.2104490.
  36. D. V. Ravenzwaaij, P. Cassey, and S. D. Brown, "A simple introduction to Markov Chain Monte-Carlo sampling," Psychonomic bulletin & review, vol. 25, no. 1, pp. 143-154, Mar. 2018. DOI: 10.3758/s13423-016-1015-8.
  37. B. Zhou, H. Okamura, and T. Dohi, "Markov chain Monte Carlo random testing," in Advances in Computer Science and Information Technology, Heidelberg, German, vol. 6059, pp. 447-456. DOI: 10.1007/978-3-642-13577-4_40.
  38. F. S. Hillier and G. J. Lieberman, "A special algorithm for the assignment problem," in Introduction to Operations Research, 9th ed., McGraw-Hill Education, pp. 342-346, 2008.
  39. D. Hamlet, D. Mason, and D. Woitm, "Theory of software reliability based on components," in Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001, Toronto: ON, Canada, pp. 361-370, 2001. DOI: 10.1109/TR.2011.2104490.
  40. S. Krishnamurthy and A. P. Mathur, "On the estimation of reliability of a software system using reliabilities of its components," in Proceedings of The Eighth International Symposium on Software Reliability Engineering, Albuquerque: NM, USA, pp. 146-155, 1997. DOI: 10.1109/ISSRE.1997.630860.
  41. M. L. Shooman, "Structural models for software reliability prediction," in Proceedings of the 2nd International Conference on Software engineering, pp. 268-280, Oct. 1976.
  42. M. Xie and C.Wohlin, "An additive reliability model for the analysis of modular software failure data," in Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'9, Toulouse, France, pp. 188-194, 1995. DOI: 10.1109/ISSRE.1995.497657.
  43. F. Zhang, X. Zhou, J. Chen, and Y. Dong, "A novel model for component-based software reliability analysis," in 2008 11th IEEE High Assurance Systems Engineering Symposium, Nanjing, China, pp. 303-309. 2008. DOI: 10.1109/HASE.2008.41.