A Method of Selecting Test Metrics for Certifying Package Software using Bayesian Belief Network

베이지언 사용한 패키지 소프트웨어 인증을 위한 시험 메트릭 선택 기법

  • 이종원 (서울대학교 전기.컴퓨터공학부) ;
  • 이병정 (서울시립대학교 컴퓨터공학부) ;
  • 오재원 (삼성전자 모바일연구소) ;
  • 우치수 (서울대학교 전기.컴퓨터공학부)
  • Published : 2006.10.15

Abstract

Nowadays, due to the rapidly increasing number of package software products, quality test has been emphasized for package software products. When testing software products, one of the most important factors is to select metrics which form the bases for tests. In this paper, the types of package software are represented as characteristic vectors having probabilistic relationships with metrics. The characteristic vectors could be regarded as indicators of software type. To assign the metrics for each software type, the past test metrics are collected and analyzed. Using Bayesian belief network, the dependency relationship network of the characteristic vectors and metrics is constructed. The dependency relationship network is then used to find the proper metrics for the test of new package software products.

오늘날 급속한 패키지 소프트웨어 제품의 증가 추세에 따라서, 소프트웨어 제품에 대한 품질 시험 요구 또한 증가하였다. 소프트웨어 제품 시험 시 중요한 요소는 무엇을 시험할지 기준이 되는 메트릭의 선정이다. 본 연구에서는 패키지 소프트웨어 종류를 특성 벡터들로 표현하여 메트릭들과의 연관 관계를 확률로서 세밀하게 표현한다. 특성 벡터란 소프트웨어의 형식 분류 지시자라고 할 수 있으며 특정한 패키지 소프트웨어가 다른 것들과 어떻게 구별되는지 나타낼 수 있다. 분류된 각각의 소프트웨어 형식별로 메트릭을 선정하기 위해서 과거 시험 데이타를 분석하여 활용한다. 베이지언망이 과거 데이타 분석에 이용되며 특성 벡터와 메트릭 간의 의존 관계 네트워크를 구축한다. 구축된 베이지언망은 새로운 패키지 소프트웨어 시험 작업에 적절한 메트릭을 찾아내는데 활용된다.

Keywords

References

  1. Boehm, B., 'Managing software productivity and reuse,' IEEE Computer, Vol. 32, No. 9, pp. 111-113, Sep. 1999 https://doi.org/10.1109/2.789755
  2. Sommerville, I., Software Engineering (7th Ed.), Addison Wesley, 2004
  3. Friedman, M. A., and Voas, J. M., Software Assessment: Reliability, Safety, Testability, New York: John Wiley & Sons, Inc., 1995
  4. Jones, C., Software Assessments, Benchmarks, and Best Practices, New York: Addison-Wesley, 2000
  5. Voas, J., 'Limited software warranties,' In Proc. of 7th IEEE International Conference and Workshop on the Engineering of Computer Based Systems, pp. 56-61, 2000 https://doi.org/10.1109/ECBS.2000.839861
  6. ISO/IEC, 'DTR 9126-2: Software Engineering - Product quality Part 2 - External metrics,' ISO/ IEC JTC1/SC7 N2419, 2001
  7. Basili, V. R., and Boehm, B., 'COTS-based systems top 10 list,' IEEE Computer, Vol. 34, No.5, pp. 91-95, May 2001 https://doi.org/10.1109/2.920618
  8. Dick, S., and Kandel, A., 'Fuzzy clustering of software metrics,' In Proc. of The 12th IEEE International Conference on Fuzzy Systems 2003, FUZZ '03, Vol. 1, pp. 642-647, May 2003 https://doi.org/10.1109/FUZZ.2003.1209439
  9. Oh, J., Lee, B., Park, D., Lee, J., Hong, E., and Wu, C., 'Using hierarchical classification to certify software packages,' In Proc. of 1st ACIS International Conference on Software Engineering Research & Applications (SERA '03), pp. 270-275, 2003
  10. Lee, C., Oh, J., Lee, B., and Wu, C., 'Selecting metrics for package software certification using Formal Concept Analysis,' In Proc. of 2nd International Conference on Software Engineering Research & Applications (SERA '04), pp, 291-297, May 2004
  11. 김용대, 베이지안 통계학, 자유아카데미, 2000
  12. Vivanco, R. A., and Pizzi, N. J., 'Identifying effective software metrics using genetic algorithms,' In Proc. of Canadian Conference on Electrical and Computer Engineering, Vol. 2, pp. 1305-1308, 2003 https://doi.org/10.1109/CCECE.2003.1226139
  13. Alexiuk, M. D., and Pizzi, N. J., 'Discriminatory software metric selection via a grid of interconnected multilayer perceptrons,' In Proc. of Canadian Conference on Electrical and Computer Engineering, Vol. 2, pp. 1131-1134, May 2003 https://doi.org/10.1109/CCECE.2003.1226096
  14. Fenton, N. E., and Neil, M., 'A critique of software defect prediction models,' IEEE Transactions on Software Engineering, Vol. 25, No. 5, pp. 675-689, Sep./Oct. 1999 https://doi.org/10.1109/32.815326
  15. Neil, M., and Fenton, N. E., 'Predicting software quality using Bayesian belief networks,' In Proc. of 21st Anniversary Software Engineering Workshop, NASA Goddard Space Flight Centre, pp, 217-230. Dec. 1996
  16. Fenton, N., Krause, P., and Neil, M., 'Software measurement: uncertainty and causal modeling,' IEEE Software, Vol. 19, No. 4, pp. 116-122, Jul./Aug. 2002 https://doi.org/10.1109/MS.2002.1020298
  17. Mitchell, M. T., Machine Learning, McGraw-Hill, 1997
  18. Telecommunications Technology Association (TTA), 'Standard for a classification scheme of software reuse,' TTAS.KO-11.0026, 2000
  19. Ziv, H., and Richardson, D., 'Bayesian confirmation of software testing uncertainties,' In Proc. of International Conference on Software Maintenance, Sep, 1997
  20. Heckerman, D., 'A tutorial on learning with Bayesian networks,' Technical Report MSR-TR95-06, Microsoft Research, Redmond, WA, 1995
  21. Fenton, N. E., and Neil, M., 'Software metrics: Roadmap,' The Future of Software Engineering, Anthony Finkelstein (Ed.), ACM Press 2000 https://doi.org/10.1145/336512.336588
  22. Lauritzen, S. J., and Spiegelhalter, D. J. 'Local computations with probabilities on graphical structures and their application to expert systems (with discussion),' J. R. Statistical Society Series B, Vol. 50, No. 2, pp. 157-224, 1988