ETRI Journal

  • 제31권2호
  • /
  • Pages.140-150
  • /
  • 2009
  • /
  • 1225-6463(pISSN)
  • /
  • 2233-7326(eISSN)
한국전자통신연구원 (Electronics and Telecommunications Research Institute)
권호 표지

Statistical Investigation on Class Mutation Operators

  • 투고 : 2008.06.23
  • 심사 : 2009.02.17
  • 발행 : 2009.04.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Although mutation testing is potentially powerful, it is a computationally expensive testing method. To investigate how we can reduce the cost of object-oriented mutation testing, we have conducted empirical studies on class mutation operators. We applied class mutation operators to 866 classes contained in six open-source programs. An analysis of the number and the distribution of class mutants generated and preliminary data on the effectiveness of some operators are provided. Our study shows that the overall number of class mutants is smaller than for traditional mutants, which offers the possibility that class mutation can be made practically affordable.

키워드

참고문헌

  1. R.A. DeMillo et al., “Hints on Test Data Selection: Help for the Practicing Programmer,” IEEE Computer, vol. 11, no. 4, Apr. 1978, pp. 34-41.
  2. R.G. Hamlet, “Testing Programs with the Aid of a Compiler,” IEEE Trans. on Software Engineering, vol. 3, no. 4, July 1977, pp. 279-290.
  3. A.J. Offutt et al., “An Experimental Determination of Sufficient Mutation Operators,” ACM Trans. on Software Engineering Methodology, vol. 5, no. 2 Apr. 1996, pp. 99-118. https://doi.org/10.1145/227607.227610
  4. W.E. Wong and A.P. Mathur, “Reducing the Cost of Mutation Testing: An Empirical Study,” The J. of Systems and Software, vol. 31, no. 3, Dec. 1995, pp. 185-196. https://doi.org/10.1016/0164-1212(94)00098-0
  5. A.P. Mathur, “Performance, Effectiveness, and Reliability Issues in Software Testing,” Proc. of the 15th Annual Int'l Computer Software and Applications Conf., Tokyo, Japan, Sept. 1991, pp. 604-605.
  6. W.E. Wong, On Mutation and Data Flow, PhD thesis, Purdue University, West Lafayette, Indiana, Dec. 1993.
  7. A.J. Offutt, G. Rothermel, and C. Zapf, “An Experimental Evaluation of Selective Mutation,” Proc. of the 15th Int'l Conf. on Software Engineering, Baltimore, Maryland, USA, May 1993, pp. 100-107.
  8. R.A. DeMillo et al., “An Extended Overview of the Mothra SoftwareTesting Environment,” Proc. of the 2nd Workshop on SoftwareTesting, Verification, and Analysis, July 1988, pp. 142-151.
  9. M.E. Delamaro and J.C. Maldonado, “Proteum: A Tool for the Assessment of Test Adequacy for C Programs,” Proc. of the Conf. on Performability in Computing Systems, July 1996, pp. 75-95.
  10. M.E. Delamaro, J.C. Maldonado, and A.P. Mathur, “Interface Mutation: An Approach to Integration Testing,” IEEE Trans. on Software Engineering, vol. 27, no. 3, Mar. 2001, pp. 228-247. https://doi.org/10.1109/32.910859
  11. S. Kim, J. Clark, and J. McDermid, “Class Mutation: Mutation Testing for Object-Oriented Programs, Net. Object Days Conference on Object-Oriented Software Systems, Oct. 2000.
  12. Y.S. Ma, A.J. Offutt, and Y.R. Kwon, “MuJava: An Automated Class Mutation System,” Software Testing, Verification, and Reliability, vol. 15, no. 2, June 2005, pp. 97-133. https://doi.org/10.1002/stvr.308
  13. Y.S, Ma, A.J. Offutt, and Y.R. Kwon, MuJava home page. online. http://salmosa.kaist.ac.kr/LAB/Mujava/,http://ise.gmu.edu/~offutt/mujava/
  14. A.J. Offutt, Y.S. Ma, and Y.R. Kwon “The Class-Level Mutants of MuJava,” Proc. of the 2006 Int'l Workshop on Automation of Software Test, pp. 78-84.
  15. R.A. DeMillo and A.J. Offutt, “Constraint-Based Automatic Test Data Generation,” IEEE Trans. on Software Engineering, vol. 17, no. 9, Sept. 1991, pp. 900-910. https://doi.org/10.1109/32.92910
  16. A.J. Offutt and S.D. Lee, “An Empirical Evaluation of Weak Mutation.,” IEEE Trans. on Software Engineering, vol. 20, no. 5, May 1994, pp. 337-344. https://doi.org/10.1109/32.286422
  17. Y.S. Ma, M.J. Harrold, and Y.R. Kwon, “Evaluation of Mutation Testing for Object-Oriented Programs, Proc. of the 28th Int'l Conf. on Software Engineering, 2006, pp. 869-872.
  18. E.F. Barbosa, J.C. Maldonado and A.M.R. Vincenzi, “Toward the Determination of Sufficient Mutant Operators for C,” The J. Software Testing, Verification, and Reliability, vol. 11, 2001, pp. 113-136. https://doi.org/10.1002/stvr.226
  19. B.H. Smith and LaurieWilliams, “An Empirical Evaluation of Killing Mutants,” Third Workshop on Mutation Analysis (Mutation 2007).