DOI QR코드

DOI QR Code

Critical Success Factors for Implementing Software Test Automation

SW 테스트 자동화 구현을 위한 핵심성공요인에 관한 연구

  • Received : 2020.11.04
  • Accepted : 2020.11.24
  • Published : 2020.12.31

Abstract

This study attempts to derive critical success factors and prioritize activities for implementing the automation of software test. Software testing proceeds in five steps of test plan, test case design, test scripting & test environment setup, test execution & evaluation, and test closure. From the literature, twenty influence factors in the five steps were identified. Focus Group Interviews with ten experts in software testing selected fourteen factors on the basis of importance and feasibility. Some factors were further divided to clarify their meanings and the number of influence factors finally became twenty one. A survey on the influence factors was conducted with 75 IT professionals. An importance-feasibility analysis was applied to the survey responses and classified the influence factors into four groups of essential factors, critical factors, low priority factors, and minimal factors. Essential factors include objectives for test automation, strategies for test automation, test automation training, test automation education, setting up test automation environment, setting up test environment, test automation tool selection. Critical factors include management's continued support, management's continued interest, role of automation engineers, and skills of automation engineers. This result suggests that a lot of efforts should be put into SW test plan for the successful SW test automation and SW automation should proceed in consideration with the priorities and resource consumption.

Keywords

References

  1. Berner, S., Weber, R., and Keller, R. K., "Observations and Lessons Learned from Automated Testing," Proc. of International Conference on Software Engineering, 2005, pp. 571-579.
  2. Chung, Y., Lee, K. J., and Kim, S. K., "A Study of Utilizing IPA in Urban Geriatric Hospital Choice Factor", Health and Social Welfare Review, Vol. 34, No. 1, 2014, pp.133-158. https://doi.org/10.15709/hswr.2014.34.1.133
  3. Dustin, E., Garrett, T., and Gauf, B., "Implementing automation software testing : how to save time and lower costs while raising quality", Addison-Wesley Professional, 2009.
  4. Garousi, V. and Elberzhager, F., "Test automation : not just for test execution", IEEE Software, Vol. 34, No. 2, 2017, pp. 90-96. https://doi.org/10.1109/MS.2017.34
  5. Graham, D. and Fewster, M., "Experiences of test automation : Case studies of software test automation", Addison-Wesley Professional, 2012.
  6. Karhu, K., Repo, T., Taipale, O., and Smolander, K., "Empirical observations on software testing automation," in Proceedings of the 2nd International Conference on Software Testing, Verification, and Validation (ICST '09), Denver, Colo, USA, April 2009, pp. 201-209.
  7. Kasurinen, J., Taipale, O., and Smolander, K., "Software test automation in practice : Empirical observations", Advances in Software Engineering, 2010, pp. 1-13.
  8. Kim, K. W. and Kim, J. D., "A Study on Critical Success Factors for Implementing Information Security Governance", Journal of Digital Convergence, Vol. 8, No. 4, 2010, pp. 97-108.
  9. Kim, S. G., Ko, B. S., Cho, S. H., and Lee, S. E., "Analysis of Relationship between Software Engineering Levels and Software Quality Costs", Journal of KISS : Software and Applications, Vol. 38, No. 10, 2011, pp. 512-523.
  10. Lee, H. J. and Kwon, W. I., Practical Software Testings for the Developers Third Edition, STA, 2011.
  11. Martilla, J. and James, J. C., "Importance-Performance analysis," Journal of Marketing, Vol. 41, No. 1, 1977, pp. 13-17. https://doi.org/10.2307/1250226
  12. Ng, S. P., Murnane, T., Reed, K., Grant, D., and Chen, T. Y., "A preliminary survey on software testing practices in Australia," in Proceedings of the Australian Software Engineering Conference (ASWEC '04), Melbourne, Australia, April 2004, pp. 116-125.
  13. Osterweil, L. J., "Software processes are software too, revisited : An invited talk on the most influential paper of ICSE 9," in Proceedings of the 19th IEEE International Conference on Software Engineering, Boston, Mass, USA, 1997, pp. 540-548.
  14. Park, H. Y., Kim, Y. J,, and Chu, S. H., "Importance-Performance Analysis(IPA) to Improve Emergency Care for Novice Nurses", J. Korean Acad Fundam Nurs., Vol. 26 No. 3, 2019, pp. 155-165. https://doi.org/10.7739/jkafn.2019.26.3.155
  15. Rabiee, F., "Focus-group interview and data analysis," Proceedings of the Nutrition Society, Vol. 63, No. 4, 2004, pp. 655-660. https://doi.org/10.1079/PNS2004399
  16. Ramler, R. and Wolfmaier, K., "Observations and lessons learned from automated testing," in Proceedings of the International Workshop on Automation of Software Testing (AST '06), Shanghai, China, 2006, pp. 85-91.
  17. Rockart, J. F., "The changing role of the information systems executive : a critical success factors perspective", Sloan Management Review, Vol. 24, No. 1, 1982, pp. 3-13.
  18. Rockart, J. F., "Chief executives define their own data needs", Harvard Business Review, Vol. 57, No. 2, 1979, pp. 81-93.
  19. Rosenfeld, A., Kardashov, O., and Zang, O., "Automation of Android Applications Testing Using Machine Learning Activities Classification", ArXiv e-prints, September 2017.
  20. Taipale, O. and Smolander, K., "Improving software testing by observing causes, effects, and associations from practice", in Proceedings of the International Symposium on Empirical Software Engineering(ISESE '06), Rio de Janeiro, Brazil, September 2006a.
  21. Taipale, O., Smolander, K., and Kalviainen, H., "Cost reduction and quality improvement in software testing," in Proceedings of the 14th International Software Quality Management Conference (SQM '06), Southampton, UK, April 2006b.
  22. Yoo, C.B. and Yang, H.S., "A Study on the Critical Success Factors for Each Phase of the Introduction of ERP Systems", Journal of the Society of Korea Industrial and Systems Engineering, Vol. 25, No. 3, 2002, pp. 64-77.