Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Novel Approach for Deriving Test Scenarios and Test Cases from Events

  • Singh, Sandeep K. (Department of Computer Science and Engineering and Information Technology, JIIT University) ;
  • Sabharwal, Sangeeta (Division of Computer Science and Engineering, NSIT) ;
  • Gupta, J.P. (Sharda University)
  • Received : 2011.04.27
  • Accepted : 2012.03.19
  • Published : 2012.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Safety critical systems, real time systems, and event-based systems have a complex set of events and their own interdependency, which makes them difficult to test ma Safety critic Safety critical systems, real time systems, and event-based systems have a complex set of events and their own interdependency, which makes them difficult to test manually. In order to cut down on costs, save time, and increase reliability, the model based testing approach is the best solution. Such an approach does not require applications or codes prior to generating test cases, so it leads to the early detection of faults, which helps in reducing the development time. Several model-based testing approaches have used different UML models but very few works have been reported to show the generation of test cases that use events. Test cases that use events are an apt choice for these types of systems. However, these works have considered events that happen at a user interface level in a system while other events that happen in a system are not considered. Such works have limited applications in testing the GUI of a system. In this paper, a novel model-based testing approach is presented using business events, state events, and control events that have been captured directly from requirement specifications. The proposed approach documents events in event templates and then builds an event-flow model and a fault model for a system. Test coverage criterion and an algorithm are designed using these models to generate event sequence based test scenarios and test cases. Unlike other event based approaches, our approach is able to detect the proposed faults in a system. A prototype tool is developed to automate and evaluate the applicability of the entire process. Results have shown that the proposed approach and supportive tool is able to successfully derive test scenarios and test cases from the requirement specifications of safety critical systems, real time systems, and event based systems.

Keywords

References

  1. Singh, S.K., Sabharwal, S., Gupta, J.P. "An event-based methodology to generate class diagrams and its empirical evaluation", Journal of Computer Science, 6 (11), January, 2010, pp.1301-1325. https://doi.org/10.3844/jcssp.2010.1301.1325
  2. Singh, K.,Sandeep, Sabharwal, Sangeeta, and Gupta, J.P., "Event Patterns for Object Oriented Requirement Analysis" in Proceedings of IASTED International Conferences on Advances in Computer Science and Technology, April 2-4 , 2008, pp.115-120.
  3. Sandeep K. Singh, Sangeeta Sabharwal, J. P. Gupta: Events - An Alternative to Use Case as Starting Point in Object-Oriented Analysis. ICETET 2009: 1004-1010.
  4. McMenamin, Stephen M.; John F. Palmer (1984). Essential Systems Analysis. Prentice-Hall (Yourdon Press). ISBN 0132879050.
  5. Yourdon Edward (2003) "Modern structured analysis" Publisher Prentice-Hall India New Delhi 2003
  6. Monique Snoeck, Guido Dedene, Object-oriented modelling with events, TOOLS Europe 2000, Tutorial (3h), Tuturial notes and text available via http://merode.econ.kuleuven.ac.be/publications.aspx.
  7. Monique Snoeck, Geert Poels, "Analogical Reuse of Structural and Behavioural Aspects of Event- Based Object-Oriented Domain Models", Domaine Engineering Workshop, Proceedings of the 11th International Workshop on Database and Expert Systems Applications, London (Greenwich), 4-8 Sept. 2000, IEEE Computer Society, [PDF], pp.802-806.
  8. POELS G. "On the Measurement of Event-Based Object-Oriented Conceptual Models", 4th International ECOOP Workshop on Quantitative Approaches in Object-Oriented Software Engineering, June 13 2000, Cannes, France.
  9. Bækgaard L. (2002), "Event Modeling in UML," Unified Modeling Language and Unified Process (part of IRMA'02 International Conference). Seattle, Washington.
  10. Bækgaard, L. (2004). Event-Based Activity Modeling. Conference on Action in Language, Action in Language, Organisations and Information Systems (ALOIS'04). Linkoping, Sweden.
  11. Olive, A,; Raventos, R. "Modeling events as entities in object-oriented conceptual modeling languages". Data&Knowledge Engineering 58 (2006), pp.243-262.
  12. J. F. M. Burg and R.P. van de Riet, COLOR-X: Linguistically-based Event Modeling: A General Approach to Dynamic Modeling, In Proceedings of the Seventh International Conference an Advanced Information System Engineering, LNCS (932), pp.26-39, Finland, 1995. Springer-Verlang.
  13. J. F. M. Burg and R.P. van de Riet, COLOR-X: Object Modeling profits from Linguistics, In Towards Very Large Knowledge Bases: Knowledge Building and Knowledge Sharing (KB&KS,95), Amsterdam, 1995, pp.204-214.
  14. Jog Roj & Martin Owen BPMN and Business Process Management - Popkin Software, September 2003.
  15. Stephen A. White - IBM and Derek Miers -Business Process Modeling and Reference Guide, BPM, Focus, September, 2008.
  16. Rittgen, P. Business Processes in UML, in Favre, Liliana: UML and the Unified Process, Hershey, PA: IRM Press, 2003, pp.315-331.
  17. Atif M. Memon, An Event-flow model of GUI-based applications for testing: Research Articles, Software Testing, Verification & Reliability, v.17 n.3, September, 2007, pp.137-157. https://doi.org/10.1002/stvr.364
  18. Atif M. Memon , Mary Lou Soffa , Martha E. Pollack, Coverage criteria for GUI testing, Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering, September 10-14, 2001, Vienna, Austria.
  19. Lu, Y., Yan, D., Nie, S., & Wang, C. (2008 December). "Development of an Improved GUI Automation Test System Based on Event-flow Graph." Proceedings of the 2008 International Conference on Computer Science and Software Engineering - Vol.02, 2, 712-715.
  20. Belli, F., Budnik, C.J., White, L.: Event-based Modeling, Analysis and Testing of User Interactions: Approach and Case Study. The Journal of Software Testing, Verification and Reliability, Vol.16(3) (2006), pp.3-32. https://doi.org/10.1002/stvr.335
  21. Alessandra Russo , Rob Miller , Bashar Nuseibeh , Jeff Kramer, An Abductive Approach for Analysing Event-Based Requirements Specifications, Proceedings of the 18th International Conference on Logic Programming, July 29-August 01, 2002, pp.22-37.
  22. Alan S. Abrahams, David M. Eyers, Jean M. Bacon An Event-Based Paradigm for E-Commerce Application Specification and Execution. Proc. of 7th International Conference on Electronic Commerce Research, Dallas, Texas, 2004, 181-192.
  23. N. H. Gehani , H. V. Jagadish , O. Shmueli, Event specification in an active object-oriented database, Proceedings of the 1992 ACM SIGMOD international conference on Management of data, p.81-90, June 02-05, 1992, San Diego, California, United States.
  24. Ping-peng Yuan, Gang Chen, Jin-xiang Dong, Wei-li-Han Reseach on an Event Specification for Event-Based Collaboration Support Software Architecture. Proc. Int Conf. On Computer Supported Cooperative Work in Design, NY, USA, 2002, 99-104.
  25. A. El-Ansary, "Behavioral Pattern Analysis: Towards a New Representation of Systems Requirements Based on Actions and Events," In Proc: SAC, 2002, pp.CC.
  26. Requirements Definitions of Robotics Automation Using the Behavioral Patterns Analysis (PBA) Approach: The Production Cell System Proceedings of the International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce Vol-1 (CIMCA-IAWTIC'06), 2005, pp.883-892.
  27. http://www.rt.db.erau.edu/BLUE/02%20SE545_FA07_TEAM_BLUE_SRS_version2.pdf
  28. Allen, FE. (1970). Control flow analysis. Proceedings of a Symposium on Compiler Optimization. ACM Press: New York, 1970; 1-19.
  29. Rosen, B.K.(1979). Data flow analysis for procedural languages. Journal of the ACM 1979; 26(2): 322-344. https://doi.org/10.1145/322123.322135
  30. R. V. Binder. Testing Object-Oriented Systems Models, Patterns, and Tools. Addison Wesley, Reading, Massachusetts, October, 1999.
  31. Ward, Paul T.; "Stephen J. Mellor Structured Development for Real-Time Systems": Vol.2, Essential Modeling Techniques. Prentice-Hall (Yourdon Press). ISBN 0138547874. (ISBN 978-0138547875).
  32. H. Zhu, P. A. V. Hall, and J. H. R. May. Software unit test coverage and adequacy. ACM Computing Surveys, 29(4):366-427, December, 1997. https://doi.org/10.1145/267580.267590
  33. T. H. Kim, I. S. Hwang, M. S. Jang, S. W. Kang, J. Y. Lee and S. B. Lee, Test Case Generation of a Protocol by a Fault Coverage Analysis. ICOIN-12., Tokyo, Japan, (1998).
  34. Aditya P. Mathur, Foundations of Software Testing, 1st Imp. : Pearson Education, 2008, 193-214, pp.45-46.
  35. Debasish Kundu, Debasis Samanta : "A Novel Approach to Generate Test Cases from UML Activity Diagrams", in Journal of Object Technology, Vol.8, No.3, May-June, 2009, pp.65-83.
  36. Chen Mingsong , Qiu Xiaokang , Li Xuandong, Automatic test case generation for UML activity diagrams, Proceedings of the 2006 international workshop on Automation of software test, May 23-23, 2006, Shanghai, China [doi>10.1145/1138929.1138931]
  37. H. Kim, S. Kang, J. Baik, and I. Ko. Test cases generation from uml activity diagrams. Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, 2007, pp.556-561.
  38. L. Wang, J. Yuan, X. Yu, J. Hu, X. Li, and G. Zheng. Generating Test Cases from UML Activity Diagram based on Gray-Box Method. In 11th Asia-Pacific Software Engineering Conference (APSEC 2004), 2004, pp.284-291.
  39. Dong Xu , Huaizhong Li , Chiou Peng Lam, Using Adaptive Agents to Automatically Generate Test Scenarios from UML Activity Diagrams, Proceedings of the 12th Asia-Pacific Software Engineering Conference (APSEC'05), December 15-17, 2005 [doi>10.1109/APSEC.2005.110], pp.C.
  40. Chandler, R., Lam, C.P., Li, H.: "AD2US:an automated approach to generating usage scenarios from UML Activity diagrams." In: Proceedings of 12th Asia Pacific Software Engineering Conference, Taipei, Taiwan (2005) , pp.9-16.
  41. Huaizhong Li and C. Peng Lam : "Using Anti-Ant-like Agents to Generate Test Threads from UML Diagrams", TestCom 2005, LNCS 3502, 2005, pp.69-80.
  42. Chen, M., Mishra, P., Kalita, D.: Coverage-driven Automatic Test Generation for UML Activity Diagrams. In: ACM Great Lakes Symposium on VLSI (GLSVLSI) (May 2008).
  43. Philip Samuel, Rajib Mall : "A Novel Test Case Design Technique Using Dynamic Slicing of UML Sequence Diagrams", e-Informatica Software Engineering Journal, Vol.2, Issue 1, 2008
  44. Dehla Sokenou "Generating Test Sequences from UML Sequence Diagrams and State Diagrams" IEEE Society October. 2006.
  45. M. Ebner. TTCN-3 Test Case Generation from Message Sequence Charts. In Workshop on Integrated-reliability with Telecommunications and UML Languages (ISSRE04:WITUL), France, November, 2004.
  46. Li, Bao-Lin; Li, Zhi-shu; Qing, Li et al, Test case automate generation from UML sequence diagram and OCL expression, Computational Intelligence and Security, 2007 International Conference on 15-19 December, 2007 pp.1048-1052.
  47. Monalisa Sarma , Debasish Kundu , Rajib Mall, "Automatic Test Case Generation from UML Sequence Diagram", Proceedings of the 15th International Conference on Advanced Computing and Communications, December, 18-21, 2007 [doi>10.1109/ADCOM.2007.49], pp.60-67.
  48. Emanuela G. Cartaxo, Francisco G. O. Neto and Patricia D. L. Machado Test Case Generation by means of UML Sequence Diagrams and Labeled Transition Systems 2007 IEEE International Conference on Systems Man and Cybernetics (2007) Publisher: Ieee, ISBN: 9781424409907 DOI: 10.1109/ICSMC.2007.4414060, pp.1292-1297.
  49. Lund, M.S., Stølen, K.: Deriving tests from UML 2.0 sequence diagrams with neg and assert. In: 1st International Workshop on Automation of Software Test (AST'06), ACM Press (2006) 22-28.
  50. Y.G. Kim, H.S. Hong, S.M. Cho, D.H. Bae, S.D. Cha : "Test Cases Generation from UML State Diagrams", IEE Proceedings - Software, Vol.146, No.4, August, 1999, pp.187-192.
  51. P. Samuel, R. Mall, A.K. Bothra : "Automatic test case generation using unified modeling language (UML) state diagrams", IET Softw., Vol.2, No.2, 2008, pp.79-93. https://doi.org/10.1049/iet-sen:20060061
  52. S. Kansomkeat and W. Rivepiboon. Automated-generating test case using UML statechart diagrams. In SAICSIT '03, 2003, pp.296-300.
  53. Baikuntha Narayan Biswal , Pragyan Nanda ,Durga Prasad Mohapatra "A Novel Approach for Scenario-Based Test Case Generation" IEEE Society ICIT. 2008.
  54. S. Weißleder and D. Sokenou. Automatic Test Case Generation from UML Models and OCL Expressions. In Testing of Software - From Research To Practice (associated with Software Engineering 2008), (TESO'08), pp.423-426.
  55. M. Riebisch, I. Philippow, and M. Gotze, "UML-Based Statistical Test Case Generation," Proc. Int'l Conf. Net.ObjectDays, Vol.2591, 2002, pp.394-411.
  56. Peter Frohlich and Johannes Link, "Automated Test Case Generation from Dynamic Models", ECOOP- Object Oriented Programming, Vol.1850, 2000, pp.472-491.
  57. Von Mayrhauser, A., France, R., Scheetz, M., and Dahlman, E. "Generating Test-Cases from an Object-Oriented Model with an Artifical-Intelligence Planning System IEEE TRANSACTIONS ON RELIABILITY", Vol.49, No.1, March, 2000.
  58. Singh, K., Sandeep, Sabharwal, Sangeeta, and Gupta, J.P., "E-XTRACT: A Tool for Extraction, Analysis and Classification of Events from Textual Requirements", in Proc.of the 2009 International Conference on Advances in Recent Technologies in Communication and Computing, India, October, 2009, pp.306-308.

Cited by

  1. Systematic mapping study on MBT: tools and models vol.11, pp.4, 2017, https://doi.org/10.1049/iet-sen.2015.0154
  2. Efficient model of Korean graphemes based on a smartphone keyboard vol.13, pp.3, 2013, https://doi.org/10.1007/s10660-013-9118-z
  3. Secure component composition with modular behavioral properties vol.70, pp.1, 2014, https://doi.org/10.1007/s11227-014-1283-x