Abstract
In the area of model based testing, major improvements have been made in the generation of conformance tests using a model checker. Unfortunately, the execution of the generated test suites tend to be rather time-consuming. In [1] we presented a method to generate the test suites with the shortest execution time providing the required coverage, but this method can only be applied to small models due to memory-consumption. Here we show how to generate test suites for a number of different test quality criteria like coverage criteria, UIOs, mutant testing. Moreover, we present heuristics to significantly reduce test execution time that are as efficient as a naive testsuite generation. Our optimization combines min-set-cover-algorithms and search strategies, which we use to enlengthen generated test cases by promising additional coverages. We compare several heuristics and present a case study where we could achieve a reduction of the test execution time to less than 10%.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Mücke, T., Huhn, M.: Generation of optimized testsuites for UML statecharts with time. In Groz, R., Hierons, R.M., eds.: TestCom. Volume 2978 of LNCS., Springer (2004) 128–143
Engels, A., Feijs, L., Mauw, S.: Test generation for intelligent networks using model checking. In Brinksma, E., ed.: Tools and Algorithms for the Construction and Analysis of Systems. (1997)
Rayadurgan, S., Heimdahl, M.: Coverage based test-case generation using model checkers. In: Intl. Conf. and Workshop on the Engineering of Computer Based Systems. (2001) 83–93
Hong, H., Lee, I., Sokolsky, O., Cha, S.: Automatic test generation from statecharts using model checking. In Brinksma, E., Tretmans, J., eds.: Workshop on Formal Approaches to Testing of Software (FATES). (2001) 15–30
Pretschner, A.: Classical search strategies for test case generation with constraint logic programming. In Brinksma, E., Tretmans, J., eds.: Workshop on Formal Approaches to Testing of Software (FATES). (2001) 47–60
King, K.N., Offutt, A.J.: A Fortran language system for mutation-based software testing. Software-Practice & Experience 21(7) (1991) 685–718
Heimdahl, M.P., Devaraj, G., Weber, R.J.: Specification test coverage adequacy criteria = specification test generation inadequacy criteria? In: Proceedings of the 8th IEEE International Symposium on High Assurance Systems Engineering (HASE), Tampa, Florida (2004)
Heimdahl, M.P., Devaraj, G.: Test-suite reduction for model based tests: Effects on test quality and implications for testing. In Wiels, V., Stirewalt, K., eds.: Proc. of the 19th IEEE Intern. Conference on Automated Software Engineering (ASE), Linz, Austria (2004)
OMG: Unified modeling language specification (2003) Version 1.5.
Larsen, K.G., Pettersson, P., Yi, W.: UPPAAL in a nutshell. International Journal on Software Tools for Technology Transfer 1(1–2) (1997) 134–152
Diethers, K., Goltz, U., Huhn, M.: Model checking UML statecharts with time. In Jézéquel, J.M., Hußmann, H., Cook, S., eds.: UML 2002, Workshop on Critical Systems Development with UML. (2002)
Diethers, K., Huhn, M.: Vooduu: Verification of object-oriented designs using uppaal. In Jensen, K., Podelski, A., eds.: TACAS. Volume 2988 of Lecture Notes in Computer Science., Springer (2004) 139–143
Robinson-Mallett, C., Liggesmeyer, P., Mücke, T., Goltz, U.: Generating optimal distinguishing sequences with a model checker. In: A-MOST’ 05: Proceedings of the 1st International Workshop on Advances in Model-based Testing, New York, NY, USA, ACM Press (2005) 1–7
Sugeta, T., Maldonado, J.C., Wong, W.E.: Mutation testing applied to validate SDL specifications. In Groz, R., Hierons, R.M., eds.: TestCom. Volume 2978 of LNCS., Springer (2004) 193–208
Offutt, J., Pan, J., Voas, J.: Procedures for reducing the size of coverage-based test sets. In: Proceedings of the Twelfth International Conference on Testing Computer Software. (1995) 111–123
Paulin, P., Knight, J.: Force-directed scheduling for the behavioural synthesis of asics. IEEE Trans. on Computer-Aided Design 8(6) (1989) 661–679
Garey, M., Johnson, D.: Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman and Company (1979)
Steiner, J., Diethers, K., Mücke, T., Goltz, U., Huhn, M.: Rigorous tool-supported software development of a robot control system. In: Robot Systems for Handling and Assembly, 2nd Colloquium of the Collaborative Research Center 562. (2005) 137–152
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 International Federation for Information Processing
About this paper
Cite this paper
Mücke, T., Huhn, M. (2006). Minimizing Test Execution Time During Test Generation. In: Sacha, K. (eds) Software Engineering Techniques: Design for Quality. IFIP International Federation for Information Processing, vol 227. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-39388-9_22
Download citation
DOI: https://doi.org/10.1007/978-0-387-39388-9_22
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-39387-2
Online ISBN: 978-0-387-39388-9
eBook Packages: Computer ScienceComputer Science (R0)