Abstract
Event-driven softwares (EDS) are now widely developed and used. Common example of Event-driven software span multiple domains from embedded systems to web and GUI applications. Testing methods based on event executing permutation is common in software testing field. Combinatorial method has been applied to generate sequence coverage array (SCA) such as t-seq algorithm developed by Kuhn et al. The SCA generated was aimed at n distinct events which occurs exactly once in sequence. However, event may be repeatable in test sequence, because, for most reactive or event driven systems, events occur multiple times in the course of practical use. Existing sequence coverage array generated by combinatorial method may exist redundancy for repeatable events. Therefore, we propose a reduction algorithm for removing the unwanted subsequence of SCA. Furthermore, we introduced a direct construction method to generate one-row test sequence, which satisfy t-way permutations coverage of n events.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Banbara, M., Tamura, N., Inoue, K.: Generating event-sequence test cases by answer set programming with the incidence matrix (2012)
Barin, M., Erdem, E., Inoue, K., Oetsch, J., Puhrer, J., Tompits, H., Yilmaz, C., Yilmaz, C.: Event-sequence testing using answer-set programming. Int. J. Adv. Softw. 5(3 and 4), 237–251 (2012)
Brooks, P.A., Memon, A.M.: Introducing a test suite similarity metric for event sequence-based test cases. In: IEEE International Conference on Software Maintenance, pp. 243–252 (2009)
Capsper, A.M., Jensen, S., Prasad, R.: Automated testing with targeted event sequence generation. In: International Symposium on Software Testing and Analysis, pp. 67–77 (2013)
Farchi, E., Segall, I., Tzoref-Brill, R., Zlotnick, A.: Combinatorial testing with order requirements. In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Los Alamitos, CA, USA, Apr 2014, pp. 118–127. IEEE Computer Society
Hazli, M., Zamli, K.Z., Othman, R.R.: Sequence-based interaction testing implementation using bees algorithm. In: 2012 IEEE Symposium on Computers and Informatics (ISCI) (2012)
Kuhn, D.R., Higdon, J.M., Lawrence, J.F., Kacker, R.N., Lei, Y.: Combinatorial methods for event sequence testing. IEEE Comput. Soc. (2012)
Kuhn, D.R., Higdon, J.M., Lawrence, J.F., Kacker, R.N., Lei, Y.: Efficient methods for interoperability testing using event sequences. Crosstalk J. Defense Softw. Eng. (2012)
Margalit, O.: Better bounds for event sequencing testing. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops, pp. 281–284 (2013)
Mayo, Q., Michaels, R., Bryce, R.: Test suite reduction by combinatorial-based coverage of event sequences. In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops, pp. 128–132 (2014)
Nasser, A.B., Hujainah, F., Alsewari, A., Zamli, K.Z.: Sequence and sequence-less t-way test suite generation strategy based on flower pollination algorithm. In: 2015 IEEE Student Conference on Research and Development (SCOReD) (2016)
Rahman, M., Othman, R.R., Ahmad, R.B., Rahman, M.M.: Event driven input sequence t-way test strategy using simulated annealing. In: 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, pp. 663–667 (2014)
Richard, K.D.: Sequence Covering Array Library. Available at: http://cs.nyu.edu/totok/professional/software/tpcw/tpcw.html
Wang, W., Sampath, S., Yu, L., Kacker, R.: An interaction-based test sequence generation approach for testing web applications. In: 2008 11th IEEE High Assurance Systems Engineering Symposium (2008)
Xun, Y., Cohen, M.B., Memon, A.M.: Covering array sampling of input event sequences for automated GUI testing. In: 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Atlanta, Georgia, USA, 5–9 Nov 2007
Xun, Y., Memon, A.M.: Generating event sequence-based test cases using GUI runtime state feedback. IEEE Trans. Softw. Eng. 36(1), 81–95 (2010)
Zamli, K.Z., Othman, R.R., Zabil, M.: On sequence based interaction testing. Comput. Inform. 662–667 (2011)
Acknowledgements
The authors would like to thank Kuhn, D. Richard for providing the tool of Sequence Covering Array Generator.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix: Verify T-Way Coverage of Sequence Generated by Direct Construction Method
Appendix: Verify T-Way Coverage of Sequence Generated by Direct Construction Method
To verify t-way coverage of the sequence generated by direct construction method, taken the 3-way sequence of 4 events as example. In order to satisfy 3-way order coverage requirement of 4 events, [a-b-c], [a-c-b], [b-a-c], [b-c-a], [c-b-a], [c-a-b], [a-b-d], [a-d-b], [b-a-d], [b-d-a], [d-b-a], [d-a-b],[a-c-d], [a-d-c], [c-a-d], [c-d-a], [d-c-a], [d-a-c], [b-c-d], [b-d-c], [c-b-d], [c-d-b], [d-c-b], [d-b-c] must be covered. [a-b-c-d-a-b-c-a-d-b] is the result given by algorithm II based on the direct construction strategy. It is easy to verify that all the 3-length sequences listed above are covered by the sequence.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, Y., Pei, D., Fang, S. (2022). Event Sequence T-Way Test Strategy for Events Driven System. In: Wu, TY., Ni, S., Chu, SC., Chen, CH., Favorskaya, M. (eds) Advances in Smart Vehicular Technology, Transportation, Communication and Applications. Smart Innovation, Systems and Technologies, vol 250. Springer, Singapore. https://doi.org/10.1007/978-981-16-4039-1_13
Download citation
DOI: https://doi.org/10.1007/978-981-16-4039-1_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-4038-4
Online ISBN: 978-981-16-4039-1
eBook Packages: EngineeringEngineering (R0)