Abstract
The paper describes an approach for creation of effective test automation technology for industrial software projects based on a formal model of the system under test, performing its automatic symbolic verification of the model and generation of symbolic traces, then their automatic concretization, generation and execution of test suites. The technology includes means for test results analysis and tests correction and update. High quality of software products is ensured by a balance between static (verification) and dynamic (testing) analysis techniques starting from the earlier development phases and through automation of all phases of software development. Special emphasis is made on presentation of the algorithm of concretization and configuring test scenarios.
Similar content being viewed by others
References
Hoare, C.A.R., Communicating Sequential Processes, Prentice Hall, 1985.
Letichevsky, Kapitonova, J., Letichevsky Jr., A., Volkov, V., Baranov, S., Kotlyarov, V., and Weigert, T., Basic protocols, message sequence charts, and the verification of requirements specifications, Computer Networks, 2005, vol. 47, pp. 662–675.
Abbot framework for automated testing of Java GUI components and programs, Abbot., 2011, http://abbot.sourceforge.net/doc/overview.shtml.
Jameleon, An automated testing tool-overview, Jameleon, 2011, http://jameleon.sourceforge.net/index.html.
Silk Software test management, test automation and performance testing, Borland, 2011, http://www.borland.com/us/products/silkline/index.aspx
Open source software engineering tools, Tigris, 2011, http://maxq.tigris.org.
Software testing tools and other products, Parasoft, 2011, http://www.parasoft.com/jsp/products.jsp.
IBM Rational software, IBM, 2011, http://www-01.ibm.com/software/rational/?pgel=ibmhzn&cm-re=masthead-_-products-_-sw-rational.
Baranov, S.N., Drobintsev, P.D., Kotlyarov, V.P., Letichevsky, A.A., Implementation of an integrated verification and testing technology in telecommunication project, Proceedings IEEE Russia Northwest Section, 110 Anniversary of Radio Invention conference, St. Petyersburg, 2005.
Letichevsky, A.A., Kapitonova, J.V., Volkov, V.A., Letichevsky, jr., A.A., Baranov, S.N., Kotlyarov, V.P., Weigert, T., System specification with basic protocols, Cybernetics and System Analyses, 2005, vol. 4, pp. 256–268.
Potienko, S.V., Methods of forward and backward symbolic modeling of systems specified by basic protocols, Problems in programming, 2008, vol. 4, pp. 39–45.
Letichevsky A.A., Godlevsky, A.B., Letichevsky Jr., A.A., Potienko, S.V., and Peschanenko, V.S., Properties of predicate transformer of VRS system, Cybernetics and System Analyses, 2010, vol. 4, pp. 3–16.
Godlevsky, A.B. and Potienko, S.V., Backward transformation of formulas in symbolic modeling: from the result to the source formula, Problems in programming, 2010, vols. 2–3, pp. 363–368.
Lvov, M.S., Algebraic approach to the problem of solving systems of linear inequalities, Cybernetics and System Analyses, 2010, vol. 2, pp. 175–188.
Goguen, J. and Meseguer, J., Ordered-sorted algebra I: partial and overloaded operations, in Errors and Inheritance, SRI International, Computer Science Lab., 1987.
Motzkin, T.S., Raiffa, H., Thompson, G.L., and Thrall, R.M., The double description method, in Matrix Games, M.: Phizmatgiz, 1961, pp. 81–109.
Zeidler, G.L., Lectures on Convex Polytopes, New York: Springer Verlag, 1994.
Chernikov, S.N., Linear Inequalities, M.: Science, 1968.
Baranov, S.N. and Kotlyarov, V.P., Computerized formalization of requirements for program testing scripts, in Perspectives of System Informatics, Materials of “Science Intensive Applied Software” Workshop, 15–19 June 2009, Novosibirsk: Akademgorodok, pp. 27–35.
Baranov, S., Kotlyarov, V., Letichevsky, A., and Drobintsev, P., The technology of automation verification and testing in industrial projects, in Proc. of St. Petersburg IEEE Chapter, International Conference, May 18–21, St. Petersburg, Russia, 2005, pp. 81–86
Nikiforov, I.V., Petrov, A.V., and Yusupov, Y.V., Generation of formal model of a system from requirements specified in use case maps, St. Petersburg State Polytechnical University Journal, Computer science, in Telecommunication and Control Systems, St. Petersburg, 2010, vol. 103, no. 4, pp. 191–195.
Sergey Baranov, Vsevolod Kotlyarov, and Thomas Weigert, Verifiable Coverage Criteria for Automated Testing, SDL 2011: INTEGRATING SYSTEM AND SOFTWARE MODELING, Lecture Notes in Computer Science, 2012, vol. 7083/2012, pp. 79–89.
Letichevsky Jr., A. and Kolchin, A., Test scenarios generation based on formal model, Programming Problems, 2010, nos. 2-3, pp. 209–215.
Utting, M. and Legeard, B., Practical Model-Based Testing: A Tools Approach, Morgan-Kaufmann, 2007.
Burdonov, I., Kosachev, A., Ponomarenko, V., and Shnitman, V., Review of Approaches to Verification of Distributed Systems, M.: ISP RAS, 2006.
Author information
Authors and Affiliations
Corresponding author
Additional information
The article is published in the original.
About this article
Cite this article
Kolchin, A., Letichevsky, A., Peschanenko, V. et al. An approach to creating concretized test scenarios within test automation technology for industrial software projects. Aut. Control Comp. Sci. 47, 433–442 (2013). https://doi.org/10.3103/S0146411613070213
Published:
Issue Date:
DOI: https://doi.org/10.3103/S0146411613070213