[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/2616606.2616839acmotherconferencesArticle/Chapter ViewAbstractPublication PagesdateConference Proceedingsconference-collections
research-article

Model-based protocol log generation for testing a telecommunication test harness using CLP

Published: 24 March 2014 Publication History

Abstract

Within telecommunications development it is vital to have frameworks and systems to replay complicated scenarios on equipment under test, often there are not enough available scenarios. In this paper we study the problem of testing a test harness, which replays scenarios and analyses protocol logs for the Public Warning System service, which is a part of the Long Term Evolution (LTE) 4G standard. Protocol logs are sequences of messages with timestamps; and are generated by different mobile network entities. In our case study we focus on user equipment protocol logs. In order to test the test harness we require that logs have both incorrect and correct behaviour. It is easy to collect logs from real system runs, but these logs do not show much variation in the behaviour of system under test. We present an approach where we use constraint logic programming (CLP) for both modelling and test generation, where each test case is a protocol log. In this case study, we uncovered previously unknown faults in the test harness.

References

[1]
M. Utting, A. Pretschner, and B. Legeard, "A taxonomy of model-based testing approaches," Software Testing, Verification and Reliability, vol. 22, no. 5, pp. 297--312, 2012.
[2]
S. Chadchan and C. Akki, "3GPP LTE/SAE: An overview," International Journal of Computer and Electrical Engineering, vol. 2, no. 5, pp. 806--814, 2010.
[3]
3GPP, "General packet radio service (GPRS) enhancements for evolved universal terrestrial radio access network (E-UTRAN) access," 3rd Generation Partnership Project (3GPP), TS 23.401. {Online}. Available: http://www.3gpp.org/ftp/Specs/html-info/23401.htm
[4]
3GPP, "Public warning system (PWS) requirements." 3rd Generation Partnership Project (3GPP), TS 22.268. {Online}. Available: http://www.3gpp.org/ftp/Specs/html-info/22268.htm
[5]
F. Rossi, P. van Beek, and T. Walsh, Eds., Handbook of Constraint Programming. Elsevier, 2006.
[6]
N. Beldiceanu, M. Carlsson, P. Flener, and J. Pearson, "On the reification of global constraints," Constraints, vol. 18, no. 1, pp. 1--6, January 2013.
[7]
E. Farchi, A. Hartman, and S. S. Pinter, "Using a model-based test generator to test for standard conformance," IBM systems journal, vol. 41, no. 1, pp. 89--110, 2002.
[8]
R. M. Hierons, K. Bogdanov, J. P. Bowen, R. Cleaveland, J. Derrick, J. Dick, M. Gheorghe, M. Harman, K. Kapoor, P. Krause, L. Gerald, A. J. Simons, S. Vilkomir, M. R. Woodard, and H. Zedan, "Using formal specifications to support testing," ACM Computing Surveys (CSUR), vol. 41, no. 2, p. 9, 2009.
[9]
B. Legeard and F. Peureux, "Generation of functional test sequences from B formal specifications presentation and industrial case-study," in 16th Annual International Conference on Automated Software Engineering, 2001. (ASE 2001)., 2001, pp. 377--381.
[10]
M. Veanes, C. Campbell, W. Grieskamp, W. Schulte, N. Tillmann, and L. Nachmanson, "Model-based testing of object-oriented reactive systems with spec explorer," Formal Methods and Testing, pp. 39--76, 2008.
[11]
R. DeMilli and A. J. Offutt, "Constraint-based automatic test data generation," Software Engineering, IEEE Transactions on, vol. 17, no. 9, pp. 900--910, 1991.
[12]
N. Williams, B. Marre, P. Mouy, and M. Roger, "Pathcrawler: Automatic generation of path tests by combining static and dynamic analysis," in 5th European Dependable Computing Conference (EDCC-5), ser. Lecture Notes in Computer Science, M. Dal Cin, M. Kaâniche, and A. Pataricza, Eds., vol. 3463. Springer-Verlag, 2005, pp. 281--292.
[13]
M. Carlier, C. Dubois, and A. Gotlieb, "Focaltest: A constraint programming approach for property-based testing," in Software and Data Technologies, ser. Communications in Computer and Information Science, J. Cordeiro, M. Virvou, and B. Shishkov, Eds. Springer Berlin Heidelberg, 2013, vol. 170, pp. 140--155.
[14]
M. Carlsson, G. Ottosson, and B. Carlson, "An open-ended finite domain constraint solver," in PLILP 1997, ser. LNCS, H. Glaser, P. Hartel, and H. Kuchen, Eds., vol. 1292. Springer, 1997, pp. 191--206.
[15]
3GPP, "Technical realization of cell broadcast service (CBS)," 3rd Generation Partnership Project (3GPP), TS 23.041. {Online}. Available: http://www.3gpp.org/ftp/Specs/html-info/23041.htm
[16]
3GPP, "Evolved universal terrestrial radio access (E-UTRA); S1 application protocol (S1AP)," 3rd Generation Partnership Project (3GPP), TS 36.413. {Online}. Available: http://www.3gpp.org/ftp/Specs/html-info/36413.htm

Cited By

View all
  • (2016)Generating tests for robotized painting using constraint programmingProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3061053.3061246(4200-4204)Online publication date: 9-Jul-2016
  • (2014)Testing Robotized Paint System Using Constraint ProgrammingProceedings of the 26th IFIP WG 6.1 International Conference on Testing Software and Systems - Volume 876310.1007/978-3-662-44857-1_10(145-160)Online publication date: 23-Sep-2014

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
DATE '14: Proceedings of the conference on Design, Automation & Test in Europe
March 2014
1959 pages
ISBN:9783981537024

Sponsors

  • EDAA: European Design Automation Association
  • ECSI
  • EDAC: Electronic Design Automation Consortium
  • IEEE Council on Electronic Design Automation (CEDA)
  • The Russian Academy of Sciences: The Russian Academy of Sciences

In-Cooperation

Publisher

European Design and Automation Association

Leuven, Belgium

Publication History

Published: 24 March 2014

Check for updates

Qualifiers

  • Research-article

Conference

DATE '14
Sponsor:
  • EDAA
  • EDAC
  • The Russian Academy of Sciences
DATE '14: Design, Automation and Test in Europe
March 24 - 28, 2014
Dresden, Germany

Acceptance Rates

Overall Acceptance Rate 518 of 1,794 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2016)Generating tests for robotized painting using constraint programmingProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3061053.3061246(4200-4204)Online publication date: 9-Jul-2016
  • (2014)Testing Robotized Paint System Using Constraint ProgrammingProceedings of the 26th IFIP WG 6.1 International Conference on Testing Software and Systems - Volume 876310.1007/978-3-662-44857-1_10(145-160)Online publication date: 23-Sep-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media