More Web Proxy on the site http://driver.im/

research-article

Conformance testing for cyber-physical systems

Authors:

Matthias Woehrle,

Lothar ThieleAuthors Info & Claims

ACM Transactions on Embedded Computing Systems (TECS), Volume 11, Issue 4

Article No.: 84, Pages 1 - 23

https://doi.org/10.1145/2362336.2362351

Published: 01 January 2013 Publication History

Abstract

Cyber-Physical Systems (CPS) require a high degree of reliability and robustness. Hence it is important to assert their correctness with respect to extra-functional properties, like power consumption, temperature, etc. In turn the physical quantities may be exploited for assessing system implementations. This article develops a methodology for utilizing measurements of physical quantities for testing the conformance of a running CPS with respect to a formal description of its required behavior allowing to uncover defects. We present foundations and implementations of this approach and demonstrate its usefulness by conformance testing power measurements of a wireless sensor node with a formal model of its power consumption.

References

[1]

Alur, R. and Dill, D. L. 1994. A theory of timed automata. Theore. Comput Scie. 126, 183--235.

Digital Library

[2]

Behrmann, G., David, A., and Larsen, K. G. 2004. A tutorial on uppaal. In International School on Formal Methods for the Design of Computer, Communication, and Software Systems (SFM-RT'04). 3185. Lecture Notes in Computer Science, vol. 3185, Springer, 200--236.

[3]

Behrmann, G., Larsen, K. G., and Rasmussen, J. I. 2005. Priced timed automata: Algorithms and applications. In Proceedings of the Conference on Formal Methods for Components and Objects (FMCO'04). 162--182.

Digital Library

[4]

Bengtsson, J. and Yi, W. 2004. Timed automata: Semantics, algorithms and tools. In Proceedings of the Lecture Notes on Concurrency and Petri Nets. Lecture Notes in Computer Science, vol. 3098, Springers.

[5]

Bohnenkamp, H. and Stoelinga, M. 2008. Quantitative testing. In Proceedings of the 8th ACM International Conference on Embedded Software (EMSOFT'08). 227--236.

Digital Library

[6]

Henzinger, T. A., Ho, P.-H., and Wong-Toi, H. 1997. Hytech: A model checker for hybrid systems. In Proceedings of the 9th International Conference on Computer Aided Verification (CAV '97). 460--463.

Digital Library

[7]

Hessel, A., Larsen, K. G., Mikucionis, M., Nielsen, B., Pettersson, P., and Skou, A. 2008. Testing real-time systems using UPPAAL. In Formal Methods and Testing, Lecture Notes in Computer Science, vol. 4949. 77--117.

Digital Library

[8]

Kim G. Larsen, Marius Mikucionis, B. N. 2009. Uppaal Tron User Manual. CISS, BRICS, Aalborg University, Aalborg, Denmark.

[9]

Larsen, K. G., Mikucionis, M., and Nielsen, B. 2004. Online testing of real-time systems using uppaal. In Proceedings of the 4th International Workshop Formal Approaches to Software Testing (FATES'04). 79--94.

Digital Library

[10]

Lim, R., Woehrle, M., Meier, A., and Beutel, J. 2009. Poster abstract: Harvester - energy savings through synchronized low-power listening. In Adjunct Proceedings of the 6th European Workshop on Sensor Networks (EWSN'09). 29--30.

[11]

Mikucionis, M., Larsen, K. G., and Nielsen, B. 2004. T-uppaal: Online model-based testing of real-time systems. In Proceedings of the 19th IEEE International Conference Automated Software Engineering (ASE'04). 396--397.

Digital Library

[12]

Shnayder, V., Hempstead, M., rong Chen, B., Allen, G. W., and Welsh, M. 2004. Simulating the power consumption of large-scale sensor network applications. In Proceedings of the 2nd International Conference on 6th Embedded Networked Sensor Systems (SenSys'04). 188--200.

Digital Library

[13]

Strehl, K. 2000. Symbolic methods applied to formal verification and synthesis in embedded systems design. Ph.D. thesis, ETH Zurich.

[14]

Tretmans, J. 1994. A formal approach to conformance testing. In Proceedings of IFIP TC6/WG6.1 6th Interantional Workshop on Protocol Test Systems VI. 257--276.

Digital Library

[15]

van Osch, M. 2006. Hybrid input-output conformance and test generation. In Formal Approaches to Software Testing and Runtime Verification, 70--84.

Digital Library

[16]

Woehrle, M., Lampka, K., and Thiele, L. 2009. Exploiting timed automata for conformance testing of power measurements. In Proceedings of the 7th International Conference on Formal Modelling and Analysis of Timed Systems (FORMATS'09). 275--290.

Digital Library

Cited By

Trüb RDa Forno RDaschinger LBiri ABeutel JThiele L(2021)Non-Intrusive Distributed Tracing of Wireless IoT Devices with the FlockLab 2 TestbedACM Transactions on Internet of Things10.1145/34802483:1(1-31)Online publication date: 27-Oct-2021
https://dl.acm.org/doi/10.1145/3480248
Lamrani IBanerjee AGupta S(2021)Operational Data-Driven Feedback for Safety Evaluation of Agent-Based Cyber–Physical SystemsIEEE Transactions on Industrial Informatics10.1109/TII.2020.300998517:5(3367-3378)Online publication date: May-2021
https://doi.org/10.1109/TII.2020.3009985
Zhang MAli SYue T(2019)Uncertainty-wise Test Case Generation and Minimization for Cyber-Physical SystemsJournal of Systems and Software10.1016/j.jss.2019.03.011Online publication date: Mar-2019
https://doi.org/10.1016/j.jss.2019.03.011
Show More Cited By

Index Terms

Conformance testing for cyber-physical systems
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Model Conformance for Cyber-Physical Systems: A Survey
Special Issue on Real Time Aspects in CPS and Regular Papers (Diamonds)

Model-based development is an important paradigm for developing cyber-physical systems (CPS). The underlying assumption is that the functional behavior of a model is related to the behavior of a more concretized model or the real system. A formal ...
Stress Testing Control Loops in Cyber-physical Systems
Cyber-physical Systems (CPSs) are often safety-critical and deployed in uncertain environments. Identifying scenarios where CPSs do not comply with requirements is fundamental but difficult due to the multidisciplinary nature of CPSs. We investigate the ...
Towards Independent In-Cloud Evolution of Cyber-Physical Systems
CPSNA '14: Proceedings of the 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications

The capabilities of Cyber-Physical Systems (CPSs) are increasingly being extended towards new composite services deployed across a range of smart sensing and controlling devices. These services enable the emergence of multiple end-to-end cyber-physical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Embedded Computing Systems

ACM Transactions on Embedded Computing Systems Volume 11, Issue 4

December 2012

459 pages

ISSN:1539-9087

EISSN:1558-3465

DOI:10.1145/2362336

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 01 January 2013

Accepted: 01 December 2010

Revised: 01 August 2010

Received: 01 February 2010

Published in TECS Volume 11, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Swiss National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
622
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Trüb RDa Forno RDaschinger LBiri ABeutel JThiele L(2021)Non-Intrusive Distributed Tracing of Wireless IoT Devices with the FlockLab 2 TestbedACM Transactions on Internet of Things10.1145/34802483:1(1-31)Online publication date: 27-Oct-2021
https://dl.acm.org/doi/10.1145/3480248
Lamrani IBanerjee AGupta S(2021)Operational Data-Driven Feedback for Safety Evaluation of Agent-Based Cyber–Physical SystemsIEEE Transactions on Industrial Informatics10.1109/TII.2020.300998517:5(3367-3378)Online publication date: May-2021
https://doi.org/10.1109/TII.2020.3009985
Zhang MAli SYue T(2019)Uncertainty-wise Test Case Generation and Minimization for Cyber-Physical SystemsJournal of Systems and Software10.1016/j.jss.2019.03.011Online publication date: Mar-2019
https://doi.org/10.1016/j.jss.2019.03.011
Duan PZhou YGong XLi B(2018)A Systematic Mapping Study on the Verification of Cyber-Physical SystemsIEEE Access10.1109/ACCESS.2018.28720156(59043-59064)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2872015
Zhou XGou XHuang TYang S(2018)Review on Testing of Cyber Physical Systems: Methods and TestbedsIEEE Access10.1109/ACCESS.2018.28698346(52179-52194)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2869834
Shen WLi GLin CLiang H(2018)Foundation of a Framework to Support Compliance Checking in Construction IndustryStructured Object-Oriented Formal Language and Method10.1007/978-3-319-90104-6_7(111-122)Online publication date: 18-Apr-2018
https://doi.org/10.1007/978-3-319-90104-6_7
Khoo TSun J(2018)The Miles Before Formal Methods - A Case Study on Modeling and Analyzing a Passenger Lift SystemFormal Methods and Software Engineering10.1007/978-3-030-02450-5_4(54-69)Online publication date: 11-Oct-2018
https://doi.org/10.1007/978-3-030-02450-5_4
Khoo T(2018)Model Based Testing of Cyber-Physical SystemsFormal Methods and Software Engineering10.1007/978-3-030-02450-5_27(423-426)Online publication date: 11-Oct-2018
https://doi.org/10.1007/978-3-030-02450-5_27
Lu Y(2017)Cyber Physical System (CPS)-Based Industry 4.0: A SurveyJournal of Industrial Integration and Management10.1142/S242486221750014202:03(1750014)Online publication date: Sep-2017
https://doi.org/10.1142/S2424862217500142
Chen H(2017)Theoretical Foundations for Cyber-Physical Systems: A Literature ReviewJournal of Industrial Integration and Management10.1142/S242486221750013002:03(1750013)Online publication date: Sep-2017
https://doi.org/10.1142/S2424862217500130
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents