Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- ArticleOctober 2024
Case Study: Runtime Safety Verification of Neural Network Controlled System
AbstractNeural networks are increasingly used in safety-critical applications such as robotics and autonomous vehicles. However, the deployment of neural-network-controlled systems (NNCSs) raises significant safety concerns. Many recent advances overlook ...
- ArticleJuly 2024
Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems
AbstractThe rapid advance of deep reinforcement learning techniques enables the oversight of safety-critical systems through the utilization of Deep Neural Networks (DNNs). This underscores the pressing need to promptly establish certified safety ...
- research-articleJuly 2024
Verifying safety of neural networks from topological perspectives
Science of Computer Programming (SCPR), Volume 236, Issue Chttps://doi.org/10.1016/j.scico.2024.103121AbstractNeural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment in ...
Highlights- To the best of our knowledge, this is the first work using topological properties of NNs to tackle the safety verification problems of neural networks.
- The proposed set-boundary based method controls the wrapping effect of existing ...
- rapid-communicationMay 2024
Chordal sparsity for SDP-based neural network verification
Automatica (Journal of IFAC) (AJIF), Volume 161, Issue Chttps://doi.org/10.1016/j.automatica.2023.111487AbstractNeural networks are central to many emerging technologies, but verifying their correctness remains a major challenge. It is known that network outputs can be sensitive and fragile to even small input perturbations, thereby increasing the risk of ...
- ArticleOctober 2023
The SafeCap Trajectory: Industry-Driven Improvement of an Interlocking Verification Tool
Reliability, Safety, and Security of Railway Systems. Modelling, Analysis, Verification, and CertificationPages 117–127https://doi.org/10.1007/978-3-031-43366-5_7AbstractThis paper reports on the industrial use of our formal-method based interlocking verification tool, called SafeCap, and on what we needed to change in SafeCap as a result of our experience in applying it to a large number of commercial signalling ...
-
- research-articleAugust 2023
Guaranteed Safe Path and Trajectory Tracking via Reachability Analysis Using Differential Inequalities
Journal of Intelligent and Robotic Systems (JIRS), Volume 108, Issue 4https://doi.org/10.1007/s10846-023-01928-wAbstractIn many automated motion planning systems, vehicles are tasked with tracking a reference path or trajectory that is safe by design. However, due to various uncertainties, real vehicles may deviate from such references, potentially leading to ...
- ArticleJuly 2023
Safety Verification for Neural Networks Based on Set-Boundary Analysis
Theoretical Aspects of Software EngineeringPages 248–267https://doi.org/10.1007/978-3-031-35257-7_15AbstractNeural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment in ...
- research-articleJune 2023
On the applicability of hybrid systems safety verification tools from the automotive perspective
International Journal on Software Tools for Technology Transfer (STTT) (STTT), Volume 26, Issue 1Pages 49–78https://doi.org/10.1007/s10009-023-00707-0AbstractTraditionally, extensive vehicle testing is applied to assure the robustness and safety of automotive systems. This approach is highly challenged by increasing system complexity. Formal verification lends a powerful framework for model-based ...
- research-articleNovember 2022
Decomposing reach set computations with low-dimensional sets and high-dimensional matrices (extended version)
AbstractApproximating the set of reachable states of a dynamical system is an algorithmic way to rigorously reason about its safety. Despite progress on efficient algorithms for affine dynamical systems, available algorithms still lack ...
- ArticleSeptember 2022
Towards Scalable Multi-robot Systems by Partitioning the Task Domain
AbstractMany complex domains would benefit from the services of Large-scale, Safety-verified, Always-on (LSA) robotic systems. However, existing large-scale solutions often forego the complex reasoning required for safety verification and prescient ...
- research-articleJune 2021
Learning safe neural network controllers with barrier certificates
Formal Aspects of Computing (FAC), Volume 33, Issue 3Pages 437–455https://doi.org/10.1007/s00165-021-00544-5AbstractWe provide a new approach to synthesize controllers for nonlinear continuous dynamical systems with control against safety properties. The controllers are based on neural networks (NNs). To certify the safety property we utilize barrier functions, ...
- research-articleJune 2021
SDLV: Verification of Steering Angle Safety for Self-Driving Cars
Formal Aspects of Computing (FAC), Volume 33, Issue 3Pages 325–341https://doi.org/10.1007/s00165-021-00539-2AbstractSelf-driving cars over the last decade have achieved significant progress like driving millions of miles without any human intervention. However, behavioral safety in applying deep-neural-network-based (DNN based) systems for self-driving cars ...
- ArticleNovember 2020
Learning Safe Neural Network Controllers with Barrier Certificates
Dependable Software Engineering. Theories, Tools, and ApplicationsPages 177–185https://doi.org/10.1007/978-3-030-62822-2_11AbstractWe provide a novel approach to synthesize controllers for nonlinear continuous dynamical systems with control against safety properties. The controllers are based on neural networks (NNs). To certify the safety property we utilize barrier ...
- research-articleOctober 2020
- ArticleJuly 2020
SAW: A Tool for Safety Analysis of Weakly-Hard Systems
AbstractWe introduce SAW, a tool for safety analysis of weakly-hard systems, in which traditional hard timing constraints are relaxed to allow bounded deadline misses for improving design flexibility and runtime resiliency. Safety verification is a key ...
- research-articleDecember 2019
Verifying Safety and Persistence in Hybrid Systems Using Flowpipes and Continuous Invariants
Journal of Automated Reasoning (JAUR), Volume 63, Issue 4Pages 1005–1029https://doi.org/10.1007/s10817-018-9497-xAbstractWe describe a method for verifying the temporal property of persistence in non-linear hybrid systems. Given some system and an initial set of states, the method establishes that system trajectories always eventually evolve into some specified ...
- short-paperJuly 2019
SAFEVM: a safety verifier for Ethereum smart contracts
ISSTA 2019: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and AnalysisPages 386–389https://doi.org/10.1145/3293882.3338999Ethereum smart contracts are public, immutable and distributed and, as such, they are prone to vulnerabilities sourcing from programming mistakes of developers. This paper presents SAFEVM, a verification tool for Ethereum smart contracts that makes use ...
- articleDecember 2016
Safety verification of finite real-time nonlinear hybrid systems using enhanced group preserving scheme
Cluster Computing (KLU-CLUS), Volume 19, Issue 4Pages 2189–2199https://doi.org/10.1007/s10586-016-0652-zIn recent years, finite realtime nonlinear hybrid systems(FRNHS) have been widely used in the fields of biology, chemical control, embedded systems, etc. Its safety verification becomes more and more important. Compared with traditional hybrid systems, ...
- research-articleOctober 2016
Two CEGAR-based approaches for the safety verification of PLC-controlled plants
Information Systems Frontiers (KLU-ISFI), Volume 18, Issue 5Pages 927–952https://doi.org/10.1007/s10796-016-9671-9AbstractIn this paper we address the safety analysis of chemical plants controlled by programmable logic controllers (PLCs). We consider a specification of the control program of the PLCs, extended with the specification of the dynamic plant behavior. The ...