demonstration

SLEMI: finding simulink compiler bugs through equivalence modulo input (EMI)

Authors:

Shafiul Azam Chowdhury,

Sohil Lal Shrestha,

Taylor T. Johnson,

Christoph CsallnerAuthors Info & Claims

ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings

Pages 1 - 4

https://doi.org/10.1145/3377812.3382147

Published: 01 October 2020 Publication History

Get Access

Abstract

This demo presents usage and implementation details of SLEMI. SLEMI is the first tool to automatically find compiler bugs in the widely used cyber-physical system development tool Simulink via Equivalence Modulo Input (EMI). EMI is a recent twist on differential testing that promises more efficiency. SLEMI implements several novel mutation techniques that deal with CPS language features that are not found in procedural languages. This demo also introduces a new EMI-based mutation strategy that has already found a new confirmed bug in Simulink version R2018a. To increase SLEMI's efficiency further, this paper presents parallel generation of random, valid Simulink models. A video demo of SLEMI is available at https://www.youtube.com/watch?v=oliPgOLT6eY.

References

[1]

Shafiul Azam Chowdhury, Taylor T. Johnson, and Christoph Csallner. 2016. CyFuzz: A differential testing framework for cyber-physical systems development environments. In Proc. 6th Workshop on Design, Modeling and Evaluation of Cyber Physical Systems (CyPhy). Springer, 46--60.

Crossref

Google Scholar

[2]

Shafiul Azam Chowdhury, Soumik Mohian, Sidharth Mehra, Siddhant Gawsane, Taylor T. Johnson, and Christoph Csallner. 2018. Automatically finding bugs in a commercial cyber-physical system development tool chain with SLforge. In Proc. 40th ACM/IEEE International Conference on Software Engineering (ICSE). ACM, 981--992.

Digital Library

Google Scholar

[3]

Shafiul Azam Chowdhury, Sohil Lal Shrestha, Taylor T. Johnson, and Christoph Csallner. 2020. SLEMI: Equivalence modulo input (EMI) based mutation of CPS models for finding compiler bugs in Simulink. In Proc. 42nd ACM/IEEE International Conference on Software Engineering (ICSE). ACM. To appear.

Digital Library

Google Scholar

[4]

Shafiul Azam Chowdhury, Lina Sera Varghese, Soumik Mohian, Taylor T. Johnson, and Christoph Csallner. 2018. A curated corpus of Simulink models for model-based empirical studies. In Proc. 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS). ACM, 45--48.

Digital Library

Google Scholar

[5]

MathWorks Inc. 2020. Simulink Documentation --- MATLAB & Simulink. http://www.mathworks.com/help/simulink/. Accessed Feb 2020.

Google Scholar

[6]

Akshay Rajhans, Srinath Avadhanula, Alongkrit Chutinan, Pieter J. Mosterman, and Fu Zhang. 2018. Graphical modeling of hybrid dynamics with Simulink and Stateflow. In Proc. 21st International Conference on Hybrid Systems: Computation and Control (HSCC). ACM, 247--252.

Digital Library

Google Scholar

[7]

Chengnian Sun, Vu Le, and Zhendong Su. 2016. Finding compiler bugs via live code mutation. In Proc. ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA). ACM, 849--863.

Digital Library

Google Scholar

Cited By

View all

Rahman ABose DBarsha FPandita R(2023)Defect Categorization in Compilers: A Multi-vocal Literature ReviewACM Computing Surveys10.1145/362631356:4(1-42)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.1145/3626313
Shrestha SJust RFraser G(2023)Harnessing Large Language Models for Simulink Toolchain Testing and Developing Diverse Open-Source Corpora of Simulink Models for Metric and Evolution AnalysisProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3605233(1541-1545)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3605233
Shrestha SChowdhury SCsallner C(2023)Replicability Study: Corpora For Understanding Simulink Models & Projects2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)10.1109/ESEM56168.2023.10304867(1-12)Online publication date: 26-Oct-2023
https://doi.org/10.1109/ESEM56168.2023.10304867
Show More Cited By

Index Terms

SLEMI: finding simulink compiler bugs through equivalence modulo input (EMI)
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering

Recommendations

SLEMI: equivalence modulo input (EMI) based mutation of CPS models for finding compiler bugs in Simulink
ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering

Finding bugs in commercial cyber-physical system development tools (or "model-based design" tools) such as MathWorks's Simulink is important in practice, as these tools are widely used to generate embedded code that gets deployed in safety-critical ...
Detecting Simulink compiler bugs via controllable zombie blocks mutation
ESEC/FSE 2022: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

As a popular Cyber-Physical System (CPS) development tool chain, MathWorks Simulink is widely used to prototype CPS models in safety-critical applications, e.g., aerospace and healthcare. It is crucial to ensure the correctness and reliability of ...
Automatically finding bugs in commercial cyber-physical system development tool chains
ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Commercial Cyber-physical System (CPS) development tools (e.g. MathWorks' Simulink) are widely used to design, simulate and automatically generate artifacts which are deployed in safety-critical embedded hardware. CyFuzz, the state-of-the-art CPS tool ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings

June 2020

357 pages

ISBN:9781450371223

DOI:10.1145/3377812

General Chairs:
Gregg Rothermel
North Carolina State University
,
Doo-Hwan Bae
KAIST, South Korea

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

KIISE: Korean Institute of Information Scientists and Engineers
IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2020

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

National Science Foundation

Conference

ICSE '20

Sponsor:

SIGSOFT

ICSE '20: 42nd International Conference on Software Engineering

June 27 - July 19, 2020

Seoul, South Korea

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
99
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rahman ABose DBarsha FPandita R(2023)Defect Categorization in Compilers: A Multi-vocal Literature ReviewACM Computing Surveys10.1145/362631356:4(1-42)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.1145/3626313
Shrestha SJust RFraser G(2023)Harnessing Large Language Models for Simulink Toolchain Testing and Developing Diverse Open-Source Corpora of Simulink Models for Metric and Evolution AnalysisProceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3597926.3605233(1541-1545)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597926.3605233
Shrestha SChowdhury SCsallner C(2023)Replicability Study: Corpora For Understanding Simulink Models & Projects2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)10.1109/ESEM56168.2023.10304867(1-12)Online publication date: 26-Oct-2023
https://doi.org/10.1109/ESEM56168.2023.10304867
Boll ABrokhausen FAmorim TKehrer TVogelsang A(2021)Characteristics, potentials, and limitations of open-source Simulink projects for empirical researchSoftware and Systems Modeling10.1007/s10270-021-00883-0Online publication date: 14-Apr-2021
https://doi.org/10.1007/s10270-021-00883-0
Boll AKehrer T(2020)On the Replicability of Experimental Tool Evaluations in Model-Based DevelopmentSystems Modelling and Management10.1007/978-3-030-58167-1_9(111-130)Online publication date: 17-Oct-2020
https://doi.org/10.1007/978-3-030-58167-1_9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

SLEMI: equivalence modulo input (EMI) based mutation of CPS models for finding compiler bugs in Simulink

Detecting Simulink compiler bugs via controllable zombie blocks mutation

Automatically finding bugs in commercial cyber-physical system development tool chains