poster

Mutation testing of quantum programs written in QISKit

Authors:

Daniel Fortunato,

José Campos,

Rui AbreuAuthors Info & Claims

ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings

Pages 358 - 359

https://doi.org/10.1145/3510454.3528649

Published: 19 October 2022 Publication History

Get Access

Abstract

There is an inherent lack of knowledge and technology to test a quantum program properly. In this paper, building on the definition of syntactically equivalent quantum operations, we investigated a novel set of mutation operators to generate mutants based on qubit measurements and quantum gates. To ease the adoption of quantum mutation testing, we further discuss QMutPy, an extension of the well-known and fully automated open-source mutation tool MutPy. To evaluate QMutPy's performance we conducted a case study on 11 real quantum programs written in the IBM's QISKit library. QMutPy has proven to be an effective quantum mutation tool, providing insight on the current state of quantum tests.

References

[1]

M. Moein Almasi, Hadi Hemmati, Gordon Fraser, Andrea Arcuri, and Jundefinednis Benefelds. 2017. An Industrial Evaluation of Unit Test Generation: Finding Real Faults in a Financial Application. In Proceedings of the 39th ICSE-SEIP.

Digital Library

Google Scholar

[2]

Mark Fingerhuth, Tomáš Babej, and Peter Wittek. 2018. Open source software in quantum computing. PLOS ONE (2018).

Google Scholar

[3]

Gordon Fraser and José Miguel Rojas. 2019. Software Testing. Springer International Publishing, Cham, 123--192.

Crossref

Google Scholar

[4]

Yipeng Huang and Margaret Martonosi. 2018. QDB: from quantum algorithms towards correct quantum programs. arXiv preprint arXiv:1811.05447 (2018).

Google Scholar

[5]

P. Liu, S. Hu, M. Pistoia, C. R. Chen, and J. M. Gambetta. 2019. Stochastic Optimization of Quantum Programs. Computer 52, 6 (2019), 58--67.

Crossref

Google Scholar

[6]

Andriy V. Miranskyy and Lei Zhang. 2018. On Testing Quantum Programs. CoRR abs/1812.09261 (2018). arXiv:1812.09261 http://arxiv.org/abs/1812.09261

Google Scholar

[7]

Michael A. Nielsen and Isaac L. Chuang. 2010. Quantum Computation and Quantum Information: 10th Anniversary Edition. Cambridge University Press.

Digital Library

Google Scholar

[8]

Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just. 2021. Does Mutation Testing Improve Testing Practices?. In Proc. of the 43rd IEEE/ACM ICSE.

Digital Library

Google Scholar

[9]

Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just. 2021. Practical Mutation Testing at Scale: A view from Google. IEEE TSE (2021).

Google Scholar

[10]

Jianjun Zhao. 2020. Quantum Software Engineering: Landscapes and Horizons. arXiv:2007.07047 [cs.SE]

Google Scholar

[11]

Pengzhan Zhao, Jianjun Zhao, and Lei Ma. 2021. Identifying Bug Patterns in Quantum Programs. In Proc. of the 2nd Q-SE.

Crossref

Google Scholar

Cited By

View all

Kitt LCohen M(2024)MorphQ++: A Reproducibility Study of Metamorphic Testing on Quantum CompilersProceedings of the 2024 Workshop on Replications and Negative Results10.1145/3695750.3695823(15-21)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3695750.3695823
Kitt LCohen MFilkov VRay BZhou M(2024)MorphQ++: A Reproducibility Study of Metamorphic Testing on Quantum CompilersProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering Workshops10.1145/3691621.3694959(8-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691621.3694959
Li YPei HHuang LYin BCai K(2024)Automatic Repair of Quantum Programs via Unitary OperationACM Transactions on Software Engineering and Methodology10.1145/366460433:6(1-43)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3664604
Show More Cited By

Index Terms

Mutation testing of quantum programs written in QISKit
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Software functional properties
      1. Formal methods
        Software verification
2. Theory of computation
  1. Semantics and reasoning
    1. Program reasoning
      1. Program verification

Index terms have been assigned to the content through auto-classification.

Recommendations

QMutPy: a mutation testing tool for Quantum algorithms and applications in Qiskit
ISSTA 2022: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis

There is an inherent lack of knowledge and technology to test a quantum program properly. In this paper, building on the definition of syntactically equivalent quantum gates, we describe our efforts in developing a tool, coined QMutPy, leveraging the ...
Quantum Software Testing 101
ICSE-Companion '24: Proceedings of the 2024 IEEE/ACM 46th International Conference on Software Engineering: Companion Proceedings

Quantum software testing (QST) is an emerging research area within quantum software engineering (QSE) to ensure quantum software functional and non-functional correctness and dependability. Since quantum computers perform computations significantly ...
Gate Branch Coverage: A Metric for Quantum Software Testing
QSE-NE 2024: Proceedings of the 1st ACM International Workshop on Quantum Software Engineering: The Next Evolution

The inherent lack of technologies and knowledge from software developers about the intricacies of quantum physics constitutes a heavy hindrance in the development of correct quantum software. Therefore, quantum computing testing techniques are currently ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings

May 2022

394 pages

ISBN:9781450392235

DOI:10.1145/3510454

General Chair:
Matthew B Dwyer
University of Virginia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2022

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Fundação para a Ciência e a Tecnologia
INESC-ID

Conference

ICSE '22

Sponsor:

SIGSOFT

ICSE '22: 44th International Conference on Software Engineering

May 21 - 29, 2022

Pennsylvania, Pittsburgh

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
120
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)9

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kitt LCohen M(2024)MorphQ++: A Reproducibility Study of Metamorphic Testing on Quantum CompilersProceedings of the 2024 Workshop on Replications and Negative Results10.1145/3695750.3695823(15-21)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3695750.3695823
Kitt LCohen MFilkov VRay BZhou M(2024)MorphQ++: A Reproducibility Study of Metamorphic Testing on Quantum CompilersProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering Workshops10.1145/3691621.3694959(8-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691621.3694959
Li YPei HHuang LYin BCai K(2024)Automatic Repair of Quantum Programs via Unitary OperationACM Transactions on Software Engineering and Methodology10.1145/366460433:6(1-43)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3664604
Fortunato DCampos JAbreu RKhan AAkbar MLiang P(2024)Gate Branch Coverage: A Metric for Quantum Software TestingProceedings of the 1st ACM International Workshop on Quantum Software Engineering: The Next Evolution10.1145/3663531.3664753(15-18)Online publication date: 16-Jul-2024
https://dl.acm.org/doi/10.1145/3663531.3664753
Paltenghi MPradel M(2024)Analyzing Quantum Programs with LintQ: A Static Analysis Framework for QiskitProceedings of the ACM on Software Engineering10.1145/36608021:FSE(2144-2166)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660802
Hu TYe GTang ZTan SWang HLi MWang ZChristakis MPradel M(2024)UPBEAT: Test Input Checks of Q# Quantum LibrariesProceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3650212.3652120(186-198)Online publication date: 11-Sep-2024
https://dl.acm.org/doi/10.1145/3650212.3652120
Juárez-Ramírez RNavarro CJiménez SRamírez ATapia-Ibarra VGuerra-García CPerez-Gonzalez HFernández-y-Fernández C(2024)A Taxonomic View of the Fundamental Concepts of Quantum Computing–A Software Engineering PerspectiveProgramming and Computing Software10.1134/S036176882308010849:8(682-704)Online publication date: 24-Jan-2024
https://dl.acm.org/doi/10.1134/S0361768823080108
Ye JXia SZhang FArcaini PMa LZhao JIshikawa FBissyandé TKlein JBird CSarro F(2023)QuraTest: Integrating Quantum Specific Features in Quantum Program TestingProceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE56229.2023.00196(1149-1161)Online publication date: 11-Nov-2023
https://dl.acm.org/doi/10.1109/ASE56229.2023.00196
Zhao PMiao ZLan SZhao J(2023)Bugs4QJournal of Systems and Software10.1016/j.jss.2023.111805205:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.jss.2023.111805

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

QMutPy: a mutation testing tool for Quantum algorithms and applications in Qiskit

Quantum Software Testing 101

Gate Branch Coverage: A Metric for Quantum Software Testing