Identifying Flakiness in Quantum Programs

dc.contributor.authorZhang, Lei
dc.contributor.authorRadnejad, Mahsa
dc.contributor.authorMiranskyy, Andriy
dc.date.accessioned2023-03-03T17:28:23Z
dc.date.available2023-03-03T17:28:23Z
dc.date.issued2023-11-08
dc.description.abstractIn recent years, software engineers have explored ways to assist quantum software programmers. Our goal in this paper is to continue this exploration and see if quantum software programmers deal with some problems plaguing classical programs. Specifically, we examine whether intermittently failing tests, i.e., flaky tests, affect quantum software development. To explore flakiness, we conduct a preliminary analysis of 14 quantum software repositories. Then, we identify flaky tests and categorize their causes and methods of fixing them. We find flaky tests in 12 out of 14 quantum software repositories. In these 12 repositories, the lower boundary of the percentage of issues related to flaky tests ranges between 0.26% and 1.85% per repository. We identify 46 distinct flaky test reports with 8 groups of causes and 7 common solutions. Further, we notice that quantum programmers are not using some of the recent flaky test countermeasures developed by software engineers. This work may interest practitioners, as it provides useful insight into the resolution of flaky tests in quantum programs. Researchers may also find the paper helpful as it offers quantitative data on flaky tests in quantum software and points to new research opportunities.en_US
dc.description.urihttps://ieeexplore.ieee.org/abstract/document/10304850en_US
dc.format.extent5 pagesen_US
dc.genreconference papers and proceedingsen_US
dc.genrepreprintsen_US
dc.identifierdoi:10.13016/m2ckqf-k1yx
dc.identifier.citationZhang, Lei, Mahsa Radnejad, and Andriy Miranskyy. "Identifying Flakiness in Quantum Programs". In 2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), 1–7, 2023. https://doi.org/10.1109/ESEM56168.2023.10304850.
dc.identifier.urihttp://doi.org/10.1109/ESEM56168.2023.10304850
dc.identifier.urihttp://hdl.handle.net/11603/26942
dc.language.isoen_USen_US
dc.publisherIEEE
dc.relation.isAvailableAtThe University of Maryland, Baltimore County (UMBC)
dc.relation.ispartofUMBC Information Systems Department Collection
dc.relation.ispartofUMBC Faculty Collection
dc.rights© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.en_US
dc.titleIdentifying Flakiness in Quantum Programsen_US
dc.typeTexten_US
dcterms.creatorhttps://orcid.org/0000-0002-4424-4942en_US

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
2302.03256.pdf
Size:
511.49 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.56 KB
Format:
Item-specific license agreed upon to submission
Description: