Please use this identifier to cite or link to this item:
https://doi.org/10.21256/zhaw-30116| Publication type: | Conference paper |
| Type of review: | Peer review (publication) |
| Title: | SBFT tool competition 2024 : Python test case generation track |
| Authors: | Erni, Nicolas Al-Ameen, Mohammed Birchler, Christian Derakhshanfar, Pouria Lukasczyk, Stephan |
| et. al: | No |
| DOI: | 10.48550/arXiv.2401.15189 10.21256/zhaw-30116 |
| Conference details: | 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024 |
| Issue Date: | 2024 |
| Publisher / Ed. Institution: | ZHAW Zürcher Hochschule für Angewandte Wissenschaften |
| ISBN: | 979-8-4007-0562-5 |
| Language: | English |
| Subjects: | Tool competition; Software testing; Test case Generation; Python; Search based software engineering |
| Subject (DDC): | 005: Computer programming, programs and data |
| Abstract: | Test case generation (TCG) for Python poses distinctive challenges due to the language’s dynamic nature and the absence of strict type information. Previous research has successfully explored automated unit TCG for Python, with solutions outperforming random test generation methods. Nevertheless, fundamental issues persist, hindering the practical adoption of existing test case generators. To address these challenges, we report on the organization, challenges, and results of the first edition of the Python Testing Competition. Four tools, namely UTBotPython, Klara, Hypothesis Ghostwriter, and Pynguin were executed on a benchmark set consisting of 35 Python source files sampled from 7 open-source Python projects for a time budget of 400 seconds. We considered one configuration of each tool for each test subject and evaluated the tools’ effectiveness in terms of code and mutation coverage. This paper describes our methodology, the analysis of the results together with the competing tools, and the challenges faced while running the competition experiments. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/30116 |
| Related research data: | https://zenodo.org/records/10559329 |
| Fulltext version: | Accepted version |
| License (according to publishing contract): | CC BY 4.0: Attribution 4.0 International |
| Departement: | School of Engineering |
| Organisational Unit: | Institute of Computer Science (InIT) |
| Published as part of the ZHAW project: | COSMOS – DevOps for Complex Cyber-physical Systems of Systems |
| Appears in collections: | Publikationen School of Engineering |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| 2024_Erni-etal_SBFT-tool-competition-python-TCG.pdf | Accepted Version | 127.71 kB | Adobe PDF |  View/Open |
Show full item record
Erni, N., Al-Ameen, M., Birchler, C., Derakhshanfar, P., & Lukasczyk, S. (2024). SBFT tool competition 2024 : Python test case generation track. 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. https://doi.org/10.48550/arXiv.2401.15189
Erni, N. et al. (2024) ‘SBFT tool competition 2024 : Python test case generation track’, in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. Available at: https://doi.org/10.48550/arXiv.2401.15189.
N. Erni, M. Al-Ameen, C. Birchler, P. Derakhshanfar, and S. Lukasczyk, “SBFT tool competition 2024 : Python test case generation track,” in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, 2024. doi: 10.48550/arXiv.2401.15189.
ERNI, Nicolas, Mohammed AL-AMEEN, Christian BIRCHLER, Pouria DERAKHSHANFAR und Stephan LUKASCZYK, 2024. SBFT tool competition 2024 : Python test case generation track. In: 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. Conference paper. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. 2024. ISBN 979-8-4007-0562-5
Erni, Nicolas, Mohammed Al-Ameen, Christian Birchler, Pouria Derakhshanfar, and Stephan Lukasczyk. 2024. “SBFT Tool Competition 2024 : Python Test Case Generation Track.” Conference paper. In 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. https://doi.org/10.48550/arXiv.2401.15189.
Erni, Nicolas, et al. “SBFT Tool Competition 2024 : Python Test Case Generation Track.” 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, ZHAW Zürcher Hochschule für Angewandte Wissenschaften, 2024, https://doi.org/10.48550/arXiv.2401.15189.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.