Please use this identifier to cite or link to this item:
https://doi.org/10.21256/zhaw-30166
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Birchler, Christian | - |
dc.contributor.author | Kombarabettu Mohammed, Tanzil | - |
dc.contributor.author | Rani, Pooja | - |
dc.contributor.author | Nechita, Teodora | - |
dc.contributor.author | Kehrer, Timo | - |
dc.contributor.author | Panichella, Sebastiano | - |
dc.date.accessioned | 2024-03-09T19:03:06Z | - |
dc.date.available | 2024-03-09T19:03:06Z | - |
dc.date.issued | 2024 | - |
dc.identifier.uri | https://digitalcollection.zhaw.ch/handle/11475/30166 | - |
dc.description | A preprint version of this paper is available at arXiv: https://doi.org/10.48550/arXiv.2401.14736 | de_CH |
dc.description.abstract | Software metrics such as coverage or mutation scores have been investigated for the automated quality assessment of test suites. While traditional tools rely on software metrics, the field of self-driving cars (SDCs) has primarily focused on simulation-based test case generation using quality metrics such as the out-of-bound (OOB) parameter to determine if a test case fails or passes.However, it remains unclear to what extent this quality metric aligns with the human perception of the safety and realism of SDCs. To address this (reality) gap, we conducted an empirical study involving 50 participants to investigate the factors that determine how humans perceive SDC test cases as safe, unsafe, realistic, or unrealistic. To this aim, we developed a framework leveraging virtual reality (VR) technologies, called SDC-Alabaster, to immerse the study participants into the virtual environment of SDC simulators. Our findings indicate that the human assessment of safety and realism of failing/passing test cases can vary based on different factors, such as the test’s complexity and the possibility of interacting with the SDC. Especially for the assessment of realism, the participants’ age leads to a different perception. This study highlights the need for more research on simulation testing quality metrics and the importance of human perception in evaluating SDCs. | de_CH |
dc.language.iso | en | de_CH |
dc.publisher | ZHAW Zürcher Hochschule für Angewandte Wissenschaften | de_CH |
dc.rights | https://creativecommons.org/licenses/by/4.0/ | de_CH |
dc.subject | Software testing | de_CH |
dc.subject | Self-driving car | de_CH |
dc.subject | Simulation | de_CH |
dc.subject | VR | de_CH |
dc.subject | Human perception | de_CH |
dc.subject.ddc | 005: Computerprogrammierung, Programme und Daten | de_CH |
dc.subject.ddc | 006: Spezielle Computerverfahren | de_CH |
dc.title | How does simulation-based testing for self-driving cars match human perception? | de_CH |
dc.type | Konferenz: Paper | de_CH |
dcterms.type | Text | de_CH |
zhaw.departement | School of Engineering | de_CH |
zhaw.organisationalunit | Institut für Informatik (InIT) | de_CH |
dc.identifier.doi | 10.21256/zhaw-30166 | - |
zhaw.conference.details | ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024 | de_CH |
zhaw.funding.eu | info:eu-repo/grantAgreement/EC/H2020/957254//DevOps for Complex Cyber-physical Systems/COSMOS | de_CH |
zhaw.originated.zhaw | Yes | de_CH |
zhaw.publication.status | acceptedVersion | de_CH |
zhaw.publication.review | Peer review (Publikation) | de_CH |
zhaw.webfeed | Software Engineering | de_CH |
zhaw.funding.zhaw | COSMOS – DevOps for Complex Cyber-physical Systems of Systems | de_CH |
zhaw.author.additional | No | de_CH |
zhaw.display.portrait | Yes | de_CH |
zhaw.relation.references | https://doi.org/10.5281/zenodo.10570960 | de_CH |
Appears in collections: | Publikationen School of Engineering |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
2024_Birchler-etal_VR-Study-SDC.pdf | Accepted Version | 18.48 MB | Adobe PDF | View/Open |
Show simple item record
Birchler, C., Kombarabettu Mohammed, T., Rani, P., Nechita, T., Kehrer, T., & Panichella, S. (2024). How does simulation-based testing for self-driving cars match human perception? ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024. https://doi.org/10.21256/zhaw-30166
Birchler, C. et al. (2024) ‘How does simulation-based testing for self-driving cars match human perception?’, in ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. Available at: https://doi.org/10.21256/zhaw-30166.
C. Birchler, T. Kombarabettu Mohammed, P. Rani, T. Nechita, T. Kehrer, and S. Panichella, “How does simulation-based testing for self-driving cars match human perception?,” in ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024, 2024. doi: 10.21256/zhaw-30166.
BIRCHLER, Christian, Tanzil KOMBARABETTU MOHAMMED, Pooja RANI, Teodora NECHITA, Timo KEHRER und Sebastiano PANICHELLA, 2024. How does simulation-based testing for self-driving cars match human perception? In: ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024. Conference paper. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. 2024
Birchler, Christian, Tanzil Kombarabettu Mohammed, Pooja Rani, Teodora Nechita, Timo Kehrer, and Sebastiano Panichella. 2024. “How Does Simulation-Based Testing for Self-Driving Cars Match Human Perception?” Conference paper. In ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. https://doi.org/10.21256/zhaw-30166.
Birchler, Christian, et al. “How Does Simulation-Based Testing for Self-Driving Cars Match Human Perception?” ACM International Conference on the Foundations of Software Engineering (FSE), Porto de Galinhas, Brazil, 17-19 July 2024, ZHAW Zürcher Hochschule für Angewandte Wissenschaften, 2024, https://doi.org/10.21256/zhaw-30166.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.