Full metadata record
DC FieldValueLanguage
dc.contributor.authorImhof, Melanie-
dc.contributor.authorBraschler, Martin-
dc.contributor.authorHansen, Preben-
dc.contributor.authorRietberger, Stefan-
dc.date.accessioned2018-03-23T14:55:56Z-
dc.date.available2018-03-23T14:55:56Z-
dc.date.issued2013-
dc.identifier.isbn978-1-4503-2420-5de_CH
dc.identifier.urihttps://digitalcollection.zhaw.ch/handle/11475/4228-
dc.description.abstractBlack box information retrieval (IR) application evaluation allows practitioners to measure the quality of their IR application. Instead of evaluating specific components, e.g. solely the search engine, a complete IR application, including the user’s perspective, is evaluated. The evaluation methodology is designed to be applicable to operational IR applications. The black box evaluation methodology could be packaged into an evaluation and monitoring tool, making it usable for industry stakeholders. The tool should lead practitioners through the evaluation process and maintain the test results for the manual and automatic tests. This paper shows that the methodology is generalizable, even though the diversity of IR applications is high. The challenges in automating tests are the simulation of tasks that require intellectual effort and the handling of different visualizations of the same concept.de_CH
dc.language.isoende_CH
dc.publisherAssociation for Computing Machineryde_CH
dc.rightsLicence according to publishing contractde_CH
dc.subject.ddc020: Bibliotheks- und Informationswissenschaftde_CH
dc.titleEvaluation for operational IR applications – generalizability and automationde_CH
dc.typeKonferenz: Paperde_CH
dcterms.typeTextde_CH
zhaw.departementSchool of Engineeringde_CH
zhaw.organisationalunitInstitut für Informatik (InIT)de_CH
zhaw.publisher.placeNew Yorkde_CH
dc.identifier.doi10.1145/2513150.2513160de_CH
zhaw.conference.detailsWorkshop on Living Labs for Information Retrieval Evaluation, San Francisco, USA, 1 November 2013de_CH
zhaw.funding.euNode_CH
zhaw.originated.zhawYesde_CH
zhaw.pages.end2558de_CH
zhaw.pages.start2557de_CH
zhaw.publication.statuspublishedVersionde_CH
zhaw.publication.reviewNot specifiedde_CH
zhaw.title.proceedingsLivingLab '13 Proceedings of the 2013 workshop on Living labs for information retrieval evaluationde_CH
zhaw.webfeedInformation Engineeringde_CH
Appears in collections:Publikationen School of Engineering

Files in This Item:
There are no files associated with this item.
Show simple item record
Imhof, M., Braschler, M., Hansen, P., & Rietberger, S. (2013). Evaluation for operational IR applications – generalizability and automation [Conference paper]. LivingLab ’13 Proceedings of the 2013 Workshop on Living Labs for Information Retrieval Evaluation, 2557–2558. https://doi.org/10.1145/2513150.2513160
Imhof, M. et al. (2013) ‘Evaluation for operational IR applications – generalizability and automation’, in LivingLab ’13 Proceedings of the 2013 workshop on Living labs for information retrieval evaluation. New York: Association for Computing Machinery, pp. 2557–2558. Available at: https://doi.org/10.1145/2513150.2513160.
M. Imhof, M. Braschler, P. Hansen, and S. Rietberger, “Evaluation for operational IR applications – generalizability and automation,” in LivingLab ’13 Proceedings of the 2013 workshop on Living labs for information retrieval evaluation, 2013, pp. 2557–2558. doi: 10.1145/2513150.2513160.
IMHOF, Melanie, Martin BRASCHLER, Preben HANSEN und Stefan RIETBERGER, 2013. Evaluation for operational IR applications – generalizability and automation. In: LivingLab ’13 Proceedings of the 2013 workshop on Living labs for information retrieval evaluation. Conference paper. New York: Association for Computing Machinery. 2013. S. 2557–2558. ISBN 978-1-4503-2420-5
Imhof, Melanie, Martin Braschler, Preben Hansen, and Stefan Rietberger. 2013. “Evaluation for Operational IR Applications – Generalizability and Automation.” Conference paper. In LivingLab ’13 Proceedings of the 2013 Workshop on Living Labs for Information Retrieval Evaluation, 2557–58. New York: Association for Computing Machinery. https://doi.org/10.1145/2513150.2513160.
Imhof, Melanie, et al. “Evaluation for Operational IR Applications – Generalizability and Automation.” LivingLab ’13 Proceedings of the 2013 Workshop on Living Labs for Information Retrieval Evaluation, Association for Computing Machinery, 2013, pp. 2557–58, https://doi.org/10.1145/2513150.2513160.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.