Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Imhof, Melanie | - |
dc.contributor.author | Braschler, Martin | - |
dc.date.accessioned | 2018-03-22T16:08:22Z | - |
dc.date.available | 2018-03-22T16:08:22Z | - |
dc.date.issued | 2015 | - |
dc.identifier.isbn | 978-3-319-24027-5 | de_CH |
dc.identifier.uri | https://digitalcollection.zhaw.ch/handle/11475/4202 | - |
dc.description.abstract | Objective evaluation of effectiveness is a major topic in the field of information retrieval (IR), as emphasized by the numerous evaluation campaigns in this area. The increasing pervasiveness of information has lead to a large variety of IR application scenarios that involve different information types (modalities), heterogeneous documents and context-enriched queries. In this paper, we argue that even though the complexity of academic test collections has increased over the years, they are still too structurally simple in comparison to operational collections in real-world applications. Furthermore, research has brought up retrieval methods for very specific modalities, such as ratings, geographical coordinates and timestamps. However, it is still unclear how to systematically incorporate new modalities in IR systems. We therefore propose a categorization of modalities that not only allows analyzing the complexity of a collection but also helps to generalize methods to entire modality categories instead of being specific for a single modality. Moreover, we discuss how such a complex collection can methodically be built for the usage in an evaluation campaign. | de_CH |
dc.language.iso | en | de_CH |
dc.publisher | Springer | de_CH |
dc.relation.ispartofseries | Lecture Notes in Computer Science | de_CH |
dc.rights | Licence according to publishing contract | de_CH |
dc.subject | IE | de_CH |
dc.subject | INIT | de_CH |
dc.subject | Datalab | de_CH |
dc.subject | Collection complexity | de_CH |
dc.subject | Modality categorization | de_CH |
dc.subject | Evaluation campaigns | de_CH |
dc.subject.ddc | 020: Bibliotheks- und Informationswissenschaft | de_CH |
dc.title | Are test collections “real”? : mirroring real-world complexity in IR test collections | de_CH |
dc.type | Konferenz: Paper | de_CH |
dcterms.type | Text | de_CH |
zhaw.departement | School of Engineering | de_CH |
zhaw.organisationalunit | Institut für Informatik (InIT) | de_CH |
zhaw.publisher.place | Cham | de_CH |
dc.identifier.doi | 10.1007/978-3-319-24027-5_23 | de_CH |
zhaw.conference.details | 6th International Conference of the CLEF Association (CLEF 2015), Toulouse, France, 8-11 September 2015 | de_CH |
zhaw.funding.eu | No | de_CH |
zhaw.originated.zhaw | Yes | de_CH |
zhaw.pages.end | 247 | de_CH |
zhaw.pages.start | 241 | de_CH |
zhaw.parentwork.editor | Mothe, Josiane | - |
zhaw.parentwork.editor | Savoy, Jacques | - |
zhaw.parentwork.editor | Kamps, Jaap | - |
zhaw.parentwork.editor | Pinel-Sauvagnat, Karen | - |
zhaw.parentwork.editor | Jones, Gareth | - |
zhaw.parentwork.editor | San Juan, Eric | - |
zhaw.parentwork.editor | Capellato, Linda | - |
zhaw.parentwork.editor | Ferro, Nicola | - |
zhaw.publication.status | publishedVersion | de_CH |
zhaw.series.number | 9283 | de_CH |
zhaw.publication.review | Not specified | de_CH |
zhaw.title.proceedings | Experimental IR meets Multilinguality, Multimodality, and Interaction | de_CH |
zhaw.webfeed | Information Engineering | de_CH |
Appears in collections: | Publikationen School of Engineering |
Files in This Item:
There are no files associated with this item.
Show simple item record
Imhof, M., & Braschler, M. (2015). Are test collections “real”? : mirroring real-world complexity in IR test collections [Conference paper]. In J. Mothe, J. Savoy, J. Kamps, K. Pinel-Sauvagnat, G. Jones, E. San Juan, L. Capellato, & N. Ferro (Eds.), Experimental IR meets Multilinguality, Multimodality, and Interaction (pp. 241–247). Springer. https://doi.org/10.1007/978-3-319-24027-5_23
Imhof, M. and Braschler, M. (2015) ‘Are test collections “real”? : mirroring real-world complexity in IR test collections’, in J. Mothe et al. (eds) Experimental IR meets Multilinguality, Multimodality, and Interaction. Cham: Springer, pp. 241–247. Available at: https://doi.org/10.1007/978-3-319-24027-5_23.
M. Imhof and M. Braschler, “Are test collections “real”? : mirroring real-world complexity in IR test collections,” in Experimental IR meets Multilinguality, Multimodality, and Interaction, 2015, pp. 241–247. doi: 10.1007/978-3-319-24027-5_23.
IMHOF, Melanie und Martin BRASCHLER, 2015. Are test collections “real”? : mirroring real-world complexity in IR test collections. In: Josiane MOTHE, Jacques SAVOY, Jaap KAMPS, Karen PINEL-SAUVAGNAT, Gareth JONES, Eric SAN JUAN, Linda CAPELLATO und Nicola FERRO (Hrsg.), Experimental IR meets Multilinguality, Multimodality, and Interaction. Conference paper. Cham: Springer. 2015. S. 241–247. ISBN 978-3-319-24027-5
Imhof, Melanie, and Martin Braschler. 2015. “Are Test Collections “Real”? : Mirroring Real-World Complexity in IR Test Collections.” Conference paper. In Experimental IR Meets Multilinguality, Multimodality, and Interaction, edited by Josiane Mothe, Jacques Savoy, Jaap Kamps, Karen Pinel-Sauvagnat, Gareth Jones, Eric San Juan, Linda Capellato, and Nicola Ferro, 241–47. Cham: Springer. https://doi.org/10.1007/978-3-319-24027-5_23.
Imhof, Melanie, and Martin Braschler. “Are Test Collections “Real”? : Mirroring Real-World Complexity in IR Test Collections.” Experimental IR Meets Multilinguality, Multimodality, and Interaction, edited by Josiane Mothe et al., Springer, 2015, pp. 241–47, https://doi.org/10.1007/978-3-319-24027-5_23.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.