Year: 2018
Type: conference-paper
Abstract: At CLEF 2018, the Personalised Information Retrieval Lab\n(PIR-CLEF 2018) has been conceived to provide an initiative aimed at\nboth providing and critically analysing a new approach to the evaluation\nof personalization in Information Retrieval (PIR). PIR-CLEF 2018 is the\nfirst edition of this Lab after the successful Pilot lab organised at CLEF\n2017. PIR CLEF 2018 has provided registered participants with the data\nsets originally developed for the PIR-CLEF 2017 Pilot task; the data collected are related to real search sessions over a subset of the ClueWeb12\ncollection, undertaken by 10 users by using a novel methodology. The\ndata were gathered during the search sessions undertaken by 10 volunteer searchers. Activities during these search sessions included relevance\nassessment of a retrieved documents by the searchers. 16 groups registered to participate at PIR-CLEF 2018 and were provided with the data\nset to allow them to work on PIR related tasks and to provide feedback\nabout our proposed PIR evaluation methodology with the aim to create\nan effective evaluation task.
Authors: Pasi, Gabriella, Jones, Gareth J.F., Curtis, Keith, Marrara, Stefania, Sanvitto, Camilla, Ganguly, Debasis, Sen, Procheta
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2970828463