• CLEF eHealth
  • ImageCLEF
  • LifeCLEF
  • Living Labs for IR (LL4IR)
  • News Recommendation Evaluation Lab (NEWSREEL)
  • Uncovering Plagiarism, Authorship and Social Software Misuse (PAN)
  • Social Book Search (SBS)
  • Cultural Microblog Contextualization (CMC)


Accepted labs and Workshops

  • CLEF eHealth: the goals are to develop processing methods and resources in a multilingual setting to enrich difficult-to-understand eHealth textx, and provide valuable documentation.
  • ImageCLEF: the task tackles different aspects of the annotation problem: Image Annotation, ImageCLEFmed: The Medical task, Handwritten Document Retrieval.
  • LifeCLEF: it aims at evaluating multimedia analysis and retrieval techniques on biodiversity data for species identification.
  • LL4IR (Living Lab for IR): the main goal is to provide a benchmarking platform for researchers to evaluate their ranking systems in a live setting with real users in their natural task environment.
  • NEWSREEL (News Recommandation Evaluation Lab): the lab will address the challenge of real-time news recommendation.
  • PAN (uncovering Plagiarism, Authorship and Social Softare Misuse): the main goal to provide for sustainable and reproducible evaluations, to get a clear view of the capabilities of state-of-the-art-algorithms.
  • SBS (Social Book Search): the goal is to investigate techniques to support users in complex book search tasks that involve more than just a query and results list.
  • CMC (Cultural Microblog Contextualization): the workshop aims at developing processing methods and resources to mine the social media sphere surrounding cultural events such as festivals.


Labs chairs

  • Craig Macdonald, University of Glasgow, UK
  • Krisztian Balog, University of Stavenger, Norway


Other members of the Lab committee

  • Martin Braschler, Zurich University of Applied Sciences, Switzerland
  • Nicola Ferro, University of Padua, Italy
  • Donna Harman, National Institute for Standards and Technology (NIST), USA
  • Maarten de Rijke, University of Amsterdam UvA, The Netherlands