Labs

  • CLEF eHealth
  • ImageCLEF
  • LifeCLEF
  • Living Labs for IR (LL4IR)
  • News Recommendation Evaluation Lab (NEWSREEL)
  • Uncovering Plagiarism, Authorship and Social Software Misuse (PAN)
  • Social Book Search (SBS)
Workshop
  • Cultural Microblog Contextualization (CMC)

 

Accepted labs and Workshops

  • CLEF eHealth: the goals are to develop processing methods and resources in a multilingual setting to enrich difficult-to-understand eHealth textx, and provide valuable documentation.
    https://sites.google.com/site/clefehealth2016/
  • ImageCLEF: the task tackles different aspects of the annotation problem: Image Annotation, ImageCLEFmed: The Medical task, Handwritten Document Retrieval.
    http://www.imageclef.org/2016
  • LifeCLEF: it aims at evaluating multimedia analysis and retrieval techniques on biodiversity data for species identification.
    http://www.imageclef.org/node/197
  • LL4IR (Living Lab for IR): the main goal is to provide a benchmarking platform for researchers to evaluate their ranking systems in a live setting with real users in their natural task environment.
    http://living-labs.net/clef-ll4ir-2016/
  • NEWSREEL (News Recommandation Evaluation Lab): the lab will address the challenge of real-time news recommendation.
    http://www.clef-newsreel.org/
  • PAN (uncovering Plagiarism, Authorship and Social Softare Misuse): the main goal to provide for sustainable and reproducible evaluations, to get a clear view of the capabilities of state-of-the-art-algorithms.
    http://pan.webis.de/
  • SBS (Social Book Search): the goal is to investigate techniques to support users in complex book search tasks that involve more than just a query and results list.
    http://social-book-search.humanities.uva.nl/#/overview
  • CMC (Cultural Microblog Contextualization): the workshop aims at developing processing methods and resources to mine the social media sphere surrounding cultural events such as festivals.
    https://mc2.talne.eu/~cmc/spip/

 

Labs chairs

  • Craig Macdonald, University of Glasgow, UK
  • Krisztian Balog, University of Stavenger, Norway

 

Other members of the Lab committee

  • Martin Braschler, Zurich University of Applied Sciences, Switzerland
  • Nicola Ferro, University of Padua, Italy
  • Donna Harman, National Institute for Standards and Technology (NIST), USA
  • Maarten de Rijke, University of Amsterdam UvA, The Netherlands

 



CLEF 2016 Conference and Labs of the Evaluation Forum