Working Notes

CLEF 2016 Labs Working Notes available online in, volume 1609.

CLEF eHealth

  • [Invited] Clinical Information Extraction at the CLEF eHealth Evaluation lab 2016
    Aurélie Névéol, Kevin Bretonnel Cohen, Cyril Grouin, Thierry Hamon, Thomas Lavergne, Liadh Kelly, Lorraine Goeuriot, Grégoire Rey, Aude Robert, Xavier Tannier and Pierre Zweigenbaum
  • [Invited] Task 1 of the CLEF eHealth Evaluation Lab 2016: Handover Information Extraction
    Hanna Suominen, Liyuan Zhou, Lorraine Goeuriot and Liadh Kelly
  • [Invited] The IR Task at the CLEF eHealth Evaluation Lab 2016: User-centred Health Information Retrieval
    Guido Zuccon, Joao Palotti, Lorraine Goeuriot, Liadh Kelly, Mihai Lupu, Pavel Pecina, Henning Müller, Julie Budaher and Anthony Deacon
  • BiTeM at CLEF eHealth Evaluation Lab 2016 Task 2: Multilingual Information Extraction
    Luc Mottin, Julien Gobeill, Anaïs Mottaz, Emilie Pasche, Arnaud Gaudinat and Patrick Ruch
  • CLEF eHealth 2016 - Task 1: Information extraction
    Lautaro Quiroz, Lydia Mennes and Evangelos Kanoulas
  • Comparison of Several Word embedding Sources for Medical Information Retrieval
    Julie Budaher, Mohannad Almasri and Lorraine Goeuriot
  • ECNU at 2016 eHealth Task 1: Handover Information Extraction
    Yang Song, Yun He, Hongyu Liu, Qinmin Hu, Liang He and Yueyao Wang
  • ECNU at 2016 eHealth Task 3: Patient-centred Information Retrieval
    Yang Song, Yun He, Hongyu Liu, Yueyao Wang, Qinmin Hu and Liang He
  • ECSTRA-INSERM @ CLEF eHealth2016-task 2: ICD10 Code Extraction from Death Certificates
    Mohamed Dermouche, Vincent Looten, Rémi Flicoteaux, Sylvie Chevret, Julien Velcin and Namik Taright
  • Erasmus MC at CLEF eHealth 2016: Concept Recognition and Coding in French Texts
    Erik M. van Mulligen, Zubair Afzal, Saber A. Akhondi, Dang Vo and Jan A. Kors
  • KDEIR at CLEF eHealth 2016: Health Documents Re-ranking Based on Query Variations
    Md Zia Ullah and Masaki Aono
  • KISTI at CLEF eHealth 2016 Task 3: Ranking Medical Documents using Word Vectors
    Heung-Seon Oh and Yuchul Jung
  • LIMSI ICD10 coding experiments on CépiDC death certificate statements
    Pierre Zweigenbaum and Thomas Lavergne
  • LITL at CLEF eHealth2016: recognizing entities in French biomedical documents
    Lydia-Mai Ho-Dac, Ludovic Tanguy, Céline Grauby, Nkauj Hnub Aurore Heu Mby, Justine Malosse, Laura Rivière, Amélie Veltz-Mauclair and Marine Wauquier
  • MayoNLPTeam at the 2016 CLEF eHealth Information Retrieval Task 1
    Yanshan Wang, Stephen Wu and Hongfang Liu
  • Semantic tagging and normalization of French medical entities
    Jorge Vivaldi, Horacio Rodriguez and Viviana Cotik
  • SIBM at CLEF eHealth Evaluation Lab 2016: Extracting Concepts in French Medical Texts with ECMT and CIMIND
    Chloé Cabot, Lina F. Soualmia, Badisse Dahamna and Stéfan Darmoni
  • Task 3: Patient-Centered Information Retrieval, IRTask 1: ad-hoc search - TEAM ub-botswana.
    Edwin Thuma, Nkwebi Peace Motlogelwa and Tebo Dingalo
  • Task3 Patient-Centred Information Retrieval: Team CUNI
    Shadi Saleh and Pavel Pecina
  • Team GU-IRLAB at CLEF eHealth 2016: Task 3
    Luca Soldaini and Will Edman
  • The effectiveness of query expansion when searching for health related content: InfoLab at CLEF eHealth 2016
    Ricardo Silva and Carla Lopes
  • WHUIRGroup at the CLEF 2016 eHealth Lab Task 3
    Ruixue Wang, Wei Lu and Ke Ren
  • Wrappers for Feature Subset Selection in CRF-based Clinical Information Extraction
    Mike Ebersbach, Robert Herms, Christina Lohr and Maximilian Eibl


  • [Invited] Overview of the ImageCLEF 2016 Handwritten Scanned Document Retrieval Task
    Mauricio Villegas, Joan Puigcerver, Alejandro Toselli, Joan Andreu Sanchez and Enrique Vidal
  • [Invited] Overview of the ImageCLEF 2016 Scalable Concept Image Annotation Task
    Andrew Gilbert, Luca Piras, Josiah Wang, Fei Yan, Arnau Ramisa, Emmanuel Dellandrea, Robert Gaizauskas, Mauricio Villegas and Krystian Mikolajczyk
  • CITlab ARGUS for Keyword Search in Historical Handwritten Documents - Description of CITlab's System for the Handwritten Scanned Document Retrieval Task: Handwritten Text Recognition on the tranScriptorium Dataset
    Tobias Strauß, Tobias Grüning, Gundram Leifert and Roger Labahn
  • CNRS TELECOM ParisTech at ImageCLEF 2016 Scalable Concept Image Annotation Task: Overcoming the Scarcity of Training Data
    Hichem Sahbi
  • DUTh at the ImageCLEF 2016 Image Annotation Task: Content Selection
    Georgios Barlas, Maria Ntonti and Avi Arampatzis
  • Image annotation and two paths to text illustration
    Herve Le Borgne, Etienne Gadeski, Ines Chami, Thi Quynh Nhi Tran, Youssef Tamaazousti, Alexandru Lucian Gînscă and Adrian Popescu
  • INAOE’s participation at ImageCLEF 2016: Text Illustration Task
    Luis Pellegrin, A. Pastor López-Monroy, Hugo Jair Escalante and Manuel Montes-Y-Gómez
  • IPL at CLEF 2016 Medical Task
    Leonidas Valavanis and Theodore Kalamboukis
  • Joint Learning of CNN and LSTM for Image Captioning
    Yongqing Zhu, Xiangyang Li, Xue Li, Jian Sun, Xinhang Song and Shuqiang Jiang
  • MayoBMI at ImageCLEF 2016 Handwritten Document Retrieval Challenge
    Sijia Liu, Yanshan Wang, Saeed Mehrabi, Dingcheng Li and Hongfang Liu
  • MRIM-LIG at ImageCLEF 2016 Scalable Concept Image Annotation Task
    Maxime Portaz, Mateusz Budnik, Philippe Mulhem and Johann Poignant
  • NovaSearch at ImageCLEFmed 2016 Subfigure Classification Task
    David Semedo and João Magalhães
  • Overview of the Medical Tasks in ImageCLEF 2016
    Alba García Seco De Herrera, Roger Schaer, Stefano Bromuri and Henning Müller
  • Subfigure and Multi-Label Classification using a Fine-Tuned Convolutional Neural Network
    Ashnil Kumar, David Lyndon, Jinman Kim and David Feng
  • Traditional Feature Engineering and Deep Learning Approaches at Medical Classification Task of ImageCLEF 2016
    Sven Koitka and Christoph M. Friedrich
  • UAEMex at ImageCLEF 2016: Handwritten Retrieval
    Miguel Ángel García Calderón and René Arnulfo García Hernández
  • UDEL CIS Working Notes in ImageCLEF 2016
    Scott Sorensen, Pengyuan Li, Abhishek Kolagunda, Xiangying Jiang, Xiaolong Wang, Hagit Shatkay and Chandra Kambhamettu
  • Using Machine Learning Techniques, Textual and Visual Processing in Scalable Concept Image Annotation Challenge
    Alexandru Cristea and Adrian Iftene


  • [Invited] LifeCLEF Bird Identification Task 2016
    Hervé Goëau, Hervé Glotin, Willem-Pier Vellinga, Robert Planqué and Alexis Joly
  • [Invited] Plant identification in an open-world (LifeCLEF 2016)
    Hervé Goëau, Pierre Bonnet and Alexis Joly
  • Audio Based Bird Species Identification using Deep Learning Techniques
    Elias Sprengel, Martin Jaggi, Yannic Kilcher and Thomas Hofmann
  • Bag of MFCC-based words for bird identification
    Julien Ricard and Hervé Glotin
  • Bluefield (KDE TUT) at LifeCLEF 2016 Plant Identification Task
    Siang Thye Hang, Atsushi Tatsuma and Masaki Aono
  • Convolutional Neural Networks for Large-Scale Bird Song Classification in Noisy Environment
  • Deep Learning and SVM Classification for Plant Recognition in Content-Based Large Scale Image Retrieval
    Bálint Pál Tóth, Márton Tóth, Dávid Papp and Gábor Szűcs
  • Feature Learning via Mixtures of DCNNs for Fine-Grained Plant Classification
    Chris McCool, Zongyuan Ge and Peter Corke
  • Floristic participation at LifeCLEF 2016 Plant Identification Task
    Hervé Goëau, Julien Champ and Alexis Joly
  • Improving Bird Identification using Multiresolution Template Matching and Feature Selection during Training
    Mario Lasseck
  • Large-scale individual whales matching: spot the difference in the ocean
    Alexis Joly, Jean-Christophe Lombardo, Julien Champ and Anjara Saloma
  • Object detection, classification, tracking and individual recognition for sea images and videos
    Dávid Papp, Dániel Lovas and Gábor Szűcs
  • Open-set Plant Identification Using an Ensemble of Deep Convolutional Neural Networks
    Mostafa Mehdipour Ghazi, Berrin Yanikoglu and Erchan Aptoula
  • Plant Identification System based on a Convolutional Neural Network for the LifeClef 2016 Plant Classification Task
    Sue Han Lee, Yang Loong Chang, Chee Seng Chan and Paolo Remagnino
  • Recognizing bird species in audio recordings using deep convolutional neural networks
    Karol Piczak
  • SeaCLEF 2016: Object proposal classification for fish detection in underwater videos
    Jonas Jäger, Erik Rodner, Joachim Denzler, Viviane Wolff and Klaus Fricke-Neuderth
  • Very Deep Residual Networks with MaxOut for Plant Identification in the Wild
    Milan Šulc, Dmytro Mishkin and Jiří Matas


(Living Lab for IR & News Recommandation Evaluation Lab)
  • [Invited] CLEF NewsREEL 2016: Comparing Multi-dimensional Offline and Online Evaluation of News Recommender Systems
    Benjamin Kille, Andreas Lommatzsch, Frank Hopfgartner, Martha Larson, Jonas Seiler, Davide Malagoli, Andras Sereny and Torben Brodt
  • CLEF NEWSReel 2016: Image based Recommendation
    Francesco Corsini and Martha Larson
  • Clicks Pattern Analysis for Online News Recommendation Systems
    Jing Yuan, Andreas Lommatzsch and Benjamin Kille
  • Develoment of a News Recommender System based on Apache Flink
    Alexandru Ciobanu and Andreas Lommatzsch
  • Development and Evaluation of a Scalable News Recommender System, Applying Time-dependent Models
    Patrick Probst and Andreas Lommatzsch
  • Ideas for a Standard LL4IR Extension - Living Labs from a System Operator's Perspective
    Philipp Schaer and Narges Tavakolpoursaleh
  • Living Ranking: from online to real-time information retrieval evaluation
    Lamjed Ben Jabeur, Laure Soulier, Paul Mousset and Lynda Tamine
  • Real-time News Recommendation using Apache Spark
    Andreas Lommatzsch, Jens Meiners, Jaschar Domann and Lea Helmers
  • Recommender Ensembles for News Articles based on Most-Popular Strategies
    Andreas Lommatzsch, Jens Meiners, Lea Helmers, Jaschar Domann and Niels Johannes
  • Recommender Systems  Evaluations : A|A Test, Offline and Online
    Gebreskirstos G. Gebremeskel and Arjen P. de Vries
  • Research-Centres Centred Living Labs
    Liadh Kelly


(uncovering Plagiarism, Authorship and Social Softare Misuse)
  • [Invited] Author Obfuscation: Attacking the State of the Art in Authorship Verification
    Martin Potthast, Matthias Hagen and Benno Stein
  • [Invited] Clustering by Authorship Within and Across Documents
    Efstathios Stamatatos, Michael Tschuggnall, Ben Verhoeven, Walter Daelemans, Guenther Specht, Benno Stein and Martin Potthast
  • [Invited] Overview of the 4th Author Profiling Task at PAN 2016: Cross-Genre Evaluations
    Francisco Manuel Rangel Pardo, Paolo Rosso, Ben Verhoeven, Walter Daelemans, Martin Potthast and Benno Stein
  •  Author Profiling using Complementary Second Order Attributes and Stylometric Features
    Konstantinos Bougiatiotis and Anastasia Krithara
  • A Big Increase in Known Unknowns: from Author Verification to Author Clustering
    Anna Vartapetiance and Lee Gillam
  • Adapting Cross-Genre Author Profiling to Language and Corpus
    Ilia Markov, Helena Gómez-Adorno and Grigori Sidorov
  • Age and Gender Identification using Stacking for Classification
    Madhulika Agrawal and Teresa Gonçalves
  • Author Diarization Using Cluster-Distance  Approach
    Abdul Sittar, Rizwan Iqbal and Adeel Nawab
  • Author Masking through Translation
    Yashwant Keswani, Harsh Trivedi, Parth Mehta and Prasenjit Majumder
  • Author obfuscation using WordNet and language models: Notebook for PAN at CLEF 2016
    Muharram Mansourizade
  • Author Profiling Using Support Vector Machines
    Rodwan Bakkar Deyab, José Duarte and Teresa Gonçalves
  • Author Profiling using SVMs and Word Embedding Averages
    Roy Khristopher Bayot and Teresa Gonçalves
  • Authorship clustering using multi-headed recurrent neural networks
    Douglas Bagnall
  • Autorship-link Ranking and Complete Author Clustering
    Valentin Zmiycharov, Dimitar Alexandrov, Hristo Georgiev, Preslav Nakov, Yasen Kiprov, Georgi Georgiev and Ivan Koychev
  • CAPS: A Cross-genre Author Profiling System - Notebook for PAN at CLEF 2016
    Ivan Bilan and Desislava Zhekova
  • Cross-Genre Age and Gender Identification in Social Media
    Anam Zahid, Aadarsh Sampath, Anindya Dey and Golnoosh Farnadi
  • Cross-Genre Author Profile Prediction Using Stylometry-Based Approach
    Shaina Ashraf,  Hafiz Rizwan Iqbal and  Rao Muhammad Adeel Nawab
  • Derivative Approach for Plagiarism Source Retrieval
    Rhulani Maluleka
  • Evaluating Safeness, Soundness and Properness of Obfuscation Systems
    Pashutan Modaresi, Matthias Liebeck and Stefan Conrad
  • Exploring the Effects of Cross-Genre Machine Learning for Author Profiling in PAN 2016
    Pashutan Modaresi, Matthias Liebeck and Stefan Conrad
  • Exploring Word Embeddings and Character N-Grams for Author Clustering
    Yunita Sari and Mark Stevenson
  • GronUP: Groningen User Profiling
    Mart Busger Op Vollenbroek, Talvany Carlotto, Tim Kreutz, Maria Medvedeva, Chris Pool, Johannes Bjerva, Hessel Haagsma and Malvina Nissim
  • Methods for intrinsic plagiarism detection and author diarizatio
    Mikhail Kuznetsov, Anastasia Motrenko, Rita Kuznetsova and Vadim Strijov
  • Multi feature space combination for authorship clustering Notebook for PAN at CLEF 2016
    Muharram Mansoorizadeh, Mohammad Aminian, Taher Rahgooy and Mehdy Eskandari
  • PANcakes Team: A Composite System of Domain-Agnostic Features For Author Profiling
    Pepa Gencheva, Martin Boyanov, Elena Deneva, Preslav Nakov, Georgi Georgiev, Yasen Kiprov and Ivan Koychev
  • Profile-based Approach for Age and Gender Identification. Notebook for PAN at CLEF 2016.
    Ma. José Garciarena Ucelay, Ma. Paula Villegas, Dario G. Funez, Leticia C. Cagnina, Marcelo L. Errecalde, Gabriela Ramírez-De-La-Rosa and Esau Villatoro-Tello
  • Profiling microblog authors using concreteness and sentiment - Know-Center at PAN 2016 author profiling
    Oliver Pimas, Andi Rexha, Mark Kröll and Roman Kern
  • Statistical Semantics in Context Space: Amrita CEN@Author Profiling
    Barathi Ganesh Hb, Anand Kumar M and Soman Kp
  • SU@PAN’2016: Author Obfuscation Notebook for PAN at CLEF 2016
    Tsvetomila Mihaylova, Georgi Karadjov, Preslav Nakov, Yasen Kiprov, Georgi Georgiev and Ivan Koychev
  • UniNE at CLEF 2016: Author Clustering
    Mirco Kocher
  • UniNE at CLEF 2016: Author Profiling
    Mirco Kocher and Jacques Savoy
  • Using Machine Learning Algorithms For Author Profiling In Social Media
    Daniel Dichiu and Irina Rancea


(Social Book Search)
  • [Invited] Overview of the SBS 2016 Interactive Track
    Maria Gaede, Mark Michael Hall, Hugo Huurdeman, Jaap Kamps, Marijn Koolen, Mette Skov, Toine Bogers and David Walsh
  • [Invited] Overview of the SBS 2016 Mining Track
    Toine Bogers, Iris Hendrickx, Marijn Koolen and Suzan Verberne
  • [Invited] Overview of the SBS 2016 Suggestion Track
    Marijn Koolen, Toine Bogers and Jaap Kamps
  • BM25 for Non-Textual Modalities in Social Book Search
    Melanie Imhof
  • Hood or Hypertext: A Comparison of Offline and Online Book Search Sessions
    Maria Gaede and Vivien Petras
  • I Need More Time!: The Influence of Native Language  on Book Search Behavior and Experience
    Chang Liu, Pengyi Zhang and Preben Hansen
  • Individual Differences and Task Behaviour
    Mark Michael Hall
  • KNOW At The Social Book Search Lab 2016 Mining Track
    Hermann Ziak, Andi Rexha and Roman Kern
  • KNOW At The Social Book Search Lab 2016 Suggestion Track
    Hermann Ziak and Roman Kern
  • Linking Task: Identifying authors and book titles in verbose queries
    Ollagnier Anaïs, Fournier Sébastien and Bellot Patrice
  • OAUC's participation in the CLEF2016 SBS Search Suggestion Track
    Michael Preminger and Gjertrud Fludal
  • Query Expansion by Word Embedding in the Suggestion Track of CLEF 2016 Social Book Search Lab
    Shih-Hung Wu, Yi-Hsiang Hsieh, Liang-Pu Chen and Ping-Che Yang
  • SBS 2016 : Combining Query Expansion Result  and Books Information Score for Book  Recommendation
    Amal Htait, Sébastien Fournier and Patrice Bellot
  • SBS 2016 Track mining: Text mining based approaches for book search requests classication
    Mohamed Ettaleb, Chiraz Latiri, Brahim Douar and Patrice Bellot
    Ritesh Kumar, Bhanodai Guggilla and Rajendra Pamula
  • USTB at Social Book Search 2016 Suggestion Task: Active Books Set and Re-ranking
    Shao-Hui Feng, Bo-Wen Zhang, Xu-Cheng Yin, Zan-Xia Jin, Jian-Lin Jin, Jian-Wei Wu, Le-Le Zhang, Hao-Jie Pan, Fan Fang and Fang Zhou
  • Verbose Query Reduction by Learning to Rank for  Social Book Search Track
    Messaoud Chaa, Omar Nouali and Patrice Bellot
  • Word Embedding for Social Book Suggestion
    Nawal Ould Amer, Philippe Mulhem, Mathias Géry and Karam Abdulahhad

Workshop Papers

Papers available online in, volume 1609.


(Cultural Microblog Contextualization)
  • Building a Knowledge Base using Microblogs: the Case of Cultural MicroBlog Contextualization Collection
    Thi Bich Ngoc Hoang and Josiane Mothe
  • LIG at CLEF 2016 Cultural Microblog Contextualization: TimeLine illustration based on Microblogs
    Nayanika Dogra, Philippe Mulhem, Nawal Ould Amer and Lorraine Goeuriot
  • Semantic Mapping: Towards Contextual and Trend Analysis of Behaviours and Practices
    Murtagh Fionn
  • Tweet Contextualization using Continuous Space Vector: an experiment on the CLEF-INEX'16 task
    Elvys Linhares Pontes, Juan-Manuel Torres-Moreno, Stéphane Huet and Andréa Carneiro Linhares
  • Tweet Data mining : the Cultural Microblog Contextualization Data Set
    Clémentine Scohy, Yassine Rkha Chaham, Sébastien Déjean and Josiane Mothe