Final CFP: TalentCLEF Shared Task (CLEF 2025) - Registration deadline April 25
Luis Gasco
(* apologies for cross-posting *)
Final CFP - TalentCLEF Shared Task (CLEF 2025)
Skill and Job Title Intelligence for Human Capital Management
https://talentclef.github.io/talentclef/
TalentCLEF is an initiative to advance Natural Language Processing (NLP) in Human Capital Management (HCM). It aims to create a public benchmark for model evaluation and promote collaboration to develop fair, multilingual, and flexible systems that improve Human Resources (HR) practices across different industries.
📅 Registration Deadline: April 25, 2025
🔜 Test set release of Task A and B
Key information:
Registration (open until 25th April 2025): https://clef2025-labs-registration.dei.unipd.it/
Codabench Task A: https://www.codabench.org/competitions/5842/
Codabench Task B: https://www.codabench.org/competitions/7059/
Motivation
Integrating Natural Language Processing (NLP) into Human Capital Management (HCM) enhances key areas such as sourcing and hiring, onboarding and training, strategic workforce planning, and career development. Despite these benefits, challenges persist in managing multilingual information, ensuring fair AI models, and developing systems flexible enough to work across industries.
The inaugural TalentCLEF shared-task aims to tackle these challenges through two key tasks:
Task A - Multilingual Job Title Matching: Participants will develop systems to identify and rank job titles most similar to a given one. For each job title in a test set, systems must generate a ranked list of similar titles from a predefined knowledge base. Evaluation will be conducted in English, Spanish, German, and Chinese, covering both monolingual and cross-lingual (between English and the other languages) matching.
Task B - Job Title-Based Skill Prediction: This task focuses on retrieving relevant skills associated with a given job title. Participants will develop systems that predict and extract key skills based on job titles. The evaluation will be conducted in English.
Schedule
20th January 2025 - Training data available for Tasks A and B
17th February 2025 – Start of Task A with the release of the development data
17th March 2025 – Start of Task B with the release of the development data
21st April 2025 – Test set of Task A release
28st April 2025 - Test set of Task B release
5th May 2025 – End of evaluation period
7th May 2025 – Publication of Official Results
30th May 2025 – Submission of CLEF 2025 Participant Working Notes (CEUR-WS)
27th June 2025 - Notification of Acceptance for Participant Papers
Publications and CLEF 2025 workshop
Teams participating in TalentCLEF will be invited to submit a system description paper for the CLEF 2025 Working Notes proceedings, published on CEUR-WS. Additionally, they will have the opportunity to present a brief overview of their approach at the CLEF 2025 workshop, which will take place in Madrid, Spain, from September 9th to 12th, 2025.
Main Organizers
Luis Gascó, Avature, Spain
Hermenegildo Fabregat, Avature, Spain
Laura García-Sardiña, Avature, Spain
Daniel Deniz Cerpa, Avature, Spain
Paula Estrella, Avature, Spain
Álvaro Rodrigo, Universidad Nacional de Educación a Distancia (UNED), Spain
Rabih Zbib, Avature, Spain
Scientific Committee
Eneko Agirre - Full Professor of the University of the Basque Country UPV/EHU - ACL Fellow
David Camacho - Full Professor of the Technical University of Madrid (UPM)
Debora Nozza - Assistant Professor of Bocconi University
Jens-Joris Decorte - Lead AI Scientist at TechWolf
David Graus - Lead Data Scientist at Randstad Group
Mesutt Kayaa - Postdoctoral Researcher at Jobindex A/S and IT University Copenhagen
Jan Luts - Senior Data Scientist at NTT Data & ESCO
Elena Montiel-Ponsoda - Professor at the Technical University of Madrid (UPM) - AI4Labour project
Javier Huertas Tato - Assistant Professor of the Technical University of Madrid (UPM)
Patricia Martín Chozas - Postdoctoral Researcher at the Ontology Engineering Group (UPM) - AI4Labour project