tasks.md

title
SemEval-2025 Tasks

We are pleased to announce the following tasks for SemEval-2025!

TASKS

Websites and contact information for individual tasks will be given below soon.

Semantic Relations

• Task 1: ADMIRE: Advancing Multimodal Idiomaticity Representation ([contact organizers], [join task mailing list])
  Thomas Pickard, Aline Villavicencio, Maggie Mi, Wei He, Carolina Scarton, Marco Idiart

• Task 2: EA-MT: Entity-Aware Machine Translation ([contact organizers], [join task mailing list])
  Simone Conia, Min Li, Roberto Navigli, Saloni Potdar

LLM Capabilities

• Task 3: Mu-SHROOM, the Multilingual Shared-task on Hallucinations and Related Observable Overgeneration Mistakes ([contact organizers], [join task mailing list])
  Timothee Mickus, Elaine Zosa, Raúl Vázquez, Teemu Vahtola, Jörg Tiedemann, Vincent Segonne, Alessandro Raganato, Shaoxiong Ji, Jussi Karlgren, Marianna Apidianaki

• Task 4: Unlearning sensitive content from Large Language Models ([contact organizers], [join task mailing list])
  Anil Ramakrishna, Kai-Wei Chang, Rahul Gupta, Volkan Cevher, Bhanu Vinzamuri, He Xie, Venkatesh Elango, Zhiqi Bu

• Task 5: LLMs4Subjects: LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog ([contact organizers], [join task mailing list])
  Jennifer D'Souza, Mathias Begoin, Holger Israel, Berrit Genat, Sören Auer

Fact Checking and Knowledge Verification

• Task 6: PromiseEval: Multinational, Multilingual, Multi-Industry Promise Verification ([contact organizers], [join task mailing list])
  Chung-Chi Chen, Juyeon Kang, Hanwool Lee, Yohei Seki, Min-Yuh Day, Hiroya Takamura

• Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval ([contact organizers], [join task mailing list])
  Qiwei Peng, Michal Gregor, Ivan Srba, Simon Ostermann, Marian Simko, Juraj Podroužek, Matúš Mesarčík, Jaroslav Kopčan

• Task 8: Question-Answering over Tabular Data ([contact organizers], [join task mailing list])
  Jorge Osés Grijalba, L. Alfonso Ureña, Eugenio Martinez-Camara, Jose Camacho-Collados

• Task 9: The Food Hazard Detection Challenge ([contact organizers], [join task mailing list])
  Korbinian Randl, George Marinos, John Pavlopoulos, Aron Henriksson, Tony Lindgren, Manos Karvounis

Knowledge Representation and Reasoning

• Task 10: Multilingual Characterization and Extraction of Narratives from Online News ([contact organizers], [join task mailing list])
  Jakub Piskorski, Giovanni Da San Martino, Preslav Nakov, Tarek Mahmoud, Tanmoy Chakraborty, Shivam Sharma, Roman Yangarber, Ion Androutsopoulos, John Pavlopoulos, Nikolaos Nikolaidis, Ricardo Campos, Alipio Jorge, Dimitar Iliyanov Dimitrov, Ivan Koychev

• Task 11: Bridging the Gap in Text-Based Emotion Detection ([contact organizers], [join task mailing list])
  Shamsuddeen Hassan Muhammad, Seid Muhie Yimam, Nedjma OUSIDHOUM, Idris Abdulmumin, Ibrahim Said Ahmad, Alham Fikri Aji, David Ifeoluwa Adelani, Vladimir Araujo, Abinew Ali Ayele, Tadesse Destaw Belay, Daniela Teodorescu, Jan Philip Wahle, Terry Ruas, Nirmal Surange, Yi Zhou

CONTACT

For questions about particular tasks, email the task organizers at the addresses linked above. General questions about SemEval organization should be directed to [email protected].

For general information about participating in SemEval and submitting papers, see Resources.

Link to CodaLab instructions, for both organizers and participants.