[CFP] 3rd Call for Participation and Extended Timeline - ISWC-LLMs4OL 2024 Challenge: Large Language Models for Ontology Learning

[Jennifer D'Souza]

[apologies if you received multiple copies of this call]

Dear colleagues and friends,

We are pleased to release the 3rd Call for Participation - LLMs4OL Challenge collocated with The International Semantic Web Conference (ISWC 2024)

Overview: LLMs4OL stands for "Large Language Models for Ontology Learning." The LLMs4OL paradigm was first introduced in our research paper (https://link.springer.com/chapter/10.1007/978-3-031-47240-4_22) published in the ISWC 2023 main conference proceedings. In this context, we aimed to test the readiness of LLMs to address the Ontology Learning (OL) task w.r.t. three main subtasks: 1) Term Typing, 2) Type Taxonomy Discovery, and 3) Non-Taxonomic Relation Extraction. Therein our evaluations included ontolgies from various knowledge domains, i.e. lexicosemantics (WordNet), geography (GeoNames), biomedicine (NCI, MEDICIN, SNOMEDCT), and web content types (schema.org). With the ISWC-LLMs4OL 2024 challenge, we aim to catalyze community-wide engagement in validating and expanding the use of LLMs in OL by releasing our evaluation datasets publicly in the community. This initiative is poised to advance our comprehension of LLMs’ roles within the Semantic Web, encouraging innovation and collaboration in developing scalable and accurate OL methods.

More info on the task website: https://sites.google.com/view/llms4ol/

The LLMs4OL Challenge will be divided into two evaluation phases:

- Evaluation Phase 1: Few-shot Testing;
- Evaluation Phase 2: Zero-shot Testing

Dates (Extended!!)

Training datasets available: March 30, 2024
Test data available (Task A): June 27, 2024
Evaluation ends (Task A): July 4, 2024
Test data available (Tasks B & C): July 5, 2024
Evaluation ends (Tasks B & C): July 18, 2024
Participant papers due: July 28, 2024
Notification to authors: August 19, 2024
Camera ready due: August 30, 2024

ISWC 2024, Baltimore, Maryland, USA: 11-15 November 2024

If you wish to compare the changes in schedule, the original timeline can be seen here https://sites.google.com/view/llms4ol/important-dates

Task Organizers

Hamed Babaei Giglou (TIB Leibniz Information Centre for Science and Technology - Germany)
Jennifer D’Souza (TIB Leibniz Information Centre for Science and Technology - Germany)
Sören Auer (TIB Leibniz Information Centre for Science and Technology - Germany)

We look forward to having you on board! Help us spread the word to other interested researchers within your network!

Contact: llms4ol.challenge [at] gmail.com