1st Call for Systems - ISWC 2020 Semantic Web Challenge on Tabular Data to Knowledge Graph Matching (SemTab)

3 views
Skip to first unread message

Ernesto Jimenez-Ruiz

unread,
Mar 11, 2020, 2:00:34 PM3/11/20
to dist...@lcc.uma.es, Description Logic, public-sem...@w3.org, OWL, semant...@w3.org, semant...@googlegroups.com, public...@w3.org, ontol...@googlegroups.com
--Apologies for cross-posting--

This is the 1st call for systems for the SemTab 2020 Semantic Web Challenge on Tabular Data to Knowledge Graph Matching collocated with the International Semantic Web Conference: http://www.cs.ox.ac.uk/isg/challenges/sem-tab/

Tabular data to Knowledge Graph (KG) matching is the process of assigning semantic tags from Knowledge Graphs (e.g., Wikidata or DBpedia) to the elements of the table. This task however is often difficult in practice due to metadata (e.g., table and column names) being missing, incomplete or ambiguous.

This challenge aims at benchmarking systems dealing with the tabular data to KG matching problem, so as to facilitate their comparison on the same basis and the reproducibility of the results.


Challenge Tasks
----------------------
The challenge includes the following tasks organised into several evaluation rounds:

    - Assigning a semantic type (e.g., a KG class) to a column: CTA task.
    - Matching a cell to a KG entity: CEA task.
    - Assigning a KG property to the relationship between two columns: CPA task

The challenge will be run with the support of the AICrowd platform.


Discussion group
----------------------
We have a discussion group for the challenge where we share the latest news with the participants and we discuss issues risen during the evaluation rounds:
https://groups.google.com/d/forum/sem-tab-challenge

Tentative Dates
----------------------
    March 23: Round 1 opens.
    April 30: Round 1 closes.
    May 8: Round 2 opens.
    July 7: Round 2 closes.
    July 8: Best participants in Rounds 1 and 2 are invited to present their results during the ISWC conference and the Ontology Matching workshop. Check the ISWC student travel grants.
    July 15: Round 3 opens.
    August 31: Round 3 closes.
    September 15: Round 4 opens.
    October 15: Round 4 closes.
    October 20: System paper submissions (preliminary version).
    November 2-3: Ontology Matching workshop.
    November 4-6: Challenge Presentation and prize announcement.
    November 15: System paper submissions (final version).


Organisation
----------------------
This track is organised by Kavitha Srinivas (IBM Research), Ernesto Jimenez-Ruiz (City, University of Lonson; University of Oslo), Oktie Hassanzadeh (IBM Research), Jiaoyan Chen (University of Oxford) and Vasilis Efthymiou (IBM Research). If you have any problems working with the datasets or any suggestions related to this challenge, do not hesitate to contact us via the discussion group.

Acknowledgements
----------------------
The challenge is currently supported by the SIRIUS Centre for Research-driven Innovation and IBM Research.


--
Ernesto Jiménez-Ruiz
Lecturer in Artificial Intelligence

Department of Computer Science
School of Mathematics, Computer Science and Engineering
City, University of London
T: +44 (0)20 7040 0212


Reply all
Reply to author
Forward
0 new messages