Inaccurate data in "val.jsonl" file

17 views
Skip to first unread message

Ianis Belu

unread,
Jul 3, 2026, 4:51:12 AMJul 3
to akbc2026-s...@googlegroups.com
I am writing to inform you that I have found incorrect and outdated data in your "val.jsonl" file while evaluating the model. It seems that information for some tasks is erroneous.

For instance, the company "Bharti Airtel" has been listed on the "National Stock Exchange of India" and the "Bombay Stock Exchange" since 2002, while the file only includes the latter. Another example is "RPS Group," which was acquired by "Tetra Tech" and delisted from the LSE in 2023.

The stock exchange task is not the only affected task. I have also found inaccuracies in the city of death for Chuck Norris (which is empty in the file, although he died this year) and incorrect lists regarding the neighboring countries of "Djibouti" and "Saint Pierre and Miquelon".

I hope you can address these issues in the near future.

Best regards,
Ianis Belu and Neacșu Matei

Jan Kalo

unread,
Jul 3, 2026, 6:09:14 AMJul 3
to akbc2026-shared-task
Dear Ianis,

Thanks for notifying us.
I think some of the used data sources are incomplete, and thus the inaccuracies and missing data.
I am working on a fix now and will update you, if the new data is available.

Best,
the AKBC Shared Task Team

Jan-Christoph Kalo

unread,
Jul 15, 2026, 5:47:05 AMJul 15
to Ianis Belu, akbc2026-s...@googlegroups.com
Dear Ianis,

sorry for the late response. I was on vacation last week.
I think we fixed most of these issues now. 

The updated data is now available on the GitHub.

Best,
Jan-Christoph

--
You received this message because you are subscribed to the Google Groups "akbc2026-shared-task" group.
To unsubscribe from this group and stop receiving emails from it, send an email to akbc2026-shared-...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/akbc2026-shared-task/CAPyMOuVf8dfVSK%3DNbCcR_qFB-6jir4vAvXRUyACCGcTNdh_yzQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages