Inaccurate data in "val.jsonl" file

[Ianis Belu]

I am writing to inform you that I have found incorrect and outdated data in your "val.jsonl" file while evaluating the model. It seems that information for some tasks is erroneous.

For instance, the company "Bharti Airtel" has been listed on the "National Stock Exchange of India" and the "Bombay Stock Exchange" since 2002, while the file only includes the latter. Another example is "RPS Group," which was acquired by "Tetra Tech" and delisted from the LSE in 2023.

The stock exchange task is not the only affected task. I have also found inaccuracies in the city of death for Chuck Norris (which is empty in the file, although he died this year) and incorrect lists regarding the neighboring countries of "Djibouti" and "Saint Pierre and Miquelon".

I hope you can address these issues in the near future.

Best regards,
Ianis Belu and Neacșu Matei

[Jan Kalo]

Dear Ianis,

Thanks for notifying us.

I think some of the used data sources are incomplete, and thus the inaccuracies and missing data.

I am working on a fix now and will update you, if the new data is available.

Best,

the AKBC Shared Task Team