Evaluation Bug

33 views

Skip to first unread message

unread,

Jun 12, 2022, 7:53:50 AM6/12/22

to AKBC2022

Hi!

It looks like there is an error in the provided 'normalize_object_phrase_list' function.

Resulting list is getting constructed not from head words, but from original phrases.

I have created a PR to fix it. After this fix baseline quality improves to 0.189.

Kind regards,

Tsimafei

unread,

Jun 12, 2022, 7:55:27 AM6/12/22

to AKBC2022

Thanks, Tsimafei. Great catch indeed! I merged the PR.

@everyone: you can `git pull` to get the latest evaluation script. Sorry for the confusion!