Translation scoring
73 views
Skip to first unread message
Steven Bird
Aug 8, 2021, 5:51:26 PM8/8/21
to nltk-dev
A request for someone to verify this fix please:
One of the functions used in the METEOR score will try to "match" words together, but failed to remove these newly matched words from the list of yet-to-match words, causing another matching method to find the same matches, resulting in duplicates matches.
This produced very incorrect METEOR scores whenever sentences include words which nearly match, such as "create" and "creates".
https://github.com/nltk/nltk/pull/2763
One of the functions used in the METEOR score will try to "match" words together, but failed to remove these newly matched words from the list of yet-to-match words, causing another matching method to find the same matches, resulting in duplicates matches.
This produced very incorrect METEOR scores whenever sentences include words which nearly match, such as "create" and "creates".
https://github.com/nltk/nltk/pull/2763
Thanks,
-Steven Bird
Reply all
Reply to author
Forward
0 new messages