iSTS Interpretable - evaluation results

[Interpretable STS Semeval Task]

Dear participants,

Regarding the results of the task, we have planned to give overall results and specific results for each one of the three datasets.

However, we would like to know your opinion about how to give the main result. We are considering two different alternatives:

• The mean score of the three datasets
• The mean score of images and headlines.

Please, let us know your preferences at the next link: http://doodle.com/poll/mpw94ndhipeear6s

Montse