On 1/2/17, 00:05, Manikandan R wrote:
> During SemEval 2016 we had around a week time for each evaluation phase, this time in Codalab only start date is mentioned. Just wanted to confirm if we similar evaluation period or should we submit on the date mentioned in Codalab.
The Phases tab shows all the dates:
In short, there will be one week to submit systems to the “Unsupervised Domain Adaptation” phase, i.e., based on all the annotated colon cancer that has already been released and the unlabeled brain cancer data. Then, there will be two weeks to submit systems to the “Supervised Domain Adaptation” phase.
> Just wanted to know when would be each of train and test sets be released.
The training data for the “Supervised Domain Adaptation” phase will be released when that phase begins, on Jan. 16, 2017. The plain text for the test data has already been released (it is the doc* files in the Test zip file); the annotations for the test data will be released once the competition is complete.
Note that since the plain text for the test set has been already released (due to the format in which the Mayo Clinic distributed the data), we ask participants to be extra careful not to somehow tune their systems to that data, and when we ask you all for system descriptions to give some details exactly how you used any of the unlabeled data (if you used it).