Leaderboard final test and info

[sali]

Dear all,

We apologise for delay. 

Due to some technical small errors at our end, we have now increased the leaderboard test attempts to 4 per day. Please make sure you keep track of your submissions. Only the latest submission by 4th 12:00 (noon, GMT, the deadline) will be taken into account. 

Good luck!!! The results will be revealed on 3rd April 2020 at the workshop. All participants who have submitted their work will be provided an opportunity to present their work at the challenge workshop which is to be held at Iowa-city, USA (in conjunction with IEEE ISBI2020).

http://2020.biomedicalimaging.org/challenges

Please do not forget to apply for a travel grant which is sponsored by NIHR BRC Oxford. 

With best wishes,

EndoCV organisers

[rub2...@gmail.com]

Hi,

I am unable to submit as it says 'submissions are closed'. Please find the attached file.

Regards

Shahadate

[Görkem Polat]

Hi,

Will there be any detail related to the mAP, mIoU and how the score is calculated in the leaderboard?

Regards.

[sali]

Hi,

No there will be no detailed metrics. This is hidden and will be revealed at the workshop. 

BW,

S

[Görkem Polat]

Hi,

It seems that last year there was a validity check on the results. We are worried that our results on the leaderboard might be invalid for the final evaluation. I was wondering if there is any chance that we could know that the results are valid?

[Prithvi Prakash]

Are all metrics on the leaderboard positive metrics? ie- Higher the better?

[Duy Huỳnh Lê]

I don't think so. There are standard deviation scores. They are likely to be used as tie-breakers.