Temporary results

[econdesousa]

Dear all

 

Temporary results are available at https://ecdp2020.grand-challenge.org/results/

All the best

Eduardo

[hongyi...@gmail.com]

Hi

Besides the f1 score that using hard prediction,

I think there should be an evaluation metric using soft prediction such as AUC(Area under the ROC Curve).

And it just need two function from sklearn.metrics package

from sklearn.metrics import roc_curve, auc

fpr, tpr, thres = roc_curve(ground_truth, soft_predictions)
roc_auc = auc(fpr, tpr)

Yiyu Hong.

在 2020年1月30日星期四 UTC+9上午12:49:18，econdesousa写道：

[Eduardo Conde-Sousa]

Hi

I put just this one because it was the one that matters according to the rules.

Regarding the soft predictions, they were asked precisely to allow more comparisons in the resulting paper.

If you want, I can update the results with more metrics (I'll do it with auc now, but I'm open to more if you want) so that you can refer to those values in your abstract. Nevertheless, remember that only f1 will be considered for the final classification of the challenge regardless of the rankings in any other metric (regardless of the value of the arguments that may be presented in favor of any other).

So if anyone wants to add more metrics, please just update the python code accordingly and send it to me and I'll update the results file.

All the best

Eduardo

******************************************************************************************

Eduardo Conde-Sousa

INEB – Instituto Nacional de Engenharia Biomédica

i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal

Telf: +351 220408815
www.bimage.ineb.up.pt

http://www.ineb.up.pt/

https://www.i3s.up.pt/scientific-platform?v=91
www.i3s.up.pt

******************************************************************************************

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-chal...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/herohe-grand-challenge/3019b930-7969-4f8d-a1d3-2f58f8b148d8%40googlegroups.com.

[econdesousa]

The results were updated to fix 2 errors.

Additionally AUC was also added and a new python code with the recent modifications was also added to the google drive.

kind regards

Eduardo

[kele...@gmail.com]

Dear organizer: 

We have submitted the results before the 28th (GMT+8), but our team name(Macaroon) was not on the received mailing list. Then the results were resubmitted in the system on the morning of the 29th (GMT+8). I did not see my team in the forum just a moment. 

May I ask you if I have any problems with my operation? 

Kele

[Vincenzo Della Mea]

Hi, do you have an approximate idea about when finalised results will be available? 

[Eduardo Conde-Sousa]

Hi Vincenzo

I'm still validating the code. 

As you might expect, this is a difficult and time-consuming task, but I'll do my best to end all the process before the early registration deadline (Feb , 17th).

All the best,

Eduardo

******************************************************************************************

Eduardo Conde-Sousa

INEB – Instituto Nacional de Engenharia Biomédica

i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal

Telf: +351 220408815
www.bimage.ineb.up.pt

http://www.ineb.up.pt/

https://www.i3s.up.pt/scientific-platform?v=91
www.i3s.up.pt

******************************************************************************************

Vincenzo Della Mea <vincenzo...@gmail.com> escreveu no dia segunda, 3/02/2020 à(s) 10:56:

Hi, do you have an approximate idea about when finalised results will be available? 

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-chal...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/herohe-grand-challenge/563282b6-0e26-492e-8efe-e9f79662df9d%40googlegroups.com.