Size of test set

65 views
Skip to first unread message

jaco...@mit.edu

unread,
Nov 29, 2019, 3:08:16 PM11/29/19
to HEROHE Grand-Challenge
Can we get a rough approximation of the size of the test set? i.e. how many Gb? It would be helpful for planning the download of the test data in January.

Thanks!

Eduardo Conde-Sousa

unread,
Dec 2, 2019, 9:43:15 AM12/2/19
to jaco...@mit.edu, HEROHE Grand-Challenge
Hi

We are finalizing the test dataset. It should have ~200 cases, so it should have a little more than half the size of the training dataset. 

all the best
Eduardo

Eduardo Conde-Sousa
INEB – Instituto Nacional de Engenharia Biomédica
i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal


<jaco...@mit.edu> escreveu no dia sexta, 29/11/2019 à(s) 20:08:
Can we get a rough approximation of the size of the test set? i.e. how many Gb? It would be helpful for planning the download of the test data in January.

Thanks!

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-chal...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/herohe-grand-challenge/c7ae58f4-6dfe-450d-b0b3-06719496a4d2%40googlegroups.com.

Vincenzo Della Mea

unread,
Dec 5, 2019, 7:39:21 AM12/5/19
to HEROHE Grand-Challenge
Hi,
regarding the tests: we have to provide "the code (or compiled version*)". Do you plan to use it for independent verification, or just to check the methods? Because in the first case, ensuring that everything runs on any platform is a requirement that could take some extra effort. 


On Monday, December 2, 2019 at 3:43:15 PM UTC+1, Eduardo Conde-Sousa wrote:
Hi

We are finalizing the test dataset. It should have ~200 cases, so it should have a little more than half the size of the training dataset. 

all the best
Eduardo

Eduardo Conde-Sousa
INEB – Instituto Nacional de Engenharia Biomédica
i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal


<jaco...@mit.edu> escreveu no dia sexta, 29/11/2019 à(s) 20:08:
Can we get a rough approximation of the size of the test set? i.e. how many Gb? It would be helpful for planning the download of the test data in January.

Thanks!

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-challenge+unsub...@googlegroups.com.

Eduardo Conde-Sousa

unread,
Dec 5, 2019, 9:04:30 AM12/5/19
to Vincenzo Della Mea, HEROHE Grand-Challenge
Dear Vincenzo
The idea is to validate all the methods. Of course depending on the number of submitted methods this may be impossible in the time frame available, but at least those that get the higher ranks in the challenge will be tested as well as some of the others randomly chosen.

Regarding the extra effort, I can reduce it a little bit. It is my intention to validate the methods in one of the following 2 options:
  • CentOS Linux release 7.6.1810 (without root privilegies)  - preferred method
  • Windows 10 - only if it turns out to be impossible with the linux alternative
So if you can give me access to a code (or compiled version of it) that runs in one of these alternatives it is enough.
Nevertheless, be sure that in the submitted files there is a README file explaining how to run the code and get the results

All the best
Eduardo

Eduardo Conde-Sousa
INEB – Instituto Nacional de Engenharia Biomédica
i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal

Vincenzo Della Mea <vincenzo...@gmail.com> escreveu no dia quinta, 5/12/2019 à(s) 12:39:
Hi,
regarding the tests: we have to provide "the code (or compiled version*)". Do you plan to use it for independent verification, or just to check the methods? Because in the first case, ensuring that everything runs on any platform is a requirement that could take some extra effort. 

On Monday, December 2, 2019 at 3:43:15 PM UTC+1, Eduardo Conde-Sousa wrote:
Hi

We are finalizing the test dataset. It should have ~200 cases, so it should have a little more than half the size of the training dataset. 

all the best
Eduardo

Eduardo Conde-Sousa
INEB – Instituto Nacional de Engenharia Biomédica
i3S – Instituto de Investigação e Inovação em Saúde, Universidade do Porto
Rua Alfredo Allen, 208 | 4200-135 Porto, Portugal


<jaco...@mit.edu> escreveu no dia sexta, 29/11/2019 à(s) 20:08:
Can we get a rough approximation of the size of the test set? i.e. how many Gb? It would be helpful for planning the download of the test data in January.

Thanks!

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-chal...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "HEROHE Grand-Challenge" group.
To unsubscribe from this group and stop receiving emails from it, send an email to herohe-grand-chal...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/herohe-grand-challenge/5fe5338f-67f5-4a06-a5ca-0082212207f0%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages