Questions about running time of the Cross-Domain MetaDL competition

[jiamin wu]

Dear organizers,

I'm a participant of Cross-Domain MetaDL Challenge. I have some questions about the running time. Our team's code can satisfy the time limit of 5 hours in the feedback stage, but will exceed the time limit of 9 hours if the final stage runs 6000 tasks. As our code has some special designs in the meta-test, the test time occupies a considerable proportion in the total running time. We have observed that other participants also have the same problem. Based on the results in the feedback stage, we estimate our running time is about 20 hours for the 6000 test tasks. However, we have also experimented with our code on our own gpu device (one nvidia 3090ti gpu), and it only takes less than half the time on your provided gpu devices，which is very likely to meet the time requirement. I want to know what will happen if our running time exceeds 9 hours in the final stage? Given the difference of the gpu devices and method types, I suggest removing the time limit, or largely increase the running time limit in the final stage, since the code has already successfully met the requirement of feedback stage. I think this will help embrace more diverse methods and promote the development of the cross-domain few-shot learning community.

Yours sincerely.

[madclam]

Dear all,

We have no plan to change the rules at this stage. We are going to run the final phase as planned. Time and resources permitting, we will run additional tests, but the prizes will be attributed on the basis of the original rules.

Best regards,

Isabelle