Submission limit - time limit

79 views
Skip to first unread message

marios mintzis

unread,
Apr 6, 2024, 1:59:49 AM4/6/24
to SIGMOD 24 Contest
Hello participants and organizers. 

I have been asking the organizers for increasing at least for some time the limit we have for the number of submissions per day. Testing on our machine on the 1m data is hard i believe and its not only that. Its not about fine tuning several values of our implementations. Its about

1) Keeping us competing - leaderboard changing often - etc - being alive - its a live competition.
2) The evaluation machine is the actual judge at the end. Being able to submit more times per day on the machine will help us understand how robust our solution is and several other things. Its not just about wining and therefore cheating in any way - meaning understanding the secret evaluation data because of many submissions. Those can easily be disqualified if you check their logs
3)sometimes we implement something new or optimize something. In order for us to get the logs or to understand that it works we submit for example with the same parameters as a previous succesfull submission just so it passes and we can compare recall and runtime to evaluate our submission because if it fails we will have no logs...no recall no runtime execution time...maybe it took 1250 seconds..and thats why it failed or maybe it took 1800 seconds..

If other participants dont think the above points are reasonable i am ok with it. But if you agree with me please comment here or respond so the organizers can pay attention..

For the organizers. 
Again thank you so much for such a wonderfull task and how organized you are. If you also understand the points above and find them reasonable kindly discuss this internally and let us know .

Good luck all ! 
Best,

Reply all
Reply to author
Forward
0 new messages