submission queue too long

129 views
Skip to first unread message

Saibo Geng

unread,
Apr 13, 2021, 6:13:49 AM4/13/21
to SIGMOD 21 Contest
Dear organizers,
        The submission queue has been quite long since recently,  usually 4 tasks in the queue. This leads to a waiting time of more than 1 hour. Would you kindly allocate more CPU resources to parallel the evaluation task? As it's said on the website, the server has 32 CPU but it seems the evaluation is only executed sequentially and is even slower than repeating the same work on our local machine. This would allow all teams to be more efficient on the task itself. 

Please also check if there is any team deliberately congesting the evaluation queue by repeating submission. We sincerely hope this is not happening.

Kindly regards,
CyberPunk2021

ACM SIGMOD Programming Contest 2021

unread,
Apr 14, 2021, 9:11:31 AM4/14/21
to SIGMOD 21 Contest
Hello!
This is not a CPU problem; the fact is that submissions evaluation in the automated system is sequential, and the resources are allocated for a submission for the whole defined timeout; this explains the slowdown of the queue.
In fact, this situation requires the capacity of each team to focus on making its submissions more significant.

Regarding the participating teams, in this phase it is very important that each team uses a single profile to perform submissions; thus, we renew the call to register the team composition using the form in the Leaderboard page (of course, for the ones not registered yet), in order to let us certify the teams.

Best regards,
The organizers

李易非

unread,
Apr 22, 2021, 12:43:58 PM4/22/21
to SIGMOD 21 Contest
Hi!

Apparently, some teams in the leader board are actually the "proxy" teams. And there is some evidence that several teams are actually the same one. This is really unfair for those who strictly comply with your rules. I think it will be better you could check the submitted code and punish these teams for their misbehavior. Actually in similar contests like kaggle, they will even cancel the scores for these misbehaviors.

Best,
Yifei Li

Sainyam Galhotra

unread,
Apr 22, 2021, 2:17:59 PM4/22/21
to SIGMOD 21 Contest
+1
Evaluation is taking far too long because of more than 15 submissions always in the queue. I am not able to realistically get an output in my time zone and the only option is to create more teams to add multiple submissions, which is exacerbating the problem.
 Would it be possible to add more compute/parallelize and not evaluate teams that have not submitted the form?

Thanks

giovanni.simonini

unread,
Apr 22, 2021, 2:54:34 PM4/22/21
to SIGMOD 21 Contest
Dear participants,
we are taking actions against unknown (possibly fake) teams. From now on, all teams that do not provide complete and verifiable information through the form will be removed the evaluation queue by default. 
Furthermore, if we will have evidence of non-fair behaviors, we will of course punish the team doing that---in the rules, it is clear that "one person can be a member of only one team".
Reply all
Reply to author
Forward
0 new messages