Thanks for reporting the half-score case, that is useful to know.
For the fastest result please try re-uploading if you have submission counts left. Tomorrow we will focus on having something that automatically retries a submission multiple times on error, and it sounds like we need to have some further verification that the files are being transferred correctly. When that is in place you will be able to re-upload and not lose a submission slot due to errors our side. I am not sure we will get to re-run individual files tomorrow but will let you know.
You received this message because you are subscribed to a topic in the Google Groups "RecSys-Challenge-2022" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/recsys-challenge-2022/O_QyAUcdBWw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to recsys-challenge...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/recsys-challenge-2022/1be0e259-b4c3-449a-a450-787c34ee6fa4n%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
This has all gone through. All existing files have been re-evaluated properly and the system should not fail any more.
There are no changes at the top of the leaderboard but some of your evaluations might have changed in score if they were affected by the intermittent issue. I have checked a couple of the reported cases where the same file failed and then succeeded or the same file gave different results, they now all have a result and it's the same number.
Sorry for the inconvenience and have a good weekend!
You received this message because you are subscribed to the Google Groups "RecSys-Challenge-2022" group.
To unsubscribe from this group and stop receiving emails from it, send an email to recsys-challenge...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/recsys-challenge-2022/cf05f147-968e-4909-9097-fb1c67ebb91an%40googlegroups.com.