Are 0.21+ teams using test data?
277 views
Skip to first unread message
jiwei liu
Jun 12, 2022, 9:14:44 PM6/12/22
to RecSys-Challenge-2022
Hello, this is by no means an accusation. I'm just curious if teams with 0.21+ scores on the leaderboard are using test data in training, validation, post-processing, test time augmentation, etc. Based on my local evaluation, using future information can get at least a 0.006 boost in the score. However, all these usages of test data are not allowed for the final submission according to the rule.
iggy ll
Jun 13, 2022, 12:54:04 AM6/13/22
to RecSys-Challenge-2022
I have a similar concern, but not about specific score threshold.
Our team observed higher MRR using session data information from validation data with inner CV than using no session data.
And one can guess somehow to integrate session data information into prediction process in a way very hard to detect it.
Our team observed higher MRR using session data information from validation data with inner CV than using no session data.
And one can guess somehow to integrate session data information into prediction process in a way very hard to detect it.
2022년 6월 13일 월요일 오전 10시 14분 44초 UTC+9에 aixuee...@gmail.com님이 작성:
Reply all
Reply to author
Forward
Message has been deleted
0 new messages