Question about decoder and log

44 views
Skip to first unread message

Danny Liu

unread,
Nov 8, 2023, 2:02:11 PM11/8/23
to Workshop and Challenge on Learned Image Compression (CLIC)
Dear Organizers,

We would like to bring to your attention a issue we are currently facing due to a change in GPU type. This year's GPU is much slower than two years ago, and we have seen other teams have similar problems. Due to the change in GPU type, it is difficult for us to submit a complete decoding during the validation phase.  Sincerely, we would like to ask you a few questions about the challenge:

1. If the decoder hash value in the test phase matches the one in the validation phase, can we use any decoder submitted during the validation phase for our test phase submissions or only the last decoder?
2. During the validation phase, our submitted decoder may not complete the decoding process due to timeout issues. Will this impact our eligibility to participate in the testing phase? We will optimize our encoder in the test phase to speed up our decodeing time.

Additionally, we encountered an unexpected situation with a test submission today, marked with Submission ID 465. The log for this submission suddenly disappeared, displaying the message "Logs are no longer available." However, the status still indicates that it is in the process of decoding, and we were able to view it just half an hour ago. Could you please provide some help?

We appreciate your prompt assistance in addressing these concerns. Thank you for your attention to this matter.

Best,
Danny

Lucas Theis

unread,
Nov 9, 2023, 11:00:00 AM11/9/23
to Workshop and Challenge on Learned Image Compression (CLIC)
Hi Danny,

> 1. If the decoder hash value in the test phase matches the one in the validation phase, can we use any decoder submitted during the validation phase for our test phase submissions or only the last decoder?

At test time you can use any decoder submitted during the validation phase, not just the last one.

> 2. During the validation phase, our submitted decoder may not complete the decoding process due to timeout issues. Will this impact our eligibility to participate in the testing phase?

Failed decoders can be used during the test phase as well.

> Additionally, we encountered an unexpected situation with a test submission today, marked with Submission ID 465. The log for this submission suddenly disappeared, displaying the message "Logs are no longer available." 

It looks like submission 465 was canceled. This happens when you submit another decoder for the same task and phase while the previous decoder is still being evaluated.

Lucas
Reply all
Reply to author
Forward
0 new messages