Decoder change clarification

[Tom]

Dear organizers,

Thank you for your great efforts on organizing the challenge. I have a generation confusion to be clarified.

It seems that while the submitted decoder is expected to be frozen after close of the validation phase, certain modification to the decoder is still possible during the test phase.

Could you help clarify the scope of the allowed modification to the decoder in the test phase, in order to give a fair understanding to potential participants who are planning to update the decoder?

Best regards,

Tom

[Johannes Ballé]

Hi Tom,

thank you for addressing this concern. In general, the decoders are frozen during validation to prevent overfitting to the test set. In this spirit, there are no circumstances under which we would allow changes that concern the submitted method itself, such as retrained parameters, etc.

However, since there can be small inconsistencies in the format from validation to test set (sometimes unintended from our side), or other unexpected problems that we didn't anticipate, we have generally helped participants with simple issues concerning, for example, input/output.

We discuss changes internally, on a case-by-case basis, to ensure the challenge remains fair.

I hope this answers your question!

Best,

Johannes.

--
You received this message because you are subscribed to the Google Groups "Workshop and Challenge on Learned Image Compression (CLIC)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clic-list+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clic-list/9bd3deed-7551-41f6-840f-014088c936cfn%40googlegroups.com.

[Yue Li]

Hi Johannes,

Thanks for your kind reply. Now it is more clear to me.

Best regards,

Yue

To view this discussion on the web visit https://groups.google.com/d/msgid/clic-list/CAN4xYSB9YRYW%3D2EYMxvcZL3xCGoTbK%2BJvKs9h-U-G25qRyf%3DBg%40mail.gmail.com.

[Tom]

I see. Appreciate your clarification, Johannes. The key is to ensure algorithm frozen, while may allowing fixing simple issues related to input/output format.

Tom.