Questions Regarding Submission Rules

[gorgeous]

Dear Organizers,

I hope this message finds you well. I would like to clarify a few points regarding the submission process:

1. I noticed that some of my submissions appear on the leaderboard, while others do not. Could you please let me know the requirements for a submission to be displayed on the leaderboard? My main concern is whether the decoders from submissions that do not appear on the leaderboard can still be used during the test phase.
2. I also came across the following rule:“Small variations of the same method by the same or overlapping teams will be disqualified if we identify them during the test phase. Typically, there should be a maximum of one account per organization, and one submission per organization and track. However, during the validation phase, we may allow up to 3 similar submissions for pre-evaluation, if the resources are available.” To ensure I fully understand, I would like to confirm the following:

• • During the validation phase, is the number of submissions unlimited, and can all submitted decoders be used in the test phase?
  • In the test phase, for each bitrate point, are we allowed to submit only once, or can we submit multiple times and have the last submission considered for the final subjective evaluation?
  • Regarding the rule about “small variations of the same method by the same team”, could you clarify how this will be defined? For example, if I submit twice in the test phase with identical decoders but slightly adjust the bitrate allocation for some images, would this be considered a violation?

Thank you very much for your time and clarification.

Best regards,  
Thanos

[Jona Ballé]

Dear Thanos,

Regarding your second question: The rule is intended to prevent people from creating an arbitrary number of teams with many slightly different submissions, which all compete with each other, in the hope that one of them will win. This would defeat the purpose of the challenge.

In general, you can make as many submissions as you want, as long as they don't compete with each other (i.e. they are made with the same team name, and the newer one replaces the older one). During the validation phase, we neglect this rule somewhat (we allow up to three submissions from overlapping team accounts). But during the test phase, only one team is allowed.

The only exception to the above is: if your organization has two completely different methods, where each comes with its own associated whitepaper, and the papers are judged to be dissimilar enough by the reviewers, then you are allowed to make two submissions which do compete with each other.

Hope this clarifies it!

~ Jona

--
You received this message because you are subscribed to the Google Groups "Challenge on Learned Image Compression (CLIC)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clic-list+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/clic-list/08fb35de-db31-4f3d-a520-660a5babdce3n%40googlegroups.com.

[Jona Ballé]

Dear Thanos:

Regarding your first question:

All decoders submitted during the validation phase can be used during the test phase. Which ones appear on the leaderboard is determined by Pareto optimality according to the metrics on the leaderboard, but that only affects the display, not your test phase submissions.

Hope this helps!

~ Jona

On Wed, Aug 27, 2025 at 4:03 AM gorgeous <gorgeous...@gmail.com> wrote:

--