VOTS2026 benchmark submissions still not working — follow-up (co-author)

[Alexandru Galea]

Dear all,

I'm following up on a thread from July about submitting to the VOTS2026 benchmark. In that thread it was suggested that submissions should be working; unfortunately, as of today (2 August) they still are not. I also sent a private follow-up afterwards but haven't received a reply, so I'm bringing it back to the group where it may reach whoever currently administers the evaluation server.

Concretely, when I try to submit, there is no upload button available. I've retried on each week until now, with the same result.

The VOTS2026 results paper (Sec. 1.1) states that the VOTS2026 Benchmark opened after the challenge "to facilitate continual tracker development," so I assume post-challenge scoring on the sequestered set is intended to be available. As a note, the benchmark link in the paper (footnote 42) currently points to the VOTS2025 leaderboard, which may be related to the confusion about where submissions should go.

My interest is legitimate and specific: I'm a co-author of the results paper, and I'm preparing a paper analyzing my VOTS2026 entries (the dam4sam_v3g family). I would like to score a set of component-ablation variants on the sequestered VOTS2026 set for a per-component error breakdown.

Could someone please confirm:

1. whether VOTS2026 benchmark submissions are currently open, and
2. if so, the correct submission endpoint and procedure; or, if not, when the benchmark is expected to reopen?

Happy to provide packed results, tracker descriptions, or any logs that would help diagnose it. Thank you for your time.

Best regards,
Alexandru Galea

[Pavel Tokmakov]

Hi Alexandru,

sorry for the confusion. It sounds like you are trying to submit to the challenge (which is closed), not the benchmark. The information for the benchmarks is as follows: 

VOTS Benchmark:

• Registration form: https://forms.gle/YjQUsJnBN9DNod386

• Eval site: https://eu.aihub.ml/competitions/201

VOTSt Benchmark:

• Registration form: https://forms.gle/gkYLr21HSdwH9jff7

• Eval site: https://eu.aihub.ml/competitions/254

VOTSp Benchmark

• Registration form: https://forms.gle/NDE5HpgJbmfT5knKA

• Eval site: https://eu.aihub.ml/competitions/274

VOTSr Benchmark

• Registration form: https://forms.gle/vTyCAytfLiP2QdgD7

• Eval site: https://eu.aihub.ml/competitions/277

VOTS2026 Benchmark:

• Registration form: https://forms.gle/oBJP5rsMXUNRSyTL9

• Eval site: https://eu.aihub.ml/competitions/278

[alan.l...@gmail.com]

Dear Alexandru, 

thanks for bringing this up and sorry for the slow response time. This is just a follow-up to the Pavel's answer:
We updated the links on the votchallenge website - here are the rules and instructions with the benchmark links:
https://www.votchallenge.net/vots2026/participation.html 

and here is a compact list with all relevant links: 
https://www.votchallenge.net/vots2026/leaderboards.html 

If you encounter any issues with the submission system, please let us know. 

Best,
Alan

ponedeljek, 3. avgust 2026 ob 17:32:01 UTC+2 je oseba pavel.t...@tri.global napisala: