Query about Track II Evaluation

84 views
Skip to first unread message

Chaos

unread,
Oct 3, 2024, 4:00:51 AM10/3/24
to clas2024-updates
Dear Organizers,

I hope this email finds you well. 

I recently submitted an entry for track II. It's been nearly two days since submission, and I haven't received any online evaluation results or feedback yet.

I wanted to inquire if this is the normal evaluation timeframe for track II submissions.

Thank you for your time and assistance.

Best regards,
Team Chaos

Zhen Xiang

unread,
Oct 3, 2024, 10:14:57 AM10/3/24
to clas2024-updates
Dear Participants,

It is possible that our server was offline. Please submit to track II again.

Best,
Organizers

Zhen Xiang

unread,
Oct 3, 2024, 10:24:46 AM10/3/24
to clas2024-updates
Dear Participants,

Your submission was actually executed at our end but with the following error message: "Expected each prediction to contain at least 1 and at most 10 tokens, but got 12."

Best,
Organizers

On Thursday, October 3, 2024 at 4:00:51 AM UTC-4 Chaos wrote:

Chaos

unread,
Oct 3, 2024, 10:57:16 AM10/3/24
to clas2024-updates
Dear Organizers,

Thank you for your prompt response.

I noticed that for both Track II and Track III, the website states "Each predicted trigger must be no more than 30 tokens long." This seems to conflict with the error message I received. Perhaps you might want to review and align the website rules with the evaluation code, or vice versa.

Thank you for your attention to this matter.

Best regards,
Team Chaos

Zhen Xiang

unread,
Oct 3, 2024, 10:00:35 PM10/3/24
to clas2024-updates
Dear Participants,

Apologies for the mistake... We have changed the website accordingly, thank you for bringing up this issue! We will also reset the submission chances for track II.

Best,
Participants
Reply all
Reply to author
Forward
0 new messages