Regarding evaluation guidelines

[Lu Ting]

Hello, 

I have a question regarding how the generated humorous content will be evaluated. To my understanding, they will be rated by human judges. Would it be possible for us to learn the demographic of those judges, for example, their age range, gender, profession, etc.? Also, are there any rating or annotation guidelines provided to the judges? If so, is it possible for us to know roughly about those guidelines?

Thank you very much!

[semeval-2026-task-1-humor-gen]

Sorry for the late reply. We don't know a priori the demographic of the judges, as anyone on the Internet will be allowed to annotate. There are no firm guidelines as we allow people to define what's funny for them, but here's the page in case it's useful: https://thefunnier.com/. There's a link at the bottom with more info for the annotators.