gem-benchmark

Thanks for your reply Sebastian. Yes, I can get the scores on the validation set and I will add these

Hi, would you be able to provide a rough format of what is expected in a system description? I was

Hi Anna, Our plan is to have a yearly selection process for GEM (similar to our initial one) that

Hello Sebastian, Would you please send me those outputs as well? Thank you in advance! Anna On

Hi Nick, Thank you for reaching out about this. We will start the selection process for the next

Hi, Thank you for the clarification!! On Mon, May 17, 2021, 12:38 AM Sebastian Gehrmann <gehrmann@

Hi Sebastian, Thanks for the clarification. On Friday, 14 May 2021 at 01:17:48 UTC+5:30 gehrmann

Hi Yimai, Sorry for the delayed response. We updated the loader to match the new checksum. Everything

Hi Sebastian Thanks for the clarification and updates! Attached is the script. It takes a path to the

Hi there, Regarding our baselines, most published ones use the hyperparameters (and code) posted in

Hi Simon Thanks for confirming! I suggest adding a clarification to the Submitting Outputs section of

Hi Bin, as far as I know you can submit for whichever dataset you want; note however that, in your

Final call for papers and shared task submissions for the Workshop on Generation, Evaluation, and

Awesome 😎 will check it out! Many thanks Mike On Thu, Apr 8, 2021 at 6:19 AM 'gehrmann' via

Second call for papers and shared task submissions for Workshop on Generation, Evaluation, and

Hi, Can you please confirm if the results for DART in Table 2 in the GEM paper are correctly reported

Dear Michael, I'm sorry for the delayed answer. I've looked more closely at the E2E scores

Hi Leshem, As Emiel mentioned, all system outputs will be made available. We even have a specific

Hello everyone, I am wondering the paper <<Text-to-Text Pre-Training for Data-to-Text Tasks>