Future planning for the GEM benchmark

20 views
Skip to first unread message

Sebastian Gehrmann

unread,
Aug 12, 2021, 2:03:09 PM8/12/21
to gem-benchmark
Hi all, 

While some projects are still ongoing, our year of work on the initial version of the GEM benchmark officially finished last week with our workshop. Thank you to all for your hard work :) 

This also means that we are now in the planning stages for GEMv2. We want to continue expanding our coverage with the GEM benchmark and run another shared task and workshop. In addition, we want to improve our documentation and ensure that anyone, regardless of their experience, will be able to participate in better NLG research. 

For this, we will need your continued involvement! If you want to sign up to be part of the team (again), please go to https://gem-benchmark.com/team/join and fill out the quick 3-question survey. I will then follow up in ~2 weeks with more details. 

Please also feel free to share this link with others who may be interested - similar to GEMv1, we want to assemble a team with a variety of backgrounds to ensure that everyone in the research community will be heard. Signing up does not commit anyone to any particular task. 

Best
Sebastian

Sebastian Gehrmann

unread,
Sep 2, 2021, 9:45:09 AM9/2/21
to gem-benchmark
Hi all, 

Over 50 of you already signed up for the next round of GEM and I wanted to kick off the next round within the next 1-2 weeks. 
That means, if you haven't filled out the quick form (https://gem-benchmark.com/team/join ) yet, but want to participate in our events, please do so before the end of next week (Sept 10). 

You are also welcome to share the link around to other communities or researchers. 

Best
Sebastian
Reply all
Reply to author
Forward
0 new messages