Participate in the NeurIPS 2021 NetHack Challenge!

41 views
Skip to first unread message

vitali...@gmail.com

unread,
Jun 11, 2021, 12:10:49 PM6/11/21
to Machine Learning News
Hi everyone,

We are organizing the NetHack Challenge at NeurIPS 2021 in collaboration with Facebook AI Research, University College London, University of Oxford, New York University and AIcrowd.

In this challenge you will complete your quest by designing an agent which can play in the procedurally generated, ascii dungeons of Nethack, a terminal-based video game complete with dangerous monsters, magical items, and hopefully enough food to survive!

Why

The Nethack Challenge provides an opportunity for AI Researchers, Machine Learning Enthusiasts and the broader community to compete and collaborate to benchmark their solutions of the NetHack Learning Environment(NLE). NLE contains complex multi-faceted sequential decision making tasks but is exceptionally cheap to simulate -- almost 14x faster than Atari -- and therefore we believe this presents one of the most interesting and accessible grand challenges in RL.

We encourage participants to use reinforcement learning (RL) agent architectures, training methods and other machine learning ideas. However, we do not restrict participants to just machine learning, the agents may be implemented and trained in any manner. The only restriction is on the compute and runtime during evaluation, though these will be set to very generous limits to support a wide range of possible implementations.

How

The starter pack includes the code complete with baselines, to allow participants to quickly get started developing their agents. Included will be the ability to evaluate agents against the testing protocol either locally or remotely, as well as to perform integration tests to determine whether their code will run on the evaluation server.

We have three tracks that your agents can be evaluated for:

* Best overall agent;

* Best agent not using a neural network;

* Best agent from an academic/independent team;

The competition runs from early June through October 15, and the winners will be announced at NeurIPS in December. For more information, check out our website: https://nethackchallenge.com/. Come join us!


Thanks,

NeurIPS 2021 NetHack Challenge organizing team

Reply all
Reply to author
Forward
0 new messages