New Changes to Badging Terminology

19 views
Skip to first unread message

Grigori Fursin

unread,
Oct 6, 2020, 3:50:37 PM10/6/20
to Artifact Evaluation for systems and ML conferences, Gennady Pekhimenko, suv...@google.com
Dear colleagues,

If you are not aware yet, ACM recently updated the terminology used for its artifact review badges. Please see below for more details.

Regards,
Grigori

===============================================
Grigori Fursin, PhD
The founder of the Collective Knowledge Project


-------- Forwarded Message --------
Subject: The Blue Diamond, October 2020
Date: Tue, 6 Oct 2020 14:25:25 -0400 (EDT)
From: ACM Publications <pu...@acm.org>
Reply-To: pu...@acm.org
To: grigori...@CTUNING.ORG


CONTENTS AT A GLANCE:
New Changes to Badging Terminology

ACM recently updated the terminology used for its artifact review badges to ensure that our current definitions of "reproducibility" and "replication" are consistent with definitions used by other research communities outside the field of computing. Following discussions with the National Information Standards Organization (NISO), it was recommended, and the ACM Publications Board agreed, to harmonize its terminology and definitions with those used in the broader scientific research community.

The ACM Publications board released a statement expressing the rationale for the change and updated "Results Reproduced" and "Results Replicated" on the New Changes to Badging Terminology page. ACM Badging Version 1.1 was released on May 15, 2020. Please see the Artifact Review and Badging Version 1.1 webpage for complete description and current badge definitions.

Back to the top

Reply all
Reply to author
Forward
0 new messages