We are running a working workshop to develop concrete guidelines for improving statistical practice in HCI. Participants will work in groups to flesh out guidelines for helping reviewers fairly assess statistical reports in CHI papers, concrete suggestions for changes to review processes, resources for authors, and other relevant guidelines or proposals the group wishes to advance. We will seed writing with draft guidelines developed in the wake of last years’ SIG on Transparent Statistics in HCI. However, we will not be constrained to the outline in these draft documents if discussions take us elsewhere.
These documents will be shared publicly once finalized and we will engage the CHI Executive Committee and/or Program Chairs to discuss the feasibility of suggested changes to the review process, and the possibility of incorporating some of the recommendations into official documents like the SIGCHI reviewer guidelines. We will also continue hosting and drafting future revisions of the documents on a collaborative editing platform.
We are looking for a diverse set of perspectives on quantitative methods in the HCI community to develop these documents (while qualitative methods are important to HCI, our primary focus in this workshop is on improving the use and communication of quantitative work). If you are interested in improving the state of statistical practice in HCI—whether or not you attended last year’s SIG—submit a position statement (at most 2 pages in CHI Extended Abstracts format) containing:
Submit to email@example.com. The final deadline for submission is Jan 14, 2017. If your ability to attend requires that you take advantage of a 2016 budget, you may submit by Dec 14, 2016. Unless a hard budget constraint is indicated, early submissions will be reviewed along with Jan 2017 submissions, so we can balance the diversity of participants’ backgrounds.
As much as we would like as many CHI researchers as possible to get involved in this initiative, we may not be able to accept all applicants due to limits in the number of attendees at CHI workshops. If this happens, we will select applications based on expertise, diversity of perspectives in quantitative methods, diversity of HCIdomains, and diversity of interest in specific artifacts (to ensure we have people interested in working on each artifact). Our goal is that the participants reflect the diversity in quantitative methods, statistics, and domains across HCI.
The purpose of the position statement is to help us determine specific participants, so we encourage one author per position statement. Position statements with multiple authors should clearly indicate which author will attend. If your position statement is accepted, the attending author must register for both the workshop and at least one day of the conference.