Griping

[Ian Soboroff]

I've heard several review gripes now that notifications are out. It
would be nice to tell people something besides "you should complaint
to the chairs" and "we're working on review criteria" when people say
they got a two-line review and a slack metareview.

Proposal: all papers that have a first-tier review more than 2
deviations shorter from the mean length are automatically flagged for
discussion.

Ian

[Ian Soboroff]

Let me clarify, I don't want this list to get bogged down complaining
about reviewers. But we really should take the opportunity to
continue the discussion started on the SPC list.

> --
> You received this message because you are subscribed to the Google Groups "SIGIR Meta" group.
> To post to this group, send email to sigir...@googlegroups.com.
> To unsubscribe from this group, send email to sigir-meta+...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/sigir-meta?hl=en.
>
>

[Charles Clarke]

Flagging short and/or inappropriate meta-reviews is a job for individual SPC members.  It can't be handled automatically.  For a rejected paper, the first-tier reviews and the meta-review should together communicate to the authors why the paper was rejected.  We can tolerate a shorter first-tier review if the others contain the necessary information and the shorter review is consistent with the final result.  On the other hand, we could easily get four longer reviews that fail to communicate the same information (I have an example in my mailbox :-).

--Charlie

On Thu, Mar 25, 2010 at 9:10 AM, Ian Soboroff <isob...@gmail.com> wrote: