Academic work on scientific peer review

[Ed Gehringer]

Hi group,

 

As many of you know, several algorithms have been developed for automatically calculating a reputation score for peer reviewers within a class (e.g., Cho & Schunn, Hamer, Lauw et al.).  Is anyone aware of similar work that has been done to calculate a reputation score for reviewers of scientific work (papers, grant proposals, etc.)?

 

Thanks,

Ed

[Schunn, Christian Dieter]

some journal and conference systems keep track of review timeliness. the one that the cogsci conference uses (https://precisionconference.com) always for some user rating of reviewer quality, which then is shown in the reviewer selection process.

-Chris

--
-- Computer-Supported Peer Review in Education
-- website: http://cspred.org
-- discussion: http://groups.google.com/group/cspred
-- email the group: csp...@googlegroups.com
-- unsubscribe: cspred+un...@googlegroups.com
--

[Ilya Goldin]

I just came across a whole special issue on peer review at in
professional settings (scientific work, grant proposals, etc):

http://www.ingentaconnect.com/content/cog/ti/2010/00000012/00000003

Unfortunately, Pitt is not a subscriber to the journal, so I can't see
any of the articles. If you can get your hands on the papers, please
let me know.

Best,
ig

[Ed Gehringer]

Thanks, Ilya.  Lakshmi and I just took a look.  Our library doesn't subscribe either.  $17 a crack, for articles that haven't even been cited by anyone.  Ouch!

 

-Ed

>>> Ilya Goldin <ilyag...@gmail.com> 1/10/2011 1:46 PM >>>