> Hi Roger,

> I haven't been active in this group, but I am doing exactly this right
> now. An RA is collecting all the relevant statistics now and we plan to
> write a report by the end of the summer. I'm also meeting Greg soon to
> discuss the implementation.
> I think it would be a worthwhile effort not only in order to provide an
> overview of observed power (post hoc) in the sample, but also to provide
> power-based advice to groups aiming to replicate the studies. I'm happy to
> communicate more on this if there is an interest.

> Cheers,
> Joachim

> On Monday, May 21, 2012 6:03:42 AM UTC-7, Roger Giner-Sorolla wrote:

>> Recently, Gregory Francis has had at least two papers applying the
>> methods of Ioannidis & Trikalinos to articles in psychology: one looking at
>> Bem's 2011 JPSP precognition article

>> Francis, G. (2012). Too good to be true: Publication bias in two
>> prominent studies from experimental psychology. *Psychonomic Bulletin &
>> Review*, *19*, 1–6.

>> and another looking at the closeness of desirable objects effect from
>> Balcetis and Dunning

>> Francis, G. (2012). The same old New Look: Publication bias in a study of
>> wishful seeing. *i-Perception*, *3*(3), 176–178.

>> which elicited a reply and an exchange from the authors (linked from
>> http://i-perception.perceptionweb.com/journal/I/volume/3/article/i0519ic)

>> In theory this could go on forever (a search reveals he has another one
>> in press at JEP:General) and of course the "hit list" approach doesn't
>> leave us with very firm grounds for discipline-wide generalizations about
>> false-positive bias. My personal reaction is, why go after results one at a
>> time if this so obviously reflects an endemic practice in the field?

>> Indeed, it occurred to me that we could do a lot better by looking at our
>> sample of the psychology field from the Reproducibility Project. We would
>> have to do power analyses for all studies in each articles, of course, but
>> we already have the framework in place. Although I have my own archival
>> project I want to start this summer, I'm wondering if anyone could take on
>> organizing this project, or at least give their opinion as to whether it's
>> worth doing?