Reproducibility Project: Conference Presentations

[Brian Nosek]

The Reproducibility Project is in its adolescence.  There are more than 60 replication projects underway or completed.  In the next week or two we expect that there will be a formal announcement of a grant application process for teams to receive funding for doing replications.  Included in that will be nominal awards for teams that have completed replications already.

We have made sufficient progress that we can start considering opportunities to share the project design, goals, preliminary results, and implications in presentations to academic communities.  There are two options to consider immediately, and others that are worth considering in the near future:

(1) Society for Personality and Social Psychology (SPSP): February 13-15, 2014 in Austin, Texas.  Competitive proposals for symposia.  

(2) European Conference of Personality (ECP): July 15-19, 2014 in Lausanne (Switzerland) 15-19 July 2014.  I am giving an address and, with that, I get to organize a symposium on a topic I select.  

I think we should try to do both of these (and perhaps psychonomics or another cognitive meeting).  We would propose a symposium with 3 or 4 talks roughly divided up as: (1 or 2) Project motivation, goals and design, (3) Project results, and (4) Implications.  Depending on the context, another presentation possibility would be a meta-commentary on crowdsourcing science.

Next steps:

(1) If you have any comments about this proposal/possibility, please share - privately or publicly

(2) If you are an effective presenter and would be interested in doing it, please email me noting which conference and if you are inclined toward one of the topics.  

[Note: I can chair the sessions, but I am inclined NOT to be a presenter in order to improve public understanding that this project has a broad contributor base.]

[heathe...@uni-erfurt.de]

I was already planning on giving a talk on the OSF at the European Congress of Psychology in Stockholm on July 9-12th. That was an invite from the Leibniz Instutite for Psychology Information, which is organizing a symposium. I will also be writing a brief paper (<10 pages) to go with it. I haven't started working on the talk, so I don't know yet what exactly I will focus on. If you guys have any opinions for a good focus, I am certainly open to suggestions!

[Ravi Iyer]

This is surely a bias of my perspective/job, where I'm involved in a lot of crowdsourcing, but when I talk about open science, I connect it to the "wisdom of crowds" and the idea that "error" encompasses a lot more than statistical error and is never randomly distributed.  That's why the margin of error in presidential polls isn't right, nor are the p values in hypothesis tests, such that they require replication.  Error can be attributed to a whole host of things that replication can help overcome (e.g. different samples, different time periods, different researchers, different locations, etc...), not just willful bias on the part of researchers.  In the future, hopefully we'll see more conceptual rather than direct replications too, which enable diversity of methods as well.  The wisdom of crowds principle is behind a lot of the progress we see today, from Nate Silver's success in the last election, to Google's success in predicting website relevance, to Wikipedia's relative efficiency/quality.  It's a natural consequence of our connected world to move from work by single individuals to work by defined groups to work by loose cooperatives working in a system (see Clay Shirky's Ted Talk) toward collective progress.  

My (admittedly biased) .02 and feel free to use or not use this framing.  If ever you wanted to give a talk on Open Science to more of a tech audience, I'd be happy to do it from this perspective if helpful.

- Ravi 

On Tue, May 14, 2013 at 12:56 PM, heathe...@uni-erfurt.de <heathe...@uni-erfurt.de> wrote:

I was already planning on giving a talk on the OSF at the European Congress of Psychology in Stockholm on July 9-12th. That was an invite from the Leibniz Instutite for Psychology Information, which is organizing a symposium. I will also be writing a brief paper (<10 pages) to go with it. I haven't started working on the talk, so I don't know yet what exactly I will focus on. If you guys have any opinions for a good focus, I am certainly open to suggestions!

--
You received this message because you are subscribed to the Google Groups "Open Science Framework" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openscienceframe...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[B.H. Now]

"In the next week or two we expect that there will be a formal announcement of a grant application process for teams to receive funding for doing replications. Included in that will be nominal awards for teams that have completed replications already."

 

 

I am curious (and perhaps impatient as well :P), any news about this yet ?

 

Regards.

[Susann Fiedler]

The Conference for Experimental Psychologists is coming up and I think it would be great opportunity to present the results of the Reproducibility Project there. The conference is hosted in Hildesheim (Germany). Its an english speaking conference with around 900 participants. The deadline for a symposia submissions is in 3 days (october 10th) and feedback will be given until the beginning of november. If someone plans to attend the conference and wants to present parts of the project, please contact me within the next days, so we can coordinate.

Most of the materials are already prepaired since we presented the project already a few times at other conferences. You can find the Abstract for previous submissions here: https://docs.google.com/document/d/1UEjNFHBkAaAzeXQLc8-IEB69LoqduvRXkNgpABMQkgU/edit

Would be great to meet some of you there!

Best, Susa