Create google doc with answers to most common questions?

108 views
Skip to first unread message

Dasa Zeithamova

unread,
Jul 9, 2020, 1:05:44 PM7/9/20
to Online Experiments
Hello,

The talk on Tuesday was great but some of the questions from the session descriptions felt through the cracks or were addressed in a manner that assumed more prior knowledge than many have. Would it be possible to have them all addressed in one place on the movingresearchonline.info webpage?  
I'm highlighting some of the questions I still have, but providing answers to all of them (e.g. via a link to the particular timepoint in the talk if they were clearly addressed there) would still be helpful.
  • How do I most effectively incentivize subjects to provide high-quality data? - I would still like more practical tips, usable by someone who is just starting online.
  • How do I best ensure subject compliance & attention? - The tips on easy catching laziness were GOLDEN. Advice on the best catch-trials, catch tasks or catch survey question would be handy.
  • How good is timing accuracy, and how does this constrain experiment design? - This was covered well in my opinion. Listing a link to the time in the talk would be probably all I need. But I don't rely on small RT effects, so someone with RT focus my be a better judge.
  • How long should subject participation last? - More tips please on the ranges of acceptable times for different formats (viral quizzes vs. "real" experiment on XYZ platform).
  • If I’m used to observing subject behavior with my own eyes, how can I run online studies?
  • How do I restrict participation? - I still have these two questions about restricting participation, but there were also some great tips (like not restricting age and instead focus on lifespan).
  • Should I restrict participation?
  • How do I address obtaining consent, protecting privacy, etc? - These last two question were addressed well. Perhaps more info for those who HAVE TO collect sensitive information.
  • How do I work with an IRB that is not familiar with online studies?
Thank you again for offering this useful workshop!

Joshua Hartshorne

unread,
Jul 9, 2020, 1:11:20 PM7/9/20
to Online Experiments
Good idea. We are working on it now!

Joshua K Hartshorne
Assistant Professor
Boston College

Jenni Rodd

unread,
Jul 9, 2020, 1:17:50 PM7/9/20
to Online Experiments
Hi
Some of these questions are very hard to answer in general terms as it depends on the specifics of your task and what your specific data quality concerns are. Would you like to give some more info about what it is you're most worried about for your specific task?

Dasa Zeithamova

unread,
Jul 9, 2020, 1:56:34 PM7/9/20
to Online Experiments
These are the questions posted in the Session 2 description. I will post specific questions in a separate threat as this question/comment was aimed to encourage the creation of a wiki-style or FAQ section on the website.
Reply all
Reply to author
Forward
0 new messages