Randomization

[s.got...@gmail.com]

Hi,

I am randomizing blocks of ordered items in a survey and have two issues/questions:

1. When I export my results into excel, all of the items are out of order, even the items prior to the randomization cue, so instead of (for example) 1A, 1B, 1C, 2A, 2B and so forth, the items are in the excel spreadsheet as (for example): 2B, 1C, 1A, 2A, 1B. Is this something to do with a glitch from the randomization? Or do I need to add something further to the google sheet?

2. What can I do so I know what participant has answered in what order? I want to be able to compare order effects between different scale ordering.

Thanks!

Sarah

[Ruben Arslan]

Hi Sarah,

what are you exporting? The results export should have the items in the order they were in your item table. Can you confirm this is not the case (for the currently uploaded item table)?

Under detailed results, you can find the information about the display order of the items. Those are in long format (one row per item and user).

Best,

Ruben

--
You received this message because you are subscribed to the Google Groups "formr" group.
To unsubscribe from this group and stop receiving emails from it, send an email to formr+un...@googlegroups.com.
To post to this group, send email to fo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/formr/704c99cd-8382-4e1e-bfbb-f95479938f2a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ruben Arslan]

Hi Sarah,

you showed me your local item table, not the one that is uploaded in formr. If they're the same it doesn't matter of course. Is your study running already? If you don't have real data yet, I'd like to know whether deleting the survey and reuploading the item table fixes the order.

I don't understand your question about manually going through each participant. 

The detailed results file has all the data for all participants. You can see whether there are effects of item order for all participants at the same time, e.g. using a multilevel model. I can show you some code where I did this:

https://rubenarslan.github.io/initial_elevation_bias

but it's a bit more complex because I also investigated reaction time and randomised whether items would be displayed at all.

Best,

Ruben

On Wed, Aug 1, 2018 at 5:20 PM Sarah Gotowiec <s.got...@utoronto.ca> wrote:

Hi,

I have attached a few screen grabs to show you what I mean - in the item table all the items are grouped together and then in the results (and excel export) they are all misordered.

So is there any way to obtain info about the order without manually going through each participant? I will have 450 people answering so it will be extremely time consuming to do them all one at a time and comb through several scales.

Thanks

Sarah

[Ruben Arslan]

What do you mean by chronologically? Can you share a small item table that shows the problem? And please keep responding to the list, because then Cyril and Matthias

can also see it and potentially fix the bug.

On Wed, Aug 1, 2018 at 5:33 PM Sarah Gotowiec <s.got...@utoronto.ca> wrote:

The problem seems to be that the "item_order" sorts chronologically. So within each of the blocks, the items 1, 2, 3 and so on become 1, 1,1, 2, 2,2, 3, 3, 3 in the item table

On Wed, Aug 1, 2018 at 5:30 PM Sarah Gotowiec <s.got...@utoronto.ca> wrote:

Hi,

Ah yes ok. Well the item table in formr is also all out of order -I deleted and reuploaded it and the problem remains,

Ok I will need to attend to this code once I have the responses then, thank you.

/S

To view this discussion on the web visit https://groups.google.com/d/msgid/formr/CALv3xzts8cF1ttnhMumf5_LZ7KAs1riQ5yH4a5vGxjGPUScnHA%40mail.gmail.com.

[Sarah Gotowiec]

The letters in the coum third from the right correspond to the blocks the items are assigned to, and the numbers in the column second from the right correspond to the items within the blocks. In the google sheet, these are sorted where one block has items 1, 2, 3 and so forth. But in the item table in formr, it lists them in numerical order, as you can see in the column second from the right. 

To view this discussion on the web visit https://groups.google.com/d/msgid/formr/CALv3xzt6YXX4dHN72k4EzsR8YefSBHXE9suN%3DUh5oG5SL54O3g%40mail.gmail.com.

[Ruben Arslan]

Can you send us a link to your Google sheet, so we can reproduce and fix the problem?