How to add Premium Qualifications?

98 views
Skip to first unread message

Guillermo Bernal

unread,
Apr 28, 2021, 3:51:26 PM4/28/21
to PsiTurk
MTurk allows requester to add premium qualification for workers, in my case I want to ass Tablet Owner per https://requester.mturk.com/pricing,

When I add require_quals = Tablet Owner to my config.txt I get the following error message
Response(Operation: create_hit | Status: error | Exception: An error occurred (ParameterValidationError) when calling the CreateHITType operation: The value "Tablet Owner" is not valid for the parameter QualificationTypeId. (1619639233979 s))

How can I specify this requirement using psiturk?

Thank you!

Guillermo Bernal

unread,
Apr 28, 2021, 5:07:33 PM4/28/21
to Dave Eargle, PsiTurk
Wonderful! thank you, Dave!
 Guillermo Bernal



On Wed, Apr 28, 2021 at 4:47 PM Dave Eargle <da...@daveeargle.com> wrote:
Here, I copied them from the mturk git hit creation page: https://gist.github.com/deargle/b6ff743e3d6b699c9dcfa67736a77911

On Wed, Apr 28, 2021 at 2:23 PM Dave Eargle <da...@daveeargle.com> wrote:
You would need to find that qualification's id, somehow.

--
You received this message because you are subscribed to the Google Groups "PsiTurk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to psiturk+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/psiturk/0d4bfd68-933f-4f0c-9191-69f5421f7463n%40googlegroups.com.

Guillermo Bernal

unread,
Apr 29, 2021, 7:43:11 PM4/29/21
to PsiTurk
Hi Dave,

I'm a bit confused about how to pass the ID from the list that you shared to Psiturk .
The requirement that I would like to use from the list is this one 

<option value="3TKFE7XEDHKIEKXQGFGM4W4E7VDNBS" data-reactid=".0.0.1.0.0.0.2.0.1.$0.0.0.2.$3TKFE7XEDHKIEKXQGFGM4W4E7VDNBS">Tablet Owner</option>

I tried to set in the config file like this require_quals = .0.0.1.0.0.0.2.0.1.$0.0.0.2.$3TKFE7XEDHKIEKXQGFGM4W4E7VDNBS
 I also tried  
require_quals = 3TKFE7XEDHKIEKXQGFGM4W4E7VDNBS
and 
require_quals =Tablet Owner

but all give me the same error.

Response(Operation: create_hit | Status: error | Exception: An error occurred (ParameterValidationError) when calling the CreateHITType operation: The value ".0.0.1.0.0.0.2.0.1.$0.0.0.2.$32DH8RR06QAI82ZGB92EJ0LYJLKYJA" is not valid for the parameter QualificationTypeId. (1619739408792 s))

What am I missing?

Thank you for your help

Evan Kirkiles

unread,
May 1, 2021, 1:02:10 AM5/1/21
to PsiTurk
It's possible that the Premium Qualification Type IDs listed are only for the live mode, not sandbox. Often the Qualification Type IDs are different between the two, at least for custom-created ones. Regardless, this line is the correct format:

require_quals = 3TKFE7XEDHKIEKXQGFGM4W4E7VDNBS

If you're willing to take the risk, try posting a single HIT in live mode with that qualification. If it works, then you know the issue––and if not, there's some deeper problem here potentially related to the qualification type id itself.

Dave Eargle

unread,
May 18, 2021, 12:38:55 PM5/18/21
to Evan Kirkiles, PsiTurk
It is the case that there are separate qualification type ids for sandbox and live. Even for custom-made qualification types, they only exist within either sandbox or live. It's a pain in the butt and I'm not sure how to most gracefully handle it for psiturk development -- a hit will not post if a qualification ID is passed which doesn't exist, and it's annoying to have to switch config.txt `require_quals` or `block_quals` back and forth between sandbox and live depending on where testing. I guess, argh, maybe `.env-sandbox` and `.env-live` which would only be read if in a certain mode? That also is so mturk-tied, and I want to stay open to prolific and other platforms. Or maybe separate sections within the config file -- [HIT Configuration.sandbox] and [HIT Configuration.live], since the [HIT Configuration] section is mturk-tied already. I think I like that last idea best. Then I wouldn't do the `.env-{mode}` thing.



Dave Eargle

unread,
May 18, 2021, 1:30:01 PM5/18/21
to Evan Kirkiles, Guillermo Bernal, PsiTurk
@Guillermo Bernal I just updated the gist (https://gist.github.com/deargle/b6ff743e3d6b699c9dcfa67736a77911) with the ids for both sandbox and live. I just successfully created a sandbox HIT using the sandbox tablet-owner premium qualification id by setting `require_quals = 33AQ5F1Y1V77OGOC6JDDWLXPCUPW16` in my config.txt. Again, that will only work for sandbox mode, not live mode, because the live mode id is different.

Guillermo Bernal

unread,
May 18, 2021, 1:36:58 PM5/18/21
to PsiTurk
Thank you, Dave!! I was able to create a live hit per Evan's suggestion but this is even better!
Reply all
Reply to author
Forward
0 new messages