MTurk premium qualifications

372 views
Skip to first unread message

Michael

unread,
Jun 2, 2018, 2:36:10 PM6/2/18
to oTree help & discussion
Hi all:

I'm running a study on MTurk in which I need to use premium qualifications (in my case, political affiliation). https://otree.readthedocs.io/en/latest/mturk.html#qualification-requirements gives an example for a location-based qualification, but I can't seem to find the QualificationTypeId for premium qualifications. Is this doable on oTree, or do I need to use the MTurk UI?

Thanks,
Michael

Michael

unread,
Jun 14, 2018, 12:13:19 AM6/14/18
to oTree help & discussion
Sorry for the multiple posts, but has anybody found a good way to deal with this?

I asked Amazon and they recommended creating two types of HITs. The first one would just be a survey asking about demographics. Then, I would issue a Custom Qualification to the participants who have the Type I'm looking for, invite them to take the main HIT, and hope for the best. 

I can't imagine that this is the most practical method though...

Philipp Chapkovski

unread,
Jun 14, 2018, 12:24:01 AM6/14/18
to oTree help & discussion
in the attached file you can find a raw data with qualification ids for premium qualifications
find corresponding one and use it in mturk_hit_settings in settings.py
(if you convert it to clean csv and upload here that would be helpful for community)
premium_qualifications_ids.txt

Michael

unread,
Jun 14, 2018, 1:12:36 AM6/14/18
to ot...@googlegroups.com
Thanks Philipp, this is perfect.

And attached is the converted csv file. (Edit: changed & to &)
premium_qualifications_ids.csv

Elif Bike Ösün

unread,
Mar 5, 2021, 12:03:43 PM3/5/21
to oTree help & discussion
Hi, 

I want to assign the premium qualification type 3ZA6VN4RCNNAUKDJ130LXNQBVABXQN (gender: female). Does this qualification take an integer value? In other words, should I write the following in the MTurk tab in oTree?

 {
      'QualificationTypeId': "3ZA6VN4RCNNAUKDJ130LXNQBVABXQN",
      'Comparator': "EqualTo",
      'IntegerValues': [1]
  }

Chris @ oTree

unread,
Mar 5, 2021, 12:22:33 PM3/5/21
to oTree help & discussion
In order to assign the qualification, simply enter  3ZA6VN4RCNNAUKDJ130LXNQBVABXQN   in the 'grant_qualification_id' field in oTree Studio.

Elif Bike Ösün

unread,
Mar 5, 2021, 12:26:02 PM3/5/21
to oTree help & discussion
Hi Chris, thank you for the quick reply. I do not want to assign this qualification. 3ZA6VN4RCNNAUKDJ130LXNQBVABXQN is one of the premium qualifications of MTurk (specifically "gender is female" and it's a Boolean variable). I want only female MTurkers to see this HIT. I'm not sure how to add this qualification requirement since it does not have an integer value. 

Chris @ oTree

unread,
Mar 5, 2021, 12:29:49 PM3/5/21
to oTree help & discussion
See here: https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI/ApiReference_QualificationRequirementDataStructureArticle.html#ApiReference_QualificationRequirementDataStructureArticle-elements

I guess you want something like:

 {
      'QualificationTypeId': "3ZA6VN4RCNNAUKDJ130LXNQBVABXQN",
      'Comparator': "Exists"
  }

Elif Bike Ösün

unread,
Mar 5, 2021, 12:30:41 PM3/5/21
to oTree help & discussion
Wonderful, thank you!

Elif Bike Ösün

unread,
Mar 5, 2021, 5:12:05 PM3/5/21
to oTree help & discussion
Hi, I want to add the solution here for future if anyone else runs into the same problem.

Apparently the following does not work; as this qualification exists for everyone: it's a boolean variable that takes the value True or False. So exists comparator doesn't work.

{
      'QualificationTypeId': "3ZA6VN4RCNNAUKDJ130LXNQBVABXQN",
      'Comparator': "Exists"
  }

Instead, the code should be:

 {

      'QualificationTypeId': "3ZA6VN4RCNNAUKDJ130LXNQBVABXQN",

      'Comparator': "EqualTo",

      'IntegerValues': [1],

      'ActionsGuarded': "DiscoverPreviewAndAccept"

  }


Best,

Elif

Reply all
Reply to author
Forward
0 new messages