Running Sample (subjective sorting) Scripts

207 views
Skip to first unread message

Jin Y. Kim

unread,
Dec 12, 2011, 5:58:14 PM12/12/11
to turkit-d...@googlegroups.com
Hi,

I wanted to do a crowdsourcing experiment using Turkit, yet found the sample codes not working. 

I think the problem has to do with how XML parameters are encoded into MTurk api, 
(attached is the description of the problem)

I'd appreciate for your help!

-Jin Y. Kim


After executing balance-checking script on Turkit successfully, I tried running the next simplest script -- sorting. 


Yet I encountered an error below (text improvement script caused the same error). Assuming that it got my account info successfully, I'm not sure what's causing this problem. 

Can you help me on this? 

If it helps, I'm be in D tower at least during the morning and can see you in 5 mins. 
(not sure whether I'll be in Tea today)

Thank a lot!

-Jin

org.mozilla.javascript.JavaScriptException: Failed to create HIT: <Title>Compare Two Items</Title><Description>Compare two items, and decide which comes first.</Description><Question>&lt;QuestionForm xmlns=&quot;http://mechanicalturk.amazonaws.com/AWSMechanicalTurkDataSchemas/2005-10-01/QuestionForm.xsd&quot;&gt;


image.png

org.mozilla.javascript.JavaScriptException: Failed to create HIT: <Title>Compare Two Items</Title><Description>Compare two items, and decide which comes first.</Description><Question>&lt;QuestionForm xmlns=&quot;http://mechanicalturk.amazonaws.com/AWSMechanicalTurkDataSchemas/2005-10-01/QuestionForm.xsd&quot;&gt;
  &lt;Question&gt;
    &lt;QuestionIdentifier&gt;vote&lt;/QuestionIdentifier&gt;
    &lt;IsRequired&gt;true&lt;/IsRequired&gt;
    &lt;QuestionContent&gt;
      &lt;Text&gt;Which comes first?&lt;/Text&gt;
    &lt;/QuestionContent&gt;
    &lt;AnswerSpecification&gt;
      &lt;SelectionAnswer&gt;
        &lt;Selections&gt;
          &lt;Selection&gt;
            &lt;SelectionIdentifier&gt;a&lt;/SelectionIdentifier&gt;
            &lt;Text&gt;2&lt;/Text&gt;
          &lt;/Selection&gt;
          &lt;Selection&gt;
            &lt;SelectionIdentifier&gt;b&lt;/SelectionIdentifier&gt;
            &lt;Text&gt;4&lt;/Text&gt;
          &lt;/Selection&gt;
        &lt;/Selections&gt;
      &lt;/SelectionAnswer&gt;
    &lt;/AnswerSpecification&gt;
  &lt;/Question&gt;
&lt;/QuestionForm&gt;</Question><AssignmentDurationInSeconds>3600</AssignmentDurationInSeconds><LifetimeInSeconds>604800</LifetimeInSeconds><Keywords>undefined</Keywords><MaxAssignments>2</MaxAssignments><AutoApprovalDelayInSeconds>null</AutoApprovalDelayInSeconds><RequesterAnnotation>null</RequesterAnnotation><Reward><Amount>0.01</Amount><CurrencyCode>USD</CurrencyCode></Reward> (jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js#16)
at org.mozilla.javascript.gen.c172._c1(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js:16)
at org.mozilla.javascript.gen.c172.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c169._c9(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js:172)
at org.mozilla.javascript.gen.c169.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js)
at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:76)
at org.mozilla.javascript.gen.c169._c10(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js:184)
at org.mozilla.javascript.gen.c169.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c166._c63(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js:994)
at org.mozilla.javascript.gen.c166.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c172._c19(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js:236)
at org.mozilla.javascript.gen.c172.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c166._c61(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js:993)
at org.mozilla.javascript.gen.c166.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js)
at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:76)
at org.mozilla.javascript.gen.c173._c0(/Users/jykim/Downloads/./code.js:35)
at org.mozilla.javascript.gen.c173.call(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:398)
at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3065)
at org.mozilla.javascript.gen.c173.call(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.gen.c173.exec(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.Context.evaluateReader(Context.java:1135)
at edu.mit.csail.uid.turkit.RhinoUtil$2.func(RhinoUtil.java:113)
at edu.mit.csail.uid.turkit.RhinoUtil.evaluate(RhinoUtil.java:35)
at edu.mit.csail.uid.turkit.RhinoUtil.evaluateFile(RhinoUtil.java:111)
at edu.mit.csail.uid.turkit.TurKit.runOnce(TurKit.java:256)
at edu.mit.csail.uid.turkit.TurKit.runOnce(TurKit.java:291)
at edu.mit.csail.uid.turkit.gui.Main.onRun(Main.java:584)
at edu.mit.csail.uid.turkit.gui.Main.onEvent(Main.java:537)
at edu.mit.csail.uid.turkit.gui.SimpleEventManager.fireEvent(SimpleEventManager.java:30)
at edu.mit.csail.uid.turkit.gui.SimpleEventManager.fireEvent(SimpleEventManager.java:24)
at edu.mit.csail.uid.turkit.gui.Main$6.actionPerformed(Main.java:131)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:272)
at java.awt.Component.processMouseEvent(Component.java:6373)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6138)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4735)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4565)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4565)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:679)
at java.awt.EventQueue.access$000(EventQueue.java:85)
at java.awt.EventQueue$1.run(EventQueue.java:638)
at java.awt.EventQueue$1.run(EventQueue.java:636)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:652)
at java.awt.EventQueue$2.run(EventQueue.java:650)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:649)
at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)
ERROR: ----------------------------------
org.mozilla.javascript.JavaScriptException: Failed to create HIT: <Title>Compare Two Items</Title><Description>Compare two items, and decide which comes first.</Description><Question>&lt;QuestionForm xmlns=&quot;http://mechanicalturk.amazonaws.com/AWSMechanicalTurkDataSchemas/2005-10-01/QuestionForm.xsd&quot;&gt;
  &lt;Question&gt;
    &lt;QuestionIdentifier&gt;vote&lt;/QuestionIdentifier&gt;
    &lt;IsRequired&gt;true&lt;/IsRequired&gt;
    &lt;QuestionContent&gt;
      &lt;Text&gt;Which comes first?&lt;/Text&gt;
    &lt;/QuestionContent&gt;
    &lt;AnswerSpecification&gt;
      &lt;SelectionAnswer&gt;
        &lt;Selections&gt;
          &lt;Selection&gt;
            &lt;SelectionIdentifier&gt;a&lt;/SelectionIdentifier&gt;
            &lt;Text&gt;2&lt;/Text&gt;
          &lt;/Selection&gt;
          &lt;Selection&gt;
            &lt;SelectionIdentifier&gt;b&lt;/SelectionIdentifier&gt;
            &lt;Text&gt;4&lt;/Text&gt;
          &lt;/Selection&gt;
        &lt;/Selections&gt;
      &lt;/SelectionAnswer&gt;
    &lt;/AnswerSpecification&gt;
  &lt;/Question&gt;
&lt;/QuestionForm&gt;</Question><AssignmentDurationInSeconds>3600</AssignmentDurationInSeconds><LifetimeInSeconds>604800</LifetimeInSeconds><Keywords>undefined</Keywords><MaxAssignments>2</MaxAssignments><AutoApprovalDelayInSeconds>null</AutoApprovalDelayInSeconds><RequesterAnnotation>null</RequesterAnnotation><Reward><Amount>0.01</Amount><CurrencyCode>USD</CurrencyCode></Reward> (jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js#16)
at org.mozilla.javascript.gen.c172._c1(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js:16)
at org.mozilla.javascript.gen.c172.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c169._c9(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js:172)
at org.mozilla.javascript.gen.c169.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js)
at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:76)
at org.mozilla.javascript.gen.c169._c10(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js:184)
at org.mozilla.javascript.gen.c169.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/TraceManager.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c166._c63(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js:994)
at org.mozilla.javascript.gen.c166.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c172._c19(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js:236)
at org.mozilla.javascript.gen.c172.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/util.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:97)
at org.mozilla.javascript.gen.c166._c61(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js:993)
at org.mozilla.javascript.gen.c166.call(jar:file:/Users/jykim/Downloads/TurKit-0.2.6.jar!/edu/mit/csail/uid/turkit/js_libs/MTurk.js)
at org.mozilla.javascript.optimizer.OptRuntime.call2(OptRuntime.java:76)
at org.mozilla.javascript.gen.c173._c0(/Users/jykim/Downloads/./code.js:35)
at org.mozilla.javascript.gen.c173.call(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:398)
at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3065)
at org.mozilla.javascript.gen.c173.call(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.gen.c173.exec(/Users/jykim/Downloads/./code.js)
at org.mozilla.javascript.Context.evaluateReader(Context.java:1135)
at edu.mit.csail.uid.turkit.RhinoUtil$2.func(RhinoUtil.java:113)
at edu.mit.csail.uid.turkit.RhinoUtil.evaluate(RhinoUtil.java:35)
at edu.mit.csail.uid.turkit.RhinoUtil.evaluateFile(RhinoUtil.java:111)
at edu.mit.csail.uid.turkit.TurKit.runOnce(TurKit.java:256)
at edu.mit.csail.uid.turkit.TurKit.runOnce(TurKit.java:291)
at edu.mit.csail.uid.turkit.gui.Main.onRun(Main.java:584)
at edu.mit.csail.uid.turkit.gui.Main.onEvent(Main.java:537)
at edu.mit.csail.uid.turkit.gui.SimpleEventManager.fireEvent(SimpleEventManager.java:30)
at edu.mit.csail.uid.turkit.gui.SimpleEventManager.fireEvent(SimpleEventManager.java:24)
at edu.mit.csail.uid.turkit.gui.Main$6.actionPerformed(Main.java:131)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:272)
at java.awt.Component.processMouseEvent(Component.java:6373)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6138)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4735)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4565)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4565)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:679)
at java.awt.EventQueue.access$000(EventQueue.java:85)
at java.awt.EventQueue$1.run(EventQueue.java:638)
at java.awt.EventQueue$1.run(EventQueue.java:636)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:652)
at java.awt.EventQueue$2.run(EventQueue.java:650)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:649)
at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)



image.png

Prithvi Raj

unread,
May 10, 2012, 1:58:55 PM5/10/12
to turkit-d...@googlegroups.com
I get the same Exception with a newer version. Is there a way around this ?

Thanks much
Prithvi

Lu Xiao

unread,
Jul 28, 2012, 9:03:11 AM7/28/12
to turkit-d...@googlegroups.com
Hello!
 
Could someone help answer this question? I have run into the same issue with the newest version too. I am in a desperate situation here: I ran experiments with the old version before HTTS requirement. They worked fine. Now I need to run more experiments to get more results, and have to run the newer version. I cannot even test the posted HIT example with the newer version yet because of this exception! Thank you very much!
 
cheers,
 
Lu

Greg Little

unread,
Jul 31, 2012, 10:33:10 PM7/31/12
to turkit-d...@googlegroups.com
I just submitted a fix for this in version 0.2.8 ( http://code.google.com/p/turkit/downloads )

Sorry I haven't been doing that great at maintaining TurKit, and I'm about to do much worse as I take a 2 month sabbatical. If anyone would like commit access to the repository, let me know.

~Greg

--
You received this message because you are subscribed to the Google Groups "TurKit Discussion" group.
To view this discussion on the web visit https://groups.google.com/d/msg/turkit-discussion/-/CghmZ-NEl9wJ.

To post to this group, send email to turkit-d...@googlegroups.com.
To unsubscribe from this group, send email to turkit-discuss...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/turkit-discussion?hl=en.

Reply all
Reply to author
Forward
0 new messages