next meeting this Friday 7/16 3pm UTA 5.428

0 views
Skip to first unread message

Matt Lease

unread,
Jul 13, 2010, 1:31:38 PM7/13/10
to UT Austin IR Reading Group
Let's continue where we left off on 7/2 on aggregating turker labels
-- taking a look at the Whitehill paper linked below.

Whose vote should count more: Optimal integration of labels from
labelers of unknown expertise. http://mplab.ucsd.edu/~jake/OptimalLabeling.pdf

-----------
For completeness, URLs for for the Xu paper we talked about last time,
as well as the snow paper we touched on; we can remind ourselves what
was going on here and then discuss Whitehill.

Fang Xu, Dietrich Klakow: Paragraph Acquisition and Selection for List
Question Using Amazon's Mechanical Turk. LREC 2010.
http://www.lsv.uni-saarland.de/241_Paper.pdf

Snow, R. and O'Connor, B. and Jurafsky, D. and Ng, A.Y. Cheap
and fast---but is it good?: evaluating non-expert annotations for
natural language tasks. Proceedings of the Conference on Empirical
Methods in Natural Language Processing.
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.142.8286&rep=rep1&type=pdf

Matt Lease

unread,
Jul 16, 2010, 2:49:57 PM7/16/10
to UT Austin IR Reading Group
reminder of today's meeting at 3

On Jul 13, 12:31 pm, Matt Lease <matt.le...@gmail.com> wrote:
> Let's continue where we left off on 7/2 on aggregating turker labels
> -- taking a look at the Whitehill paper linked below.
>
> Whose vote should count more: Optimal integration of labels from
> labelers of unknown expertise.http://mplab.ucsd.edu/~jake/OptimalLabeling.pdf
>
> -----------
> For completeness, URLs for for the Xu paper we talked about last time,
> as well as the snow paper we touched on; we can remind ourselves what
> was going on here and then discuss Whitehill.
>
> Fang Xu, Dietrich Klakow: Paragraph Acquisition and Selection for List
> Question Using Amazon's Mechanical Turk. LREC 2010.http://www.lsv.uni-saarland.de/241_Paper.pdf
>
> Snow, R. and O'Connor, B. and Jurafsky, D. and Ng, A.Y. Cheap
> and fast---but is it good?: evaluating non-expert annotations for
> natural language tasks. Proceedings of the Conference on Empirical
> Methods in Natural Language Processing.http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.142.8286&rep...
Reply all
Reply to author
Forward
0 new messages