Rion Snow presented the paper, “Cheap and Fast – But is it Good?” at EMNLP last week.
Here are the slides from the talk:
Rls For Emnlp 2008
View SlideShare presentation or Upload your own.
The CrowdFlower Blog
EMNLP Slides
November 6th, 2008 by
Cesar B. aka the Mover
11/06/08
This Blog reminds me the reason I like bloging so much, the interaction is very important with readers and you guys have it right. Looks great too, will be back for more posts, David the mover. : – )
Tim Reynolds
12/07/08
Nice post. Thank you for the info. Keep it up.
Heather Piwowar
12/29/08
Great paper. Timely, helpful, and thorough.
Thanks also for the continued descriptions of your work on your blog.
I’ve also been playing with Mech Turk for annotations. Not sure if you’ve looked at other metrics for reliability and generalizability of annotations, beyond correlations? I’ve got a blog post here with rough notes on using the generalizability coefficient… comments are most welcome, and feel free to run with the ideas if they are helpful.
Heather
Brendan O'Connor
12/29/08
Heather, thanks for posting this. We haven’t done too much with other metrics yet.