Comments on: EMNLP Slides http://blog.crowdflower.com/2008/11/emnlp-slides/ Wed, 07 Dec 2011 22:49:55 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Brendan O'Connor http://blog.crowdflower.com/2008/11/emnlp-slides/#comment-733 Brendan O'Connor Mon, 29 Dec 2008 19:42:13 +0000 http://blog.doloreslabs.com/2008/11/emnlp-slides/#comment-733 Heather, thanks for posting this. We haven't done too much with other metrics yet. Heather, thanks for posting this. We haven’t done too much with other metrics yet.

]]> By: Heather Piwowar http://blog.crowdflower.com/2008/11/emnlp-slides/#comment-732 Heather Piwowar Mon, 29 Dec 2008 16:41:43 +0000 http://blog.doloreslabs.com/2008/11/emnlp-slides/#comment-732 Great paper. Timely, helpful, and thorough. Thanks also for the continued descriptions of your work on your blog. I've also been playing with Mech Turk for annotations. Not sure if you've looked at other metrics for reliability and generalizability of annotations, beyond correlations? I've got a blog post <a href="http://researchremix.wordpress.com/2008/12/29/generalizability-coefficient-for-mechanical-turk-annotations/" rel="nofollow">here</a> with rough notes on using the generalizability coefficient... comments are most welcome, and feel free to run with the ideas if they are helpful. Heather Great paper. Timely, helpful, and thorough.

Thanks also for the continued descriptions of your work on your blog.

I’ve also been playing with Mech Turk for annotations. Not sure if you’ve looked at other metrics for reliability and generalizability of annotations, beyond correlations? I’ve got a blog post here with rough notes on using the generalizability coefficient… comments are most welcome, and feel free to run with the ideas if they are helpful.
Heather

]]> By: Tim Reynolds http://blog.crowdflower.com/2008/11/emnlp-slides/#comment-659 Tim Reynolds Sun, 07 Dec 2008 16:19:10 +0000 http://blog.doloreslabs.com/2008/11/emnlp-slides/#comment-659 Nice post. Thank you for the info. Keep it up. Nice post. Thank you for the info. Keep it up.

]]> By: Cesar B. aka the Mover http://blog.crowdflower.com/2008/11/emnlp-slides/#comment-636 Cesar B. aka the Mover Thu, 06 Nov 2008 23:02:52 +0000 http://blog.doloreslabs.com/2008/11/emnlp-slides/#comment-636 This Blog reminds me the reason I like bloging so much, the interaction is very important with readers and you guys have it right. Looks great too, will be back for more posts, David the mover. : - ) This Blog reminds me the reason I like bloging so much, the interaction is very important with readers and you guys have it right. Looks great too, will be back for more posts, David the mover. : – )

]]>