Update 9/19: Final PDF version has been uploaded. See also the comments below for updates — our released data is already being used by others! We recently teamed up with Rion Snow, Prof. Dan Jurafsky, and Prof. Andrew Ng from the Stanford AI Lab to try using Amazon Mechanical Turk to generate data sets for… Read more »
Posts By: Brendan O'Connor
Fleshmap: crowdsourcing sex
We all know crowds can tell us the weight of an ox, but can they help us in bed? With artists Fernanda Viegas and Martin Wattenberg, we took pictures of the nude human body, and asked people online to rate how much they’d like to touch, or be touched at, different positions all over the… Read more »
Survey: crowdsourcing sex
On this blog we’ve used crowdsourcing techniques to study media bias, linguistics of color, social perceptions, information retrieval, etc. But this is thinking small. The ability to quickly and easily collect data from thousands of people on the Web should allow us to study a huge swath of human behavior. Therefore, the next obvious topic… Read more »
Wisdom of small crowds, part 3: another worker visualization
This is a follow-up to the previous post on individual workloads and rates. Here are the submission times and durations for every worker on the same graph. Each worker is one horizontal line. An assignment is started at a dot, and its duration is for the line segment extending to the right. The particular data… Read more »
Wisdom of small crowds, part 2: individual workloads and rates
[ Update: see also another visualization of this. ] AMT’s great new interface makes it easy to download completion times for individual worker assignments. Therefore, it’s easy to visualize :) For a recent small job we did (250 HIT’s, 5 workers per HIT), here’s a graph of completion times per worker, over the entire 15… Read more »