Superbowl Commercials – The Good, The Bad and The Ugly

Posted by & filed under Miscellaneous.

With consumers increasingly recording their experiences with brands online, Superbowl XLVI unleashed a trove of valuable consumer data. As the volume increases, though, it becomes harder and harder to sift though the quantities of data. In the words of Brad Jakeman, Chief Creative Officer of Pepsi, Smart listening tools that generate real-time cultural insights and… Read more »

Crowdsourcing and Retention: From First-Timers to Seasoned Veterans

Posted by & filed under Experiments, Miscellaneous.

Millions of people have participated in our tasks over the last few years, and tens of thousands of people are active at any given moment. However, crowdsourcing is not a traditional engagement model. Tasks are elective, which means people are free to come and go as they please. It’s a fair question, then, to ask whether they… Read more »

Enterprise Crowdsourcing or: How I learned to stop worrying and trust the crowd

Posted by & filed under Miscellaneous.

Our recent post about confidence bias, where we showed that most contributors vastly overestimate their own ability to complete tasks correctly, raised a lot of questions about how we manage quality at CrowdFlower. You might remember these themes from such classic posts as: AMT is Fast, Cheap and Good or the Wisdom of Small Crowds series… Read more »

Confidence Bias: Evidence from Crowdsourcing

Posted by & filed under Experiments, Miscellaneous.

Evidence in experimental psychology suggests that most people overestimate their own ability to complete objective tasks accurately. This phenomenon, often called confidence bias, refers to “a systematic error of judgment made by individuals when they assess the correctness of their responses to questions related to intellectual or perceptual problems.” 1 But does this hold up in crowdsourcing? We ran an experiment to… Read more »

From Sea to Shining Sea

Posted by & filed under Miscellaneous.

With Independence Day just behind us, I thought it might make sense to reflect on the people who do CrowdFlower tasks throughout the Union. Sure enough, we do have people doing CrowdFlower tasks in all 50 states. California, Texas, New York, and Florida are well represented among people working on our tasks, which isn’t especially… Read more »