Where does “Blue” end and “Red” begin?

March 17th, 2008 by Brendan O'Connor

What would you call these colors?

We showed thousands of random colors like this to people on Mechanical Turk and asked what they would call them. Here’s what they said:

label-wheel2.gif

The above picture contains about 1,300 colors and the names for them that Turkers gave.  Each is printed in its color and positioned on a color wheel.  Just looking around, there sure seem to be different regions for different names.  But there are also rich sets of modifiers (”light”, “dark”, “sea”), multiword names (”army green”), and fun obscure ones (”cerulean”). To help look at all this, we also made a color label explorer, so you can search for different terms and see different parts of the space. If the link doesn’t work for you, here are a few examples:

explorer-screenshot-full.gif explorer-screenshot-full.gif
explorer-screenshot-full.gif explorer-screenshot-full.gif

This study is basically the same design as the famous World Color Survey, where anthropologists showed color patches to speakers of many different languages and asked for names, to test the universality of language.  Of course, we have mostly native English speakers. However, we can get much more data.  (The above picture and links use only a small percentage of all the colors and names we collected.)  There’s tons more that can be done. Want to make a better visualizer?  Statistical analysis of colors to name terms?  Let us know and we should be able to get this data set online.

UPDATE 3/18: I posted the data set.

-Brendan

99 Responses to “Where does “Blue” end and “Red” begin?”

  1. lakelady Says:

    cerulean obscure?? obviously no painters on staff as it’s a standard color in oils and acrylic paints.

  2. Stephan Says:

    I wonder how much variation would disappear if all the respondents were using correctly (or at least identically) calibrated monitors. Neat experiment, though! My two-year-old son and I frequently disagree on whether one his toys is blue (him) or purple (me). Mom agrees with him, FWIW.

  3. Egg Davis Says:

    Brendan,

    I for one would love to see the dataset made available. One interesting question: on what colors were there most agreement? Least?

  4. John Says:

    Hi, I’d love to play with this dataset. Depending on what is in it, you could do interesting things like look at the relationship between the colors presented to Turkers and their names, whether certain colors took longer to label than others, which colors have a higher level of “agreement” than others, etc.

  5. Mark Johnson Says:

    Baby poop? Ewww. Very neat though.

  6. mim golub Says:

    I just finished teaching a class in color exploration at the Virginia Museum of Fine Arts Studio School. I’m definitely going to share this with my students. I think it’s fascinating.

  7. Satchel Says:

    No printers either: no “reflex blue” or “process blue.”

  8. Klaus Says:

    When u mix red with blue? Whatever…

  9. Philipp Grawe Says:

    I wonder how many of the respondents were colour blind? Stephan, it would be worth getting tested - I’m protanopic and I have the exact same problem.

  10. JanusNode Says:

    Do you have gender info for the namers? I’d like to see that.

  11. rafael Says:

    Neat!

    linked on boingboing, btw

  12. Linda Carson Says:

    I’m building a new cross-over colour theory course for studio artists and science students. I love this, and I’d like to cast another vote for getting access to the dataset. (Ditto on cerulean and process blue–your Turks were general audience, not colour professionals.)

  13. Nostrilio Sniffo Says:

    I fell out of a window
    A second story window
    And caught my eyelash on the sill.

  14. brendano Says:

    Thanks for all the feedback folks.

    “cerulean obscure” –>my fault. Actually Lukas and Chris are both painters, I feel chagrined on this :)

    Monitor calibration –> I’m sure it affects things substantially. With all the variation from that, plus variance between individuals and the incredible subjectiveness of the task, I’m just happy to see stable regions on the color space!

    The data set –> I’m working on releasing it, check back soon!

  15. Avner Kashtan Says:

    @Linda Carston:
    Yes, the mechanical turks were probably a general audience. Isn’t that the point?

  16. Avner Kashtan Says:

    Correction to above: Carson, not Carston. My apologies.

  17. Emiline Says:

    Cerulean is also a standard color in the Crayola 64 crayon box; I’m actually surprised there aren’t more Crayola entries on the palette. (Lazer Lemon, anyone?) Turkers must have long since outgrown the coloring books!

  18. fire-pixel.com Says:

    I use two monitors - one laptop and other LCD flat and it’s a bugger to get the colors sync’d up.

    Good article, found another one for you if you’re interested:

    Top 10 Awesome Websites That Sell Cool Products You Probably Have Never Visited But Need To.

    http://www.comember.net/blogs/firepixel/

    Take care

  19. GreshkaLox Says:

    I think this is a terrific study. i also would like to see the dataset and also to repeat the experiment among many different groups. A university campus would be great and to get a little bit of background on the responders could be a riveting socio-anthro sketch.

  20. GreshkaLox Says:

    P.S. found this through boingboing.net FTW

  21. juan Says:

    By labeling with something that his long horizontally and short vertically, you’ve created a horizontal blur effect. Thus the green wedge seems broader than the blue wedge.

  22. Papayoung Says:

    Wonderful fun. I’d think presenting people with several colors side-by-side would have created more drift than varying monitors, as we perceive colors relative to each other. Much better to show one color at a time. Of course I didn’t see the survey itself, so I can’t be sure how you presented it. BTW, it seems to me you’ve already given us the data set; a ‘view source’ on the color label page pretty much covers it. Are you okay with us remixing it?

  23. RTH Says:

    “My two-year-old son and I frequently disagree on whether one his toys is blue (him) or purple (me). Mom agrees with him, FWIW.”

    You probably have a type of color blindness called anomalous trichromacy, of which there’s a subset called deuteranomalous which shift some colors slightly toward the red. It’s sex-linked, it effects mostly males, and causes a slight alteration to the color receptors in the eye (cones). These alterations can cause certain shades of blue to appear purple.

    It’s not particularly rare, and certainly not harmful. Most people don’t even notice until, like you, they argue over the color of an object.

  24. sDow Says:

    Hulkcredible!!!

  25. Andrea Says:

    Stephan (#2) wonders how much variation would disappear if all the respondents were using calibrated monitors, and I wonder how much would disappear if misspellings (e.g., “flourescent” instead of “fluorescent”) were corrected and capitalization/spacing were made consistent. Cool exercise, regardless.

  26. Mark Says:

    For a great book on color (human vision, color perception, ontology, phenomenlogy, …) see “Color for Philosophers: Unweaving the Rainbow” by C. L. Harden.

  27. Rene Says:

    You can tell how much of an impact Crayola has had on our country. I wouldn’t be surprised to find “macaroni and cheese” or “tickle me pink” up there…

  28. Mary Catherine Says:

    “Statistical analysis of colors to name terms?”

    I’m definitely interested!! I majored in Stats. I’d love to poke around with the data in Excel! :D

  29. Brandon Says:

    Could you make the source data available? I think it’d be a lot of fun to turn it into an interactive widget, if I got a few free moments. So you could type in a few letters and see examples like you give in real-time.

  30. brendano Says:

    papayoung, actually you can look at an example of the survey used by following the link on “asked” right after the color boxes. OK, it’s a little hidden :) so here it is: http://s3.amazonaws.com/lab20/ae18a3141e0cd78369c043fda22c76bdd354ff48.html

    Andrea, I tried looking at a few misspellings. For example, both “fushia” and “fuschia” appear a lot… “fusc?hia” gets both in the explorer.

  31. brendano Says:

    To all interested — I finally got the data set online!

    http://blog.doloreslabs.com/?p=17

  32. slim Says:

    The front porch of the house I grew up in was painted blue. Sure, it was a smoky, grayish sort of blue, but I always gave people directions by saying to look for “the house with the blue porch”. When my mom told me the porch was gray, I was very confused.

  33. Paul Kay Says:

    You say that each name is “printed in its color.” That would have required as many different ‘inks’ as there were different names offered (modulo synonymy) and also a procedure to decide which color ink went with each name. Didn’t you mean rather that you started with a version of color space and selected a bunch of points from that space for naming, then recorded each name at the point it was used to name? Apologies if this comes across as nit-picking, but I was genuinely confused at first.

  34. Anon Says:

    I’ve often wondered if there are regional differences. Obviously humans learn color names from their parents and caregivers, largely when they’re rather young. So if we take a certain shade of blue-green, for instance, is it true that most people growing up in France will call it “blue” while most people growing up in the USA will call it “green”? That’s a made-up example, but there OUGHT to be such differences, and it would be interesting to explore them.

  35. flakmonkey Says:

    http://blog.doloreslabs.com/?p=11
    Stephan & Philipp: I’ve got that problem where I confuse:
    blue and purple
    red and green
    green and brown
    pink and purple and violet (I’m pretty sure this is just disagreement over which word represents which colors)

    As for the dataset projects I could REALLY REALLY USE a tool where I give the hex/rgb/hsv/cmyk value of a color and it gives me the words most people would use to describe that color or the color closest to it. There already is a tool similar to that named WhatColor but it’s Windows only and its color set is quite limited.

    I’ve tried expanding the color set but the only data I’d found to work with before were fancy-pants tootie-fruity names of colors made by textile, interior decorating, and paint companies.

  36. George Says:

    Lukas and Chris:
    Nice work.
    Are you aware of the NIST list of 500+ color names?
    http://fire.nist.gov/fds/color_table.html

    I just added it to my Social Bookmarks
    http://del.icio.us/NetStrider?settagview=cloud

    What you need is a random sample of adults who
    work with colors to vote on each many color names.

    Regards, George

  37. Anders Thorseth Says:

    This is a great concept for a statistic-mash-up web application. What would people call this color in China or Europe. What would women call this color if they are between 20 and 40 and so on.

    Besides that it seems that you forgot the shades of white that would occur when additively mixing the colors.

    Great idear!

  38. brendano Says:

    Prof. Kay — by “printed in its color”, I just meant, when drawn on screen for that color wheel visualization. You’re right, all I did was start with a bunch of points in the color space and then showed them to people.

    To be even more specific, the rendering was through whatever RGB system that people’s computers used (probably sRGB, I think but am not sure); and as others pointed out, differences in people’s monitors probably made a non-trivial difference in what the actually saw.

  39. My Life In a Cube Says:

    I think “Cubicle Gray” has a nice ring to it, as does “Pink Slip Rouge,” which is what color you’ll be getting if you read too much of MyLifeInaCube.com

  40. Poster Says:

    I would like to see this experiment with technical parts of a computer or vehicle. with non-professionals. like in this study. “uhm a thing”, “oughta be a screw”, “somekindof screw”, “a piece of metal”, “definitely metal”.

  41. andy cutbirth Says:

    i love the color blue,it’like summer sky,dawn.it’s also the color most used in hospital:(

  42. andy cutbirth Says:

    i wonder if this was a random survey.Most of the people i know like the color blue.I’ts really irrelevant anywaythis is not one of my fav sites.i just thought i would put in my two cents,anyway.hehe

  43. Jesse Says:

    I like the one color blind green on there.

  44. Billy-Bob Says:

    What about anti-freeze green?

  45. GMH Says:

    Being color blind, I would love to see a survey of the colorblind and check out that representation. Maybe a question on the next survey.

  46. sandra Says:

    Hola, hablar de colores es un tema muy complicado tantas gamas, tonos, degradados que creo que seria imposible identificar uno de otro, pero que hermosos son en la naturaleza creo que todavia los podemos apreciar.

  47. Stuart Robinson Says:

    Nice work, Brendan. If I recall correctly (a big if), the procedure that was used in the basic color term research by Kay and others, your procedure is the “inverse” of theirs: they started with terms (basic color terms) and asked which color chips they covered whereas you’re starting with a color chip and asking which terms cover them.

  48. Jim Gal Says:

    Wy not a numbering system for colors instead of “fashion” names?

  49. Lee Says:

    Apart from colour blindness in males, women also have a greater range of colour perception than men - up to 6 colour receptors instead of the usual 3 - and greater variation.

  50. Paul Kay Says:

    Brendan, it seems like no one else shared my confusion, so let’s forget it. BTW, cool stuff.

    Stuart Robinson, you’re right that in the earliest work (Basic Color Terms. Berlin & Kay. 1969) we gave people names and asked them to indicate the corresponding color chips (in a fixed array), but in the later World Color Survey we presented color chips individually for naming. Check out http://www.icsi.berkeley.edu/wcs/ if you’re interested. For one thing, you’ll see the palette of chips used, and we still used that on the “show me the best example of …” task.

  51. Ibo Says:

    Just failed some color-tests so my flight license (in the UK/EU) will be restricted to flight during day time. The test were named Ishihara plates, Beynes latern test and Holmes Wright latern test. Never new about these test and neither about having a color vision deficiency/deviation. Some other approved test are available at flight authorities in switzerland, Germany and France. If one passes one of those (or USA or Australian ones) one can fly unrestricted within EU-airspace!

    — I wander what is most confusing: some slight color deviations or EU-regulations…

  52. Melatonina Says:

    Babypoop color? heheheh

  53. jacko Says:

    Couldn’t find baby-shit green!

  54. Chris Says:

    If you liken the Color Label Explorer to a map of China and Mongolia, you get Tibet if you type in “blue,” Mongolia if you type in “green,” and Xinjiang (homeland of the Uyghurs) if you type in “aqua.” “Red” will get you that southeastern region around Guangdong and Hong Kong.

    I know, it’s kind of a strange way to look at it, but I’ve had kind of a strange day.

  55. Alex Says:

    George said “Are you aware of the NIST list of 500+ color names?
    http://fire.nist.gov/fds/color_table.html

    That’s not quite what you think - the naming style and a least a large number of the names appear to be based on the X11 color name list, which was itself not very scientifically constructed. It’s also based on RGB device-coordinates, which isn’t very stable.

    I worked up my own table in 1994 or so, yielding http://www.talisman.org/~erlkonig/software/pub/xcms-rgb.xcmsdb with about 10000 colors based on variants of 24 basic hues with 2 more between each of those (so orange, orange-goldenrod, goldenrod-orange, goldenrod, goldenrod-yellow, etc), 9 steps towards white (pastels), 12 steps towards black, and 4 steps towards gray. And the whole X11 database, some symbolically-named colors, and a few extra. Using RGBI (emission- instead of device-coordinates, to some extent) allow for using CMS for color correction, so that 0-255 had subjectively even steps instead of tending to be bunched near the brighter end.

    Anyway, I’m thinking reviewing my 24 hue names in light of the research set should be interesting, but perhaps the results of my project from back then would be useful to someone else :-)

  56. Teresa Says:

    I have a friend who is blind. If some of the extraneous colors were deleted and this could be printed out somehow for a blind person, this would be very, very useful.

  57. mp Says:

    Here’s a 3D visualizer for the data and some screenshots:

    http://www.box.net/shared/qbunsqy0og

    The script requires Python and the Panda3D engine. It uses the modified data set (data2.csv) posted by Nick. Use the left mouse button to pan and the right mouse button to zoom. It’s pretty easy to change the scale and orientation of the axes in the code. Improvements are welcome.

  58. bot Says:

    cool site , thanks

  59. cheritycall Says:

    Hi, Give something to help those hungry people from Africa or India,
    I added this blog about them:
    at http://tinyurl.com/5hu74e

  60. Merlin Says:

    Your site is very very cool !! I love it :) Respect !,

  61. caring christmas live tree Says:

    Whyareyoulookingsosour-faced? caring christmas live tree 8503

  62. Cassie Martin Says:

    The funny thing with color is that it’s not really technically there at all - It’s merely light reflected off of pigments. WWWEEEIIIRRRDDD!!!!!

  63. Lucia Says:

    and what od you think about energetic problem in Russia?

  64. Quad Says:

    amaing think))

  65. Ola Says:

    Where I may tofid posts on this tpoic?

  66. Oktra Says:

    It’’s hard to uneerstand…

  67. Ric Says:

    So cool!

  68. Beddy Says:

    Yes, it’s real, I know!

  69. Perm Says:

    Nice post =)

  70. Pank Says:

    Super! I’ll do similar post in my blog

  71. Pink Says:

    such a nice story..

  72. Dimitris Mylonas Says:

    I must say I amazed, very beautiful visualization, well done.
    However colour varies across monitors, viewing conditions and observers and it would be nice to filter the database. The Colour Imaging Research Group at London College of Communication is running an on-line colour naming experiment, which takes into account some of these variations, give it a try?

  73. oksqurj sgewxdi Says:

    ipctw pkojn vlfo bmsl mnsh jscxmo chklsmvnw

  74. Scott Seiter Says:

    Great project! Consider it tweeted!

  75. Алексей Says:

    Самый интересный информационный портал о новинках мини устройствах, а также обзоры сотовых устройств

  76. знакомство Says:

    хотела бы с вами поообщаться поближе, снедать ровня вопросов сообразно оформлению и обмену блогами, дозволено даже поработать

  77. Словарь Юриста Says:

    списки кандидатов, выдвигаемые партиями политическими и избирательными объединениями (блоками) на выборах в представительные органы, проводимые по пропорциональной избирательной системе.

  78. Phi Says:

    The experiment goes on Farbnamen (german) and Colornames. The next goal will be to translate the names (german english).

  79. Zashkaser Says:

    Wait…which one is Britney?

  80. Августин Рабазов Says:

    Действительно интересно. Хотелось бы еще чего-нибудь об этом же.

  81. Гавриил Семенов Says:

    Подскажите где взять шаблон как у вас?

  82. Femmes Russes Says:

    Your site is very interesting, thank you very match!!

  83. Rosyjskie teledyski Says:

    After reading this blog makes me want to start my own.

  84. Dziewczyny Ukraina Says:

    Very cool site , thanks!!

  85. Otto Znakomstva Says:

    Very great project! Consider it tweeted!

  86. Hutchison Says:

    cool pics

  87. Rash Says:

    Oh, Yes lol :)

  88. Sonia Hall Says:

    A friend encoraged me to check out this page, great post, fanstatic read… keep up the good work!

  89. BARBARA Says:

    this is really cool….i definitely will be blogging about it

  90. lori Says:

    id like to try it

  91. jacob Says:

    i like this ill def think about this

  92. Ladna Dziewczyna Says:

    Yes, this blog is really cool….

  93. kitkat858 Says:

    baby poop makes me laff!

  94. Liawayliete Says:

    Блог очень понравился. Так держать!!!

  95. ez Says:

    nice..

  96. Liawayliete Says:

    А почему у вас так мало читателей, по мне отличный блог.

  97. Cordelia Bertolini Says:

    Somebody dropped a link to your site on Twitter and that is where I first found your blog. Fancy the stuff I have seen so far and will unquestionably return to read more in a while. By the way, are you on Twitter?

  98. Elkington Says:

    cool pics

  99. Release Says:

    Very good research. Thanks for the information.

Leave a Reply