Categorizing Has Consequences

post by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2008-02-19T01:40:56.000Z · LW · GW · Legacy · 13 comments

Contents

13 comments

Among the many genetic variations and mutations you carry in your genome, there are a very few alleles you probably know—including those determining your blood type: the presence or absence of the A, B, and + antigens.  If you receive a blood transfusion containing an antigen you don't have, it will trigger an allergic reaction.  It was Karl Landsteiner's discovery of this fact, and how to test for compatible blood types, that made it possible to transfuse blood without killing the patient.  (1930 Nobel Prize in Medicine.)  Also, if a mother with blood type A (for example) bears a child with blood type A+, the mother may acquire an allergic reaction to the + antigen; if she has another child with blood type A+, the child will be in danger, unless the mother takes an allergic suppressant during pregnancy.  Thus people learn their blood types before they marry.

Oh, and also: people with blood type A are earnest and creative, while people with blood type B are wild and cheerful.  People with type O are agreeable and sociable, while people with type AB are cool and controlled. (You would think that O would be the absence of A and B, while AB would just be A plus B, but no...)  All this, according to the Japanese blood type theory of personality.  It would seem that blood type plays the role in Japan that astrological signs play in the West, right down to blood type horoscopes in the daily newspaper.

This fad is especially odd because blood types have never been mysterious, not in Japan and not anywhere.  We only know blood types even exist thanks to Karl Landsteiner.  No mystic witch doctor, no venerable sorcerer, ever said a word about blood types; there are no ancient, dusty scrolls to shroud the error in the aura of antiquity.  If the medical profession claimed tomorrow that it had all been a colossal hoax, we layfolk would not have one scrap of evidence from our unaided senses to contradict them.

There's never been a war between blood types.  There's never even been a political conflict between blood types.  The stereotypes must have arisen strictly from the mere existence of the labels.

Now, someone is bound to point out that this is a story of categorizing humans.  Does the same thing happen if you categorize plants, or rocks, or office furniture?  I can't recall reading about such an experiment, but of course, that doesn't mean one hasn't been done.  (I'd expect the chief difficulty of doing such an experiment would be finding a protocol that didn't mislead the subjects into thinking that, since the label was given you, it must be significant somehow.)  So while I don't mean to update on imaginary evidence, I would predict a positive result for the experiment:  I would expect them to find that mere labeling had power over all things, at least in the human imagination.

You can see this in terms of similarity clusters: once you draw a boundary around a group, the mind starts trying to harvest similarities from the group.  And unfortunately the human pattern-detectors seem to operate in such overdrive that we see patterns whether they're there or not; a weakly negative correlation can be mistaken for a strong positive one with a bit of selective memory.

You can see this in terms of neural algorithms: creating a name for a set of things is like allocating a subnetwork to find patterns in them.

You can see this in terms of a compression fallacy: things given the same name end up dumped into the same mental bucket, blurring them together into the same point on the map.

Or you can see this in terms of the boundless human ability to make stuff up out of thin air and believe it because no one can prove it's wrong.  As soon as you name the category, you can start making up stuff about it.  The named thing doesn't have to be perceptible; it doesn't have to exist; it doesn't even have to be coherent.

And no, it's not just Japan:  Here in the West, a blood-type-based diet book called Eat Right 4 Your Type was a bestseller.

Any way you look at it, drawing a boundary in thingspace is not a neutral act.  Maybe a more cleanly designed, more purely Bayesian AI could ponder an arbitrary class and not be influenced by it.  But you, a human, do not have that option.  Categories are not static things in the context of a human brain; as soon as you actually think of them, they exert force on your mind.  One more reason not to believe you can define a word any way you like.

13 comments

Comments sorted by oldest first, as this post is from before comment nesting was available (around 2009-02-27).

comment by Psy-Kosh · 2008-02-19T02:06:15.000Z · LW(p) · GW(p)

ponders Just a thought for a possilbe start to a reasonable protocol for such an experiment:

Maybe something like having the subjects themselves create the categories instead of giving it to them? What I mean is this: You'd have, some set of plants (or whatever objects) and a group of test subjects. Then have each subject independantly produce a category. That is, tell them to select X plants at random and give a made up name to that group.

Several possible ways to deal with those that have been assigned to multiple categories. One way may be to remove each such entity. Other would simply be to give those a name somehow constructed from the names of the categories they're made of. Alternately, invent a new artificial category, like the "2 cat" category, the "3 cat" category, etc...

(This is just a bit if a fuzzy idea, not a full experimental protocol or anything, just a notion of a starting point for one)

comment by Acheman2 · 2008-02-19T03:08:53.000Z · LW(p) · GW(p)

Nice article, marred by the inaccurate presentation of maternal-fetal immune reaction. Most severe allergic reactions to the child have to do with Rhesus type, not ABO type. ABO reactions are rarely serious, and could only occur in a type O mother, because it's type Os who have the anti-A and anti-B antibodies in their blood serum. Irrelevant sidenote: they made a similar mistake on 'House' recently.

comment by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2008-02-19T03:21:28.000Z · LW(p) · GW(p)

Acheman, corrected.

comment by Tom_McCabe2 · 2008-02-19T05:01:32.000Z · LW(p) · GW(p)

"Or you can see this in terms of the boundless human ability to make stuff up out of thin air and believe it because no one can prove it's wrong."

Suppose that, on a tour of a Mad Scientist's Lab (tm), you see an object apparently floating in midair. You walk around it, and you determine that there are no structural supports, hidden wires, or air currents holding it up. And it's still, say, 1900, well before magnetic levitation and so forth are well known. The two alternatives you've expounded on before are:

  • Make up a theory out of thin air and whatever physics knowledge you possess. The theory must, obviously, predict levitation in this instance, but it should also predict a whole bunch of other phenomena, a great deal of which won't be testable. If the theory gains any notoriety, it will probably be hijacked by crackpots in precisely this manner.
  • Declare the matter a mystery, beyond the ability of present-day science to solve. This runs into the problem of people worshipping sacred mysteries.

Is there another alternative that has a better chance of finding the correct explanation?

Replies from: DanielLC
comment by DanielLC · 2012-02-02T05:27:17.185Z · LW(p) · GW(p)

Declare the matter a mystery beyond your ability to solve. Find some physicists, and ask them if it's beyond present-day physics. If it is, let them do science. Very little is beyond science. They'll work it out eventually. It might not be present day anymore, but they'll work it out.

comment by Roland2 · 2008-02-19T06:38:42.000Z · LW(p) · GW(p)

Tom McCabe:

3rd alternative: analyse more and/or try to gather more evidence before proposing any solution/theory to the mystery.

comment by Benquo · 2008-02-19T18:14:37.000Z · LW(p) · GW(p)

I thought Mr. McCabe was suggesting that holding off has a tendency to blur into worshiping the mystery. If so, I think the solution may just be to be extra special careful not to do that.

comment by Amanojack · 2010-03-11T18:04:23.502Z · LW(p) · GW(p)

The ideas you're touching on in this and related posts are probably the most important and most overlooked because they're not all that "sexy." These are the kinds of errors made in nearly every utterance and nearly every thought.

comment by A1987dM (army1987) · 2012-02-04T11:28:03.298Z · LW(p) · GW(p)

Does the same thing happen if you categorize plants, or rocks, or office furniture? I can't recall reading about such an experiment

IIRC, there were experiments which showed that native speakers of languages with grammatical genders tend to assign stereotypical-man-like features to objects the noun for which is grammatically masculine and stereotypical-woman-like features to objects the noun for which is grammatically feminine.

comment by Scrabbler · 2012-04-15T16:20:34.331Z · LW(p) · GW(p)

"Thus people learn their blood types before they marry"

should be

"Thus people aware of this problem learn their blood types before they deliberately attempt to conceive"

unless it was a statement designed to provoke exactly this analysis. ;)

comment by Benevolence · 2012-07-12T02:15:23.170Z · LW(p) · GW(p)

I think the oddness of this fad can be described by its link to the "science" literary genre.

I heard about this theory a few years ago, and looked it up on the internet, where i promptly found out it was just a myth. however at first i believed it. And i had a decent reason to do so.

I didn't know a lot about genetics (not that i do now lol). It seemed entirely reasonable that the genetics that determined your blood type would at least give a predisposition for a persons personality to slide in a certain direction from the norm.

This myths popularity can probably be explained by its believability. Only people doing further research would find out its a myth. Most would likely believe it on the spot and be satisfied because it sounds like something that came from doctors and scientists.

It may be that the original myth came about because of someone LOOKING for differences between labelled groups, but honestly it kind of makes sense to do this when those labels represent physical differences in genetics.

Theres a good reason human pattern-recognition runs in overdrive. Its damn useful.

As long as you're not trying to force yourself to find similarities, but just looking (even if its just for curiosity), I don't see the problem with trying to find similarities between different groups (labelled or otherwise). After all, so often, those similarities exist, and are very interesting. Especially where humans and psychology are concerned, if that kind of thing tickles your fancy as it does mine.

comment by ScottMcGreal · 2015-07-28T10:28:20.867Z · LW(p) · GW(p)

"The stereotypes must have arisen strictly from the mere existence of the labels." Actually, there is an interesting history to where these (completely bogus) stereotypes came about. Wikipedia has an article on this that explains the historic roots of this fad in racism and politics. For example, Japan had a political conflict with Taiwan, and someone noticed that Taiwanese people are predominantly type O. He therefore argued that "Taiwanese rebelliousness" was genetically determined and that blood type was a marker of this. Clearly this is pattern recognition gone wild, but there was an actual political agenda motivating this false pattern recognition. Therefore, the blood type fad did not originate "strictly from the mere existence of the labels." Of course it is possible that the fad has persisted long after the original political agendas have been forgotten (although I am speculating here) and this meme has taken on a life of its own so to speak.