Only say 'rational' when you can't eliminate the word
post by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2012-05-31T06:56:44.278Z · LW · GW · Legacy · 49 commentsContents
The word 'rational' should never be used on any occasion except when it is necessary, i.e., when we are discussing cognitive algorithms as algorithms. None 49 comments
Almost all instances of the word "true" can be eliminated from the sentences in which they appear by applying Tarski's formula. For example, if you say, "I believe the sky is blue, and that's true!" then this can be rephrased as the statement, "I believe the sky is blue, and the sky is blue." For every "The sentence 'X' is true" you can just say X and convey the same information about what you believe - just talk about the territory the map allegedly corresponds to, instead of talking about the map.
When can't you eliminate the word "true"? When you're generalizing over map-territory correspondences, e.g., "True theories are more likely to make correct experimental predictions." There's no way to take the word 'true' out of that sentence because it's talking about a feature of map-territory correspondences in general.
Similarly, you can eliminate the sentence 'rational' from almost any sentence in which it appears. "It's rational to believe the sky is blue", "It's true that the sky is blue", and "The sky is blue", all convey exactly the same information about what color you think the sky is - no more, no less.
When can't you eliminate the word "rational" from a sentence?
When you're generalizing over cognitive algorithms for producing map-territory correspondences (epistemic rationality) or steering the future where you want it to go (instrumental rationality). So while you can eliminate the word 'rational' from "It's rational to believe the sky is blue", you can't eliminate the concept 'rational' from the sentence "It's epistemically rational to increase belief in hypotheses that make successful experimental predictions." You can Taboo the word, of course, but then the sentence just becomes, "To increase map-territory correspondences, follow the cognitive algorithm of increasing belief in hypotheses that make successful experimental predictions." You can eliminate the word, but you can't eliminate the concept without changing the meaning of the sentence, because the primary subject of discussion is, in fact, general cognitive algorithms with the property of producing map-territory correspondences.
The word 'rational' should never be used on any occasion except when it is necessary, i.e., when we are discussing cognitive algorithms as algorithms.
If you want to talk about how to buy a great car by applying rationality, but you're primarily talking about the car rather than considering the question of which cognitive algorithms are best, then title your post Optimal Car-Buying, not Rational Car-Buying.
Thank you for observing all safety precautions.
49 comments
Comments sorted by top scores.
comment by Antisuji · 2012-05-31T21:27:28.713Z · LW(p) · GW(p)
Only say 'rational' when you can't eliminate the word
This is good advice for most words.
Replies from: DanArmak↑ comment by DanArmak · 2012-06-01T12:40:44.135Z · LW(p) · GW(p)
In the limit, only speak when you cannot remain silent.
Replies from: Cyan, James_Miller↑ comment by James_Miller · 2012-06-02T01:27:21.108Z · LW(p) · GW(p)
But "small talk" seems to be a friendship-enabling technology.
Replies from: iii↑ comment by iii · 2012-06-02T22:52:57.952Z · LW(p) · GW(p)
Only make up hasty generalizations when it's entertaining to do so.
Also: if it gets you internet points.
Replies from: InsertUsernameHere↑ comment by InsertUsernameHere · 2013-07-06T15:11:54.163Z · LW(p) · GW(p)
Internet points are constantly ruining my subreddits.
comment by Maelin · 2012-05-31T07:36:33.142Z · LW(p) · GW(p)
Similarly, you can eliminate the sentence 'rational' from almost any sentence in which it appears. "It's rational to believe the sky is blue", "It's true that the sky is blue", and "The sky is blue", all convey exactly the same information about what color you think the sky is - no more, no less.
I might be missing the point of this paragraph, but it seems to me that "it's rational to believe the sky is blue" and "the sky is blue" do not convey the same information. I can conceive of situations in which it is rational to believe the sky is blue, and yet the sky is not blue. For example, the sky is green, but superintelligent alien pranksters install undetected nanotech devices into my optic and auditory nerves/brain, altering my perceptions and memories so that I see the green sky as blue, and hear (read) the word "blue" where other people have actually said (written) the word "green" when describing the sky.
Under these circumstances, all my evidence would indicate the sky is blue - and so it would be rational to believe that the sky is blue. And yet the sky is not blue. But the first statement doesn't feel like I am generalising over cognitive algorithms in the sense I took from the big paragraph.
Am I missing or misinterpreting something?
Replies from: Oligopsony, VincentYu, Luke_A_Somers, beriukay↑ comment by Oligopsony · 2012-05-31T08:00:25.226Z · LW(p) · GW(p)
When discussing these third-person as you are now, cognitive algorithms as algorithms are being invoked. But we all know that "p" and "Alice thinks that p" are hardly reducible to each other, it's first-person items like "I believe that p" that are deflationary. So while it is clearly the case that you can imagine situations where the sky is not blue but it would be epistemically rational to believe that it is, that does not demonstrate situations where one could justifiably claim only one of "the sky is blue" and "it is rational to believe that the sky is blue" (indeed the justifiability of the former just is the content of the latter.)
Replies from: ronny-fernandez, JonathanLivengood↑ comment by Ronny Fernandez (ronny-fernandez) · 2012-06-11T00:31:45.707Z · LW(p) · GW(p)
"I believe that 'P'." is only deflationary because it treats belief as if it were binary, but it isn't. "I have 0.8 belief in 'P'." is certainly not the same as "It is true that 'P'." Yes? One is a claim about the world, and one is a claim about my model of the world.
↑ comment by JonathanLivengood · 2012-06-01T01:55:44.435Z · LW(p) · GW(p)
I am pretty sure that p and "it is rational to believe that p" can come apart even from a first-person perspective. At least, they can come apart if belief is cashed out in terms of inclination to action in a single case.
Let me illustrate. Suppose there are five live hypotheses to account for some evidence, and suppose that I assign credences as follows:
C(h1) = 0.1; C(h2) = 0.35; C(h3) = 0.25; C(h4) = 0.15; C(h5) = 0.1; and C(other) = 0.05.
Further suppose that I am in a situation where I need to take some action, and each of the five hypotheses recommends a different action in the circumstances.
Assuming that by "belief" one means something like "what one proposes to act on in forced situations," then it is rational to believe h2. It is rational to act as if h2 were true. But one need not think that h2 is true. It is more likely to be true than any of the other options, but given the credences above, one ought to think that h2 is false. That is, it is much more likely on the evidence that h2 is false than that it is true.
Replies from: thomblake↑ comment by thomblake · 2012-06-01T18:11:03.131Z · LW(p) · GW(p)
"It's rational to believe that #32 will win" and "It's rational to bet on #32" are not the same thing. In fact, they're using different senses of "rational", as we usually carve things up.
Thus in your example, "it's rational to believe h2" and "h2" are still equivalent, but "act as though h2" is not.
Replies from: JonathanLivengood↑ comment by JonathanLivengood · 2012-06-01T23:02:31.048Z · LW(p) · GW(p)
Could you elaborate on the mistake you think I'm making? I'm not seeing it, yet.
↑ comment by VincentYu · 2012-05-31T09:19:15.540Z · LW(p) · GW(p)
I think the intended meaning is as follows:
Similarly, you can eliminate the [word] 'rational' from almost any sentence [you utter]. [Saying] "It's rational to believe the sky is blue", [saying] "It's true that the sky is blue", and [saying] "The sky is blue", all convey exactly the same information about what color you think the sky is - no more, no less.
As you pointed out, the first sentence is not logically equivalent to the second and third (the second and third are logically equivalent according to Tarski's semantic theory of truth).
↑ comment by Luke_A_Somers · 2012-05-31T14:43:17.235Z · LW(p) · GW(p)
Alternately, if the sky IS blue, and someone objects to jumping to that conclusion, you can point out that the obvious conclusion is in fact rational in addition to claiming that it's correct.
↑ comment by beriukay · 2012-05-31T08:36:53.474Z · LW(p) · GW(p)
"the sky is blue" and "it is rational to believe that the sky is blue" (indeed the justifiability of the former just is the content of the latter.)
This. You have created an example that shows that it is utterly impossible for a creature with our limited primate capabilities to actually know The Truth. What we can do is pay close attention to what we think and why we think that to be so.
In your case, there's an overwhelming amount of good reason to believe the sky is blue to anyone who doesn't know about these loki-like aliens (I really wanted to call them 'lokiens'). You might be wrong, and it could possibly lead to bad consequences in the future. But the alternative, believing something to be true without good reason, is crazy.
comment by Benquo · 2012-05-31T14:03:03.969Z · LW(p) · GW(p)
I agree.
Rationality is kind of like Voldemort.
But seriously, when we keep using the word rational to describe what we ought to do or think, when we really should just say "what action accomplishes this specific goal I have?" or "what's really there, and what observations do I expect?", It lets us be lazy and use "rationality" as an identity, rather than a way to win.
comment by James_Miller · 2012-06-02T01:25:14.847Z · LW(p) · GW(p)
As an economics professor can I get an exemption from this rule? Rationality is a default assumption in my classes and I often need to remind students of this by throwing the word "rational" into sentences.
Replies from: DanielLC↑ comment by DanielLC · 2014-09-15T04:34:00.494Z · LW(p) · GW(p)
I'd say you need it not just because it's a default assumption, but because it's also an inaccurate assumption. Sort of like how you specify that an inclined plane is frictionless and in a vacuum, but you don't mention that it's under the force of gravity, or that it will force away any object that would otherwise pass through it.
comment by John_Maxwell (John_Maxwell_IV) · 2012-05-31T19:14:14.886Z · LW(p) · GW(p)
It sounds like good advice, but the forcefulness of the recommendation seems out of proportion with the importance of the topic.
Replies from: vi21maobk9vp↑ comment by vi21maobk9vp · 2012-05-31T20:23:35.637Z · LW(p) · GW(p)
I guess it is an attempt to top off all the recent "a bit more about r-word" discussions and move one already.
Replies from: John_Maxwell_IV↑ comment by John_Maxwell (John_Maxwell_IV) · 2012-06-01T00:01:45.636Z · LW(p) · GW(p)
It seems like a blunt way to do it, you could always just say "hopefully that will clear things up for the next month or so" or whatever.
comment by [deleted] · 2015-11-19T01:22:53.548Z · LW(p) · GW(p)
Perhaps you're confusing 'rational' with 'rationale' and 'reason'.
comment by Armok_GoB · 2012-05-31T21:14:23.867Z · LW(p) · GW(p)
What about saying "it is rational to feel X" when you are not good enough at self modification to actually feel X?
What about the actions of someone else? "It is rational to not eat the cake" vs. "don't eat the cake"? The later may be interpreted as requesting a favour since you want to eat the cake yourself.
"rational" is a rather versatile word, a general rule to never use it except in specific situation X is not going to turn out well.
Replies from: Benquo↑ comment by Benquo · 2012-06-01T01:43:46.288Z · LW(p) · GW(p)
I think that both those are actually great examples of where using a word like "rational" obscures rather than clarifies.
What about saying "it is rational to feel X"
We have less direct control over our feelings than our explicit thoughts. It may or may not be irrational to endorse a feeling, but I for one think of feelings as neither rational nor irrational, but mere facts, and I think that's the common usage. You'd likely be better off thinking, "Y is true, but feeling X is inconsistent with my goals if Y is true. Therefore I want to feel less X."
For example, let's say that I am afraid of the dark, but it does not in fact achieve my goals to avoid the dark, or to be afraid when it's dark. Then what I want to do is notice that the feeling is unhelpful, and take actions to reduce it.
What does it add to say that the feeling itself is irrational?
What about the actions of someone else? "It is rational to not eat the cake" vs. "don't eat the cake"?
Here, "rational" is substituting for a claim about whether eating the cake has some specific effect, or optimizes or fails to optimize some goal or utility function. It is more precise to make the claim explicit than to use a vague term like "rational." For example, you might say that it is unfair for them to eat the cake, or that they probably wouldn't be better off with the extra calories, etc.
comment by Bart119 · 2012-05-31T16:03:22.505Z · LW(p) · GW(p)
I have no commitment to 'rational' in the sense OP wants to eliminate. But what shorthand might one use for "applying the sorts of principles that are the general consensus among the LW community, as best I understand them"?
Replies from: evandcomment by Jay_Schweikert · 2012-05-31T14:32:35.613Z · LW(p) · GW(p)
So, when we're distinguishing "optimal car-buying" from "rational car-buying," is the point that using the word "rational" is somehow wrong and distorts or confuses the intended message? Or is really just that we want to save the word for when we need it most, so as to safeguard against death-spiraling around "rationality"? I'm not trying to suggest that the latter wouldn't be a good enough reason, but I'm trying to figure out if Eliezer's point is about being precise with this concept on a substantive level, or more about community norms, rhetorical efficacy, and sanity prophylactics. The last sentence of the OP suggests the latter is at least in play, but I'm trying to figure out whether this issue suggests some problem with what we mean by the word in the first place.
Replies from: CuSithBell, Jack, RobertLumley↑ comment by CuSithBell · 2012-05-31T16:41:25.971Z · LW(p) · GW(p)
My take on it is - "rationality" isn't the point. Don't try to do things "rationally" (as though it's a separate thing), try to do them right.
It's actually something we see with the nuts that occasionally show up here - they're obsessed with the notion of rationality as a concrete process or something, insisting (e.g.) that we don't need to look at the experimental evidence for a theory if it is "obviously false when subjected to rational thought", or that it's bad to be "too rational".
↑ comment by Jack · 2012-05-31T14:53:44.823Z · LW(p) · GW(p)
For me it's this: From a pragmatics perspective "the rational way to buy a car is..." repeats information-- when a person shares a method of doing something everyone assumes the speaker thinks that method is rational. Repeating it is redundant and redundant speech acts have a tendency to come off as arrogant and squicky. It's what you do when you talk down to someone.
It's also just sloppy to use words with connotations that don't apply when a better word exists. "Rational" connotes some general discussion of cognitive algorithms.
So I suspect it's a combination of a)sloppiness is bad and b)sloppiness looks and sounds bad
Replies from: Jay_Schweikert↑ comment by Jay_Schweikert · 2012-05-31T15:06:36.951Z · LW(p) · GW(p)
But then what about "optimal car-buying"? Surely if someone is taking the time to describe how to buy a car, they probably think it's the optimal method, or at least as close as they can get. So "optimal" would seem to be redundant too, and yet we would seem to prefer one over the other, even though they basically mean the same thing thing in this context.
Now, there may be some arrogance built into "rational" that's not present in "optimal," but I don't see the issue as one of redundancy. Rather, it seems like "rational" can sometimes come off as an assertion of superiority over another -- i.e., something like a man telling a female colleague that she needs to be more rational.
Replies from: Jack, shokwave↑ comment by RobertLumley · 2012-05-31T15:54:25.185Z · LW(p) · GW(p)
I think the objection to rational stems largely from this. Rationalism has a negative connotation in society thanks to, among other things, Hollywood and Ayn Rand.
See also: Straw Vulcan
comment by BaconServ · 2012-05-31T21:04:05.922Z · LW(p) · GW(p)
Anyone got any bets on the next word LessWrong is going to abuse?
Replies from: Benquo, Alex_Altair↑ comment by Alex_Altair · 2012-06-01T00:22:43.064Z · LW(p) · GW(p)
Let's try "Bayesian".
Replies from: thomblakecomment by Shmi (shminux) · 2012-05-31T14:57:17.212Z · LW(p) · GW(p)
While I agree with the rationality part, I have a nitpick with the truth part.
When can't you eliminate the word "true"? When you're generalizing over map-territory correspondences, e.g., "True theories are more likely to make correct experimental predictions." There's no way to take the word 'true' out of that sentence because it's talking about a feature of map-territory correspondences in general.
This is a realist position. An instrumentalist approach is that realism (= map/territory distinction) is a model in itself. Hence the definition of the word true: "theories that are more likely to make correct experimental predictions are provisionally defined as true in the map-territory model". Thus in instrumentalism "true" is replaced with "useful": "theories that are more likely to make correct experimental predictions are more useful", without any ontological claims attached.
comment by Oscar_Cunningham · 2012-05-31T11:05:54.899Z · LW(p) · GW(p)
I would add the additional constraint that if you can eliminate all instances of the word "rational" from your post then LessWrong isn't the blog for it, and you should post it elsewhere.
Replies from: Manfred, thomblake, army1987↑ comment by Manfred · 2012-05-31T11:19:05.724Z · LW(p) · GW(p)
This is seriously false.
Replies from: steven0461↑ comment by steven0461 · 2012-05-31T23:02:26.393Z · LW(p) · GW(p)
Surely you can see the point Oscar is trying to make, though? If a post's claim to topicality was that it presented "a rational way to do something", and if (by the advice of the original post) you instead make it present "a way to do something", then that raises the question of what it's doing here instead of on the rest of the internet.
↑ comment by thomblake · 2012-06-01T18:12:45.847Z · LW(p) · GW(p)
I think your claim as stated is literally false, but I completely agree with your sentiment.
Replies from: Oscar_Cunningham↑ comment by Oscar_Cunningham · 2012-06-01T18:35:36.676Z · LW(p) · GW(p)
I think my claim as stated is literally true, since if I could add that constraint as a community norm, I would.
↑ comment by A1987dM (army1987) · 2012-06-01T10:29:23.185Z · LW(p) · GW(p)
This is among the highest-voted posts ever and doesn't use the word “rational”.
Replies from: Oscar_Cunningham↑ comment by Oscar_Cunningham · 2012-06-01T14:11:22.139Z · LW(p) · GW(p)
I come to Less Wrong to learn about how to think and how to act effectively. I care about general algorithms that are useful for many problems, like "Hold off on proposing solutions" or "Habits are ingrained faster when you pay concious attention to your thoughts when you perform the action". These posts have very high value to me because they improve my effectiveness across a wide range of areas.
Another such technique is "Dissolving the question". The post you linked to (Yvain's "Diseased thinking: dissolving questions about disease") is valuable as an exemplary performance of this technique. It adds to Eliezer's description of question-dissolving by giving a demonstration of its use on a real question. It's main value comes from this, anything I learnt about disease whilst reading it is just a bonus.
To quote badger in the recent thread "Rational Toothpaste: A Case Study"
I claim a post on "rational toothpaste buying" could be on-topic and useful, if correctly written to illustrate determining goals, assessing tradeoffs, and implementing the final conclusions. A post detailing the pros and cons of various toothpaste brands is for a dentistry or personal hygiene forum; a post about algorithms for how to determine the best brands or whether to do so at all is for a rationality forum.
But we don't need more than one or two such examples! Yvain's post about question-dissolving was the only such post I ever need to read.
Posts about toothpaste or house-buying or room-decoration or fashion (EDIT: shaving, computer hardware) only tell me about that particular thing. As good as many of them are they'll never be as useful as a post that teaches me a general method of thought applicable on many problems. And if I want to know about some particular topic I'll just look it up on Google, or go to a library.
It's not possible for LessWrong to give a rational treatment of every subject. There are just too many of them. Even if we did I wouldn't be able to carry all that info around in my head. That's why I need to learn general algorithms for producing rational decisions.
(Also: Even though badger makes it clear in the quote I gave that the post is supposed to about the algorithms used, only one of the comments on it (kilobug's) is talking about this. Most of the rest are actually talking about toothpaste.)
EDIT: Should I repost this to discussion level?
Replies from: army1987↑ comment by A1987dM (army1987) · 2012-06-02T17:53:05.107Z · LW(p) · GW(p)
Should I repost this to discussion level?
Yes.