Rationality and the English Language
post by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2007-09-12T22:55:57.000Z · LW · GW · Legacy · 33 commentsContents
33 comments
The other day, someone commented that my writing reminded them of George Orwell’s “Politics and the English Language.”1 I was honored. Especially since I’d already thought of today’s topic.
If you really want an artist’s perspective on rationality, then read Orwell; he is mandatory reading for rationalists as well as authors. Orwell was not a scientist, but a writer; his tools were not numbers, but words; his adversary was not Nature, but human evil. If you wish to imprison people for years without trial, you must think of some other way to say it than “I’m going to imprison Mr. Jennings for years without trial.” You must muddy the listener’s thinking, prevent clear images from outraging conscience. You say, “Unreliable elements were subjected to an alternative justice process.”
Orwell was the outraged opponent of totalitarianism and the muddy thinking in which evil cloaks itself—which is how Orwell’s writings on language ended up as classic rationalist documents on a level with Feynman, Sagan, or Dawkins.
“Writers are told to avoid usage of the passive voice.” A rationalist whose background comes exclusively from science may fail to see the flaw in the previous sentence; but anyone who’s done a little writing should see it right away. I wrote the sentence in the passive voice, without telling you who tells authors to avoid passive voice. Passive voice removes the actor, leaving only the acted-upon. “Unreliable elements were subjected to an alternative justice process”—subjected by whom? What does an “alternative justice process” do? With enough static noun phrases, you can keep anything unpleasant from actually happening.
Journal articles are often written in passive voice. (Pardon me, some scientists write their journal articles in passive voice. It’s not as if the articles are being written by no one, with no one to blame.) It sounds more authoritative to say “The subjects were administered Progenitorivox” than “I gave each college student a bottle of 20 Progenitorivox, and told them to take one every night until they were gone.” If you remove the scientist from the description, that leaves only the all-important data. But in reality the scientist is there, and the subjects are college students, and the Progenitorivox wasn’t “administered” but handed over with instructions. Passive voice obscures reality.
Judging from the comments I get, someone will protest that using the passive voice in a journal article is hardly a sin—after all, if you think about it, you can realize the scientist is there. It doesn’t seem like a logical flaw. And this is why rationalists need to read Orwell, not just Feynman or even Jaynes.
Nonfiction conveys knowledge, fiction conveys experience. Medical science can extrapolate what would happen to a human unprotected in a vacuum. Fiction can make you live through it.
Some rationalists will try to analyze a misleading phrase, try to see if there might possibly be anything meaningful to it, try to construct a logical interpretation. They will be charitable, give the author the benefit of the doubt. Authors, on the other hand, are trained not to give themselves the benefit of the doubt. Whatever the audience thinks you said is what you said, whether you meant to say it or not; you can’t argue with the audience no matter how clever your justifications.
A writer knows that readers will not stop for a minute to think. A fictional experience is a continuous stream of first impressions. A writer-rationalist pays attention to the experience words create. If you are evaluating the public rationality of a statement, and you analyze the words deliberatively, rephrasing propositions, trying out different meanings, searching for nuggets of truthiness, then you’re losing track of the first impression—what the audience sees, or rather feels.
A novelist would notice the screaming wrongness of “The subjects were administered Progenitorivox.” What life is here for a reader to live? This sentence creates a distant feeling of authoritativeness, and that’s all—the only experience is the feeling of being told something reliable. A novelist would see nouns too abstract to show what actually happened—the postdoc with the bottle in their hand, trying to look stern; the student listening with a nervous grin.
My point is not to say that journal articles should be written like novels, but that a rationalist should become consciously aware of the experiences which words create. A rationalist must understand the mind and how to operate it. That includes the stream of consciousness, the part of yourself that unfolds in language. A rationalist must become consciously aware of the actual, experiential impact of phrases, beyond their mere propositional semantics.2
Or to say it more bluntly: Meaning does not excuse impact!
I don’t care what rational interpretation you can construct for an applause light like “AI should be developed through democratic processes.” That cannot excuse its irrational impact of signaling the audience to applaud, not to mention its cloudy question-begging vagueness.
Here is Orwell, railing against the impact of cliches, their effect on the experience of thinking:
When one watches some tired hack on the platform mechanically repeating the familiar phrases—BESTIAL, ATROCITIES, IRON HEEL, BLOODSTAINED TYRANNY, FREE PEOPLES OF THE WORLD, STAND SHOULDER TO SHOULDER—one often has a curious feeling that one is not watching a live human being but some kind of dummy . . . A speaker who uses that kind of phraseology has gone some distance toward turning himself into a machine. The appropriate noises are coming out of his larynx, but his brain is not involved, as it would be if he were choosing his words for himself . . .
What is above all needed is to let the meaning choose the word, and not the other way around. In prose, the worst thing one can do with words is surrender to them. When you think of a concrete object, you think wordlessly, and then, if you want to describe the thing you have been visualising you probably hunt about until you find the exact words that seem to fit it. When you think of something abstract you are more inclined to use words from the start, and unless you make a conscious effort to prevent it, the existing dialect will come rushing in and do the job for you, at the expense of blurring or even changing your meaning. Probably it is better to put off using words as long as possible and get one’s meaning as clear as one can through pictures and sensations.
Charles Sanders Peirce might have written that last paragraph. More than one path can lead to the Way.
1Comment at http://lesswrong.com/lw/jb/applause_lights/f1t.
2Compare “Semantic Stopsigns” and “Applause Lights” in Map and Territory.
33 comments
Comments sorted by oldest first, as this post is from before comment nesting was available (around 2009-02-27).
comment by Robin_Hanson2 · 2007-09-13T00:22:26.000Z · LW(p) · GW(p)
What is above all needed is to let the meaning choose the word. Excellent advice.
comment by Cihan_Baran · 2007-09-13T02:09:32.000Z · LW(p) · GW(p)
Yay! And I am honored that my mentioning of Orwell's essay lead you to discus it!
I am not quite sure I agree with this, however,:"Whatever the audience thinks you said is what you said, whether you meant to say it or not; you can't argue with the audience no matter how clever your justifications."
Doesn't this make misunderstanding or misinterpretation -just by definition- impossible? I do think misinterpretation is a genuine possibility.
Also, you left out the good bit in your Orwell quote (probably to shorten the length):
one often has a curious feeling that one is not watching a live human being but some kind of dummy: a feeling which suddenly becomes stronger at moments when the light catches the speaker's spectacles and turns them into blank discs which seem to have no eyes behind them. (Emphasis mine)
comment by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2007-09-13T03:48:22.000Z · LW(p) · GW(p)
I do think misinterpretation is a genuine possibility.
Of course, but it's always the author's fault, at least if you happen to be an author. It's not the audience who misinterprets your words, it's you.
Also, you left out the good bit in your Orwell quote
Vivid imagery, yes; rational argument, no. Orwell wrote some classic stuff on Traditional Rationality but I never said he was a True Bayesian Master.
Replies from: DimitriK↑ comment by DimitriK · 2014-11-03T15:31:29.299Z · LW(p) · GW(p)
I agree with cihan here. It may not be a rational argument by itself, but it enhances the preceding argument because it makes you feel what the argument is all about. Besides, I got the impression your post was about how this is an important factor often missing from discussion. Or were you talking about active vs passive voice only?
comment by Jeremy_McKibben · 2007-09-13T03:55:01.000Z · LW(p) · GW(p)
Excellent post.
comment by anonymous4 · 2007-09-13T04:43:23.000Z · LW(p) · GW(p)
"Authors, on the other hand, are trained not to give themselves the benefit of the doubt."
Trained by whom?
comment by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2007-09-13T05:50:53.000Z · LW(p) · GW(p)
Yes, well, I never said I was a True Writing Master either.
comment by Rick_Smith · 2007-09-13T10:33:36.000Z · LW(p) · GW(p)
Another great post.
comment by Doug2 · 2007-09-13T13:22:32.000Z · LW(p) · GW(p)
Amen! Wonderful post! I couldn't agree more.
I would also note that—larger philosophical issues aside—from a pure efficiency standpoint, the passive voice uses more words than the active voice to convey the same meaning, again confusing meaning.
Bravo on this post!
comment by Daniel_Humphries · 2007-09-14T05:30:03.000Z · LW(p) · GW(p)
Wonderful.
I am a writer and Orwell is my hero. I love to see him discussed, and I find there is never a time at which I couldn't use a refresher. "Politics and the English Language" is an all-time gem.
When you say "If you analyze words deliberatively, rephrasing propositions, trying out different meanings, searching for nuggets of truthiness, then you're losing track of the first impression", it's a bit confusing. It sounds like you are saying "Don't use stock phrases as interchangeable tokens in an attempt to construct something truthy-sounding," which I gather is your meaning, which Orwell would endorse, and which would be of a piece with the rest of this blog.
But it also sounds very close to saying, "A writer should write from the gut and not worry about rephrasing and editing because editing is phony," which is of course the opposite of what Orwell teaches. What the most romantic-minded writers call "from the gut" is very often nothing more than received wisdom that "feels" true because they have never really questioned it. A good writer, like you say, is always reevaluating his words and the ways they might be construed. He rephrases his prepostions not his propositons, if I may be so cheeky.
comment by Eliezer Yudkowsky (Eliezer_Yudkowsky) · 2007-09-14T05:50:56.000Z · LW(p) · GW(p)
Daniel, I was thinking of the reader over-analyzing, not the author. Specifically, I'm thinking of all the times I've said, "Don't say X, it's misleading" and then a commenter says, "Well, if you interpret X to mean Y, it's sorta true." I edited the passage a bit, hopefully making it a bit clearer what I'm worried about.
comment by Sniffnoy · 2009-10-25T00:40:44.774Z · LW(p) · GW(p)
I have to point out, you've made a mistake of terminology here, one frequently pointed out at Language Log. You seem to have used "passive voice" to mean "construction that is vague as to agency". It's important to note weaseling, as you point out, but the use of passive voice isn't a good heuristic for that. Consider your own example of "Unreliable elements were subjected to an alternative justice process"; little of the weaseliness comes from the use of the passive. It wouldn't be much less weaselly if written as "When dealing with such unreliable elements, those responsible apply an alternative justice process." Who's responsible? I dunno.
Replies from: RobinZ, DSimon↑ comment by DSimon · 2010-07-10T16:12:35.010Z · LW(p) · GW(p)
Better yet, "When dealing with such unreliable elements, the authorities apply an alternative justice process." By not directly mentioning the notion of responsibility, we just have an authority doing properly authority-ish things, and the weasleyness is obscured fully once more.
Replies from: Sniffnoycomment by TheOtherDave · 2010-10-26T19:16:13.587Z · LW(p) · GW(p)
Agreed with your main thrust. Additionally, you touch glancingly on some points I want to highlight.
- Some scientists write their journal articles in passive voice. It's not as if the articles are being written by no one, with no one to blame
Right. And your sentence suggests the scientists are to blame.
Contrast 1b: "Some journal editors publish only articles in passive voice*."
Those sentences might describe the same present world, but they make different predictions. #1 implicitly predicts that a scientist can write a journal article "in the active voice", while #1b explicitly predicts that they often can't (because the relevant journals' editors might not publish an article "in the active voice").
So which sentence is correct? Well, maybe you haven't a clue, and it's beside your point. Maybe your point really is that "Journal articles are often written in passive voice."
That is, sometimes one obscures agency because one genuinely isn't sure who the agent is, and believes it's better to be vague than to be misleading. There's a legitimate difference between obscuring something known and obscuring something obscure.
Arguably, the real fallacy underlying all of this is the improperly excluded middle. If there were only two ways to write -- identifying agency, or using the passive voice -- then "avoid the passive voice!" would be equivalent to "identify the agent!", albeit longer. But there aren't, and it isn't.
- What does an "alternative justice process" do?
The problem here is entirely different.
"I subjected the unreliable elements to an alternate justice process" doesn't obscure the subject, but it still points away, rather than pointing at. The sentence asserts that whatever I used is a justice process, and isn't a standard one, but it doesn't actually say what I did. And it asserts that whoever I used it on was an element, and wasn't reliable, but doesn't actually say what it was.
This is a common way of pretending to say something without actually saying anything. It raises the question: do I not know what I'm talking about, or am I just refusing to say?
Incidentally, Avoid the passive voice! has the same problem. There are LOTS of ways to avoid the passive voice, most of which don't accomplish your goal. Presumably you mean "Identify the agent!"... so why not say that?
- I perhaps should write "with obscured agency" here, as per sniffjoy's entirely accurate comment. But making two corrections at the same time seems the greater sin, so I rely on scarequotes instead.
↑ comment by gwenn · 2011-01-20T09:39:12.886Z · LW(p) · GW(p)
That’s a different perspective of the English language, quite philosophical actually, I never thought about a language that way. I’ll bring this up to my sat tutoring colleagues and see what they have to say about it.
comment by CronoDAS · 2011-03-07T00:22:12.478Z · LW(p) · GW(p)
When writing essays for English class in high school, I was explicitly forbidden from using the word "I"...
Replies from: Yvain↑ comment by Scott Alexander (Yvain) · 2011-03-07T00:31:44.189Z · LW(p) · GW(p)
Did you by any chance go to high school in a Randian dystopia?
Replies from: CronoDAS↑ comment by CronoDAS · 2011-03-07T00:41:22.342Z · LW(p) · GW(p)
Heh.
More specifically, I was forbidden for using such phrases as "In my opinion" or "I think" or "I believe" on the grounds that
1) "it's not the correct style for an academic essay"
and
2) "you're the author, so saying 'I believe X' instead of just 'X' is redundant."
Perhaps ironically, my 9th grade English teacher spent a month or so on the novel Anthem by Ayn Rand... I believe it was my 10th grade English teacher that was the source of the injunction against the use of the word "I" though...
comment by Vladimir_M · 2011-03-07T00:56:05.847Z · LW(p) · GW(p)
Eliezer Yudkowsky:
Yesterday, someone said that my writing reminded them of George Orwell's Politics and the English Language. I was honored.
To continue with the thread necromancy, it's a dubious honor. I've seen several well argued scathing critiques of that essay by linguists. See for example the Language Log posts by David Beaver and Geoffrey Pullum discussing Orwell's nonsensical claims about the passive voice, the use of metaphors, etc.
Orwell was the outraged opponent of totalitarianism and the muddy thinking in which evil cloaks itself
There's plenty of "thinking" in Orwell's books that it would be charitable to call muddy. Orwell was one hell of a good writer, but intellectually he's way overrated. Even when it comes to his best work, 1984, every now and then I'm struck when I read some older book and realize that significant parts of the plot and philosophy of 1984 were borrowed from it. (If you think I'm exaggerating, just read Arthur Koestler's Darkness at Noon and James Burnham's wartime books.)
Replies from: ArisKatsaris↑ comment by ArisKatsaris · 2011-09-06T15:33:30.810Z · LW(p) · GW(p)
I've read both the posts you linked to -- and they're both horribly written nonsense.
They attack an essay that itself argues that all of the guidelines he stated can be occasionally broken, by showing how it occasionally breaks its own guidelines. Other flaws supposedly pointed out (e.g. that Orwell doesn't provide evidence for a superior quality in the past) are just factually false: Orwell gives as counterexample the English translation of Ecclesiastes.
Seriously, these posts don't say anything else: they just accuse it of a hypocrisy that isn't actually there. Are these the best arguments against Orwell's essay? If so, that's high praise for it indeed.
Replies from: Vladimir_M↑ comment by Vladimir_M · 2011-09-06T23:28:33.694Z · LW(p) · GW(p)
I see at least three problems with your criticism:
Orwell doesn't provide any useful guidelines on when the exceptions to his rules should apply. He only says you shouldn't use them when it would make you sound "outright barbarous." But this makes these rules useless as advice, since the exceptions are supposed to be guided by aesthetic feeling -- and those whose feeling is refined enough ipso facto already know what to do even without Orwell.
The second LL article cites a result that the use of passives in Orwell's essay is in fact well above the average found in a large sample of English prose. So whatever exeptions to his rules he has in mind, this necesarily implies that he breaks his own advice. There is no reasonable interpretaton of his admonition to avoid passives, whatever caveats and exceptions are attached to it, that would permit writing a whole essay with such an exceptionally high rate of passives.
- One sample of old text is very weak evidence of the average quality of old writing. Especially considering that it's from a highly non-representative source. (By which I mean a high-budget collaborative translation by top-rate English stylists, which has also survived popularity competition with other Biblical translations.)
↑ comment by ArisKatsaris · 2011-09-07T00:03:06.193Z · LW(p) · GW(p)
But this makes these rules useless as advice, since the exceptions are supposed to be guided by aesthetic feeling -- and those whose feeling is refined enough ipso facto already know what to do even without Orwell.
Orwell prefaces his rules by the following sentence:
one can often be in doubt about the effect of a word or a phrase, and one needs rules that one can rely on when instinct fails. I think the following rules will cover most cases:
In short, he explicitly states that it's when this aesthetic instinct fails that the rules are to be applied. And he talks in detail about the process he suggests be used BEFORE turning to the rules as a last resort.
The second LL article cites a result that the use of passives in Orwell's essay is in fact well above the average found in a large sample of English prose.
Possible, but mostly irrelevant, unless we're shown that Orwell used the passive somewhere where he ought have used the active...
↑ comment by MatthewW · 2011-10-28T22:41:07.174Z · LW(p) · GW(p)
The useful advice is in the first 5000 words of the essay, most importantly in the examples of bad writing. The 100 words or so of 'rules' are just a summary at the end.
This kind of teaching is common in other subjects. For example, in a Go textbook it's not rare to see a chapter containing a number of examples and a purported 'rule' to cover them, where the rule as stated is broken all the time in professional play. It would be a mistake to conclude that the author isn't a strong player, or that the chapter doesn't contain helpful advice. The 'rule' is just a way to describe a group of related examples.
I think it's better to think of the 'rules' in Orwell's essay more like mnemonics for what he's said earlier, rather than instructions to be followed on their own.
Replies from: FAWS↑ comment by FAWS · 2011-11-22T19:58:14.183Z · LW(p) · GW(p)
It would however be reasonable to conclude that the author does not have strong analytic understanding of what exactly makes them a strong player/good writer, and be cautious about the more abstract parts of the advice, similar to how native speakers can tell you whether a sentence is grammatical, but are usually less reliable for giving you general rules than speakers who learned the language as adults to a high level of proficiency.
comment by Tzalumen · 2012-09-11T08:54:27.139Z · LW(p) · GW(p)
This is perhaps a bit after the event, but the word that kept screaming through my mind as I read this was 'context'. I was surprised, upon searching for the word, that nowhere in your article or anywhere in the comments below did anyone mention the word 'context'. Context is what the passive voice strips from a statement, and the lack of context is what obscures the meaning. It's a minor complaint, but it struck me as odd, the literal lack of 'context'.
comment by LizzardWizzard · 2014-05-30T11:50:59.895Z · LW(p) · GW(p)
Elizier, and what about Huxley? Counterpoint is a stream of author's extremely rational counciousness, but you two might not get along, because Auldus wasn't too impressed of highly developed AI
comment by slicedtoad · 2015-07-07T19:32:47.758Z · LW(p) · GW(p)
Link to Orwell's paper is broken. New one: http://www.orwell.ru/library/essays/politics/english/e_polit/
comment by Jan Galkowski (jan-galkowski) · 2023-05-07T21:46:25.534Z · LW(p) · GW(p)
I wonder if some or most of the above can be rolled up into a formula for critiquing the utterances of things like GPT4, or even detecting it is GPT4 and not a person.