The Martial Art of Rationality

To continue with this metaphor, it seems what we need is a good set of problems to test our rationality (i.e., ability to resist common biases). As with any cognitive test, the details of the test can't be known in advance, or people would just memorize answers instead of developing skills. So we need to collect a rather large set of good test questions, or create a generators to create sets of them automatically. Not easy, but perhaps worth doing.

It seems that calibrating personal judgements using decision markets could in principle be a way to measure rationality. You make a guess, and if your guess is close to what the market predicts, you can be slightly more confident about yourself. Of course, for this to work, you'd have to avoid prior knowledge of the market, and skip participating in betting on topics that you want to consider unassisted first.

Great post btw.

Do we want "techniques" for finding the truth? I suppose if the truth is "the weight of this fruit for sale." But if the truth is more like "what I ought to be doing," there is something closer to the essence of personality involved. If my personality is gained as a technique at a truth dojo, then it does not feel like mine. The necessity of discovering certain truths personally rather through technical instruction is a limit on the usefulness of teaching.

Ultimately, the nature of rationality is a question that goes to essence of personality. If I am willing to receive only deductively derived formula as rational, then I have -- not only a technique of rationality -- but a particularly well-known and annoying personality. If I am willing to act on any emotional or intuitive vapor, then I have another well-known and annoying personality. We are all aware that the grounds upon which I am willing to believe and act are not just techniques of rationality -- they are part of our fundamental identities and determine the way that we form or do not form social relations with others.

Michael, you can't have a prediction market without a way to pay off the bets, and if you have that you can measure personal accuracy directly, if you just wait.

Robin, I agree that the main difficulty is figuring out how to pay off the bets, but it seems to me that - given such a measure - playing a prediction market around the measure makes the game more complex, and hopefully more of a lesson, and more socially involving and personally intriguing. In other words, it's the difference between "Guess whether it will rain tomorrow?" and "Bob is smiling evilly; are you willing to bet $50 that his probability estimate of 36.3% is too low?" Or to look at it another way, fewer people would play poker if the whole theme was just "Estimate the probability that you can fill an inside straight." I think Anissimov has a valid fun-amplifying suggestion here.

Psychologists have developed a self-deception test, which includes questions like "Did you ever hate your mother," on the assumption that most everyone did but few want to admit it. See:

Paulhus, Delroy L. "Self-deception and Impression Management in Test Responses." In Angleitner, A. & Wiggins, J. S., Personality assessment Via Questionnaires. New York, NY: Springer, 1986, 143-165.

Perhaps questions like those might be a good part of a rationality test and practice regime .

Why aren't there dojos that teach rationality?

They're called universities. My PhD adviser taught me to think rationally and caught many of the errors in my thinking, including those caused by biases. This eventually allowed me to catch many of my own errors.

No, it wasn't perfect. It was limited to one academic area and was not explicitly aimed at teaching rationality and overcoming biases. (Then again, martial-arts senseis do not teach their skills "explicitly", but by repetition and training.) Moreover, gaining subject-matter expertise took as much of the effort as learning rational thinking processes. But a PhD in a rigorous field from a good university is as close as you'll find to a "color belt" (dare I say "black belt"?) in rationality.

Joshua, the thought had occurred to me, but with all due respect to universities, that's the same sort of training-in-passing that you get from reading "Surely You're Joking, Mr. Feynman" as a kid. It's not systematic, and it's not grounded in the recent advances in cognitive psychology or probability theory. If we continue with the muscle metaphor, then I would say that - if judged by the sole criterion of improving personal skills of rationality - then studying physics is the equivalent of playing tennis. If you actually want to do physics, of course, that's a whole separate issue. But if you want to study rationality, you really have to study rationality; just as if you wanted to study physics it wouldn't do to go off and study psychology instead.

I think you are accepting the advertising hooey of martial arts dojos too much at face value. Most people don't take martial arts for all the abstracted reasons that appear in the brochures, but because they want to feel they can win fights with other people.

Similarly, people don't want to learn how to be rational for the sake of being rational. Instead, you have to sell rationality for more human ends, such as being able to win arguments, or make money, or understand a particular field such as baseball statistics. You can learn a lot of general lessons about rationality from reading Bill James on baseball statistics, but it's not very exciting to study rationality for the sake of being rational.

Steve: Wasn't that the claim of the sophists? "We'll teach you how to win arguments so you can prevail in politics." The problem is that the skills for winning arguments aren't necessarily the schools for rationality in general. Probably the easiest way to learn the skills for winning arguments is to go to law school and "learn to think like a lawyer."

Steve, you're probably right, but I doubt that's really a big obstacle. Rationality has plenty of uses, and if anyone wants to teach it for money, they shouldn't have problems finding ways to promote it, in the long run. Besides, if people want to learn karate to beat people up, why don't dojos advertise based on that?

But I think that the analogy to martial arts is ill-advised for other reasons. Martial arts is a mostly anachronistic practice when evaluated against its original purpose. If you're really serious about self-defense nowadays, you get weapons. (Weapons have always been an advantage, but it's only been for a few hundred years now that they've become such a decisive advantage.)

Where are the tools for giving us a rational advantage? Sure, we have plenty of them for bringing knowledge to us quickly. The internet has been pretty successful at that. But what about other prostheses that specifically target our rational acuity?

Well,

I'll go with the martial arts metaphor, it has at least limited application, and is already the reference point for the discussion. As far as there being no rationality dojos, what about Buddhism, or any other mystic or contemplative path along religious lineages?

As far as measuring rationality or rational skills, the main problem is there is no generally agreed upon Truth or even agreement as to whether Truth even exists. This discussion is not about the actual content of truth per se but about the integrity of the approach to truth. This may be soundly based on the idea that we are only approaching knowledge of truth, but truth itself is still not known. So we cannot measure the soundness as a function of measurable results, since the results are either non-existent,unknown or not agreed upon.

It seems that if this is the case then any form of measurement cannot be objective or externally made, but must be subjective and internally assessed. So the question would become not what is true as fact, but what is true as honest. My vote would be for rational integrity as the context within which skill or understanding would be viewed.

Just as one style of martial arts benefits mainly one area, say the feet, another is totally dedicated to the fists. To measure the growth in each of these forms, there are different 'belts' or levels of mastery based on what you have learned. So perhaps rationality cannot be measured in just one way; the different applications would have to have different levels, just as schools have letter grades on different subjects, and then an overall GPA. Practical usage, such as in the workplace, would have to be 'graded' differently than the same practical usage in a social setting.

Re-reading this brings to mind the history of the Logicians in ancient China. Apparently, they fell out of favor because all that their skills seemed to be good for was winning arguments, and others already had much more effective ways of winning arguments. Advertising rationality as a way to win arguments, as suggested by some of the original commenters, could cause rationality to fall into a similar trap.

I think this problem is avoided by your (later) idea of a Bayesian Conspiracy; if practitioners of beisudo were demonstrably better at the various instrumental tasks they undertook, then that might be enough advertising to attract people to rationality.

I also wonder if cargo-cult rationality would be good or bad. It seems like it could go either way.

I wonder how much of a correlation there is between people who put effort into self-training in rationality (or communal training, a la Less Wrong) and those who actually train a martial art. And I don't mean in the "Now I'lll be able to beat up people Hoo-AH" three-week-course training - I mean real, long-term, long-rewards-curve training. I've done aikido on and off for years (my life's been too hectic to settle down to a single dojo, sadly), and it takes a similar sort of dedication, determination, and self-reflection as a serious foray into training your mind to rationality. And, I'd go so far as to say, a similar 'predilection of mind and preference' (and I'll let you LWers go to town on that one).

Why aren't there dojos that teach rationality?

There is. Buddhist temples in the Himalayas (Bhutan and the neighbouring countries) and remote china. I lived in Bhutan as a child. All buddhist monks lived their lifes' in monasteries; meditating, contemplating, doing the daily chores, in introspection and following the teachings of Buddha. Isn't that a "dojo of rationality"?

How to communicate procedural skills of rationality, or measure them, is probably the single largest open issue that stands between humanity and rationality dojos - at least it's the part of the problem that most baffles me.

Discussion; as is with every other field.

Well, if we have a Bayesian Conspiracy in place, as it were, then I reckon the test would be derivation of hidden knowledge from available priors. This would require that the Conspiracy have access to answers reasoned out ahead of time, and also that the actual testing was kept secret. Perhaps an aspiring rationalist may only be tested once. If we have that strict a measure, though, we might consider allowing a certain amount of leniency... but then again, perhaps only those who strictly adhere to the Art deserve to move further into its ranks.

I am quite aware that my idea is based largely on a post you made about 16 months after this one; in that sense, I'm simply perpetuating a feedback loop, and may be acting in redundancy. But the more I think on this problem, the more convinced I am that it is a Good Idea: test, ceremony, Conspiracy, and all.

Computer games, done properly, could be a good teacher of rationality. If you fail to observe the laws of nature that happen to apply in the game and act accordingly, you die / can't get to the goal. Also, debugging programs has been good for me: plenty of times I could not see an error in my algorithm, but knew there had to be one (modulo system bugs), and so I learned what does and does not constitute valid argument that way. Put these ideas together (games where you have to program things that work in the game universe) and it'd be interesting. Some AI competitions work that way, but we could probably build an iPad app for kids with the right ideas. For example, I'm not talking about teaching basic or some terrible "easy" language. Why not base the programming language of the game off some other Turing-complete system, like, say, cellular automata. The automata rules could change from time to time to keep them guessing. The game could be a sequence of problems: fill in these squares correctly in order to get the desired result and move to the next level. Actually, maybe Markov algorithms would be better. Or a version of the untyped lambda calculus (http://worrydream.com/AlligatorEggs/). Having a good baseline programming "world" is an important part of getting them to think about the right kinds of abstractions.

An AI psychologist would stand the best chance of learning human interactions and rational. An AI in that position could quickly learn how we work and understand things. The programmers would also have a great view of how the AI responds.

As for the Dojo idea, we may now have that with, "luminosity.com", possibly the world's first online mental Dojo. A local Dojo would lack the visibility needed to ensure the correct training was being applied. If it were just local it would be more like theology rather than rational learning.

I try to explore ideas and concepts that put people outside the realm or normality on my site thinkonyourown.com, I've found that challenging people's limits is a fantastic way of exercising the mental muscles.

I was arguing the other day with someone online, and I said to him " I think you're trying to throw me off your scent here... You are cornered, and trying to confuse the issue by claiming I'm arguing for this idea, and you've been arguing against it. "

The truth is, that I had not cornered him. The reason I couldn't corner him was in order to corner someone in a rational debate, they have to allow themselves to become cornered... That is, they have to explain themselves so well, what their thoughts and ideas actually are that they are "nailed down".

If their ideas are valid, from a scientific perspective, then this position of being cornered and nailed down, is actually the position of ultimate strength. It is exactly the opposite of where you would want to be in a physical fight.

What is often done, in an argument with a rationalist, who is trying to be cornered and nailed down, so that he can argue from his position of greatest strength, is that the attacker, knowing that he cannot actually attack the argument being defended, must create a strawman argument.

While this does nothing to the beliefs of the person defending the argument, it does confuse other participants or bystanders in the argument, and may succeed in impugning the integrity of a person defending a true idea... e.g., put him in an illusory box that gives others an excuse not to listen to him.

So, as a rule, one can be more successful in seeking truth, by looking for the participant in the debate who is defending and explaining their own ideas, with an honest desire to be cornered and nailed down. They will not feint, or dodge, but will stand where they are, defending their ground, until such time as they are exposed to a better idea.

What empirical evidence do we have that rationality is trainable like martial arts? How do we measure (change of) rationality skills?

-"Deliberately we decide that we want to seek only the truth; but our brains have hardwired support for rationalizing falsehoods."

Deciding that you want to seek only the truth will not give you the truth. This is because, as you say, our brains have hardwired support for rationalizing falsehoods. What I have found to be a better strategy is self-cooperation. Your mind makes its existence known on several different levels like the vocal, the subvocal but still audible, the purely silent but still internally audible, and eventually laughter and similar responses. Each of these levels has different information about the world, and may be willing to share it with the higher levels as long as it does not end up feeling betrayed. But a naive attitude of "I want the truth!" is exactly what is likely to lead to such a betrayal. To put it another way, if a friend told you a secret and then you immediately went to tell that secret to someone else, would they be likely to continue to trust you after that? Even if you said that you were sharing the secret in the name of "truth"? Self-trust works the same way.

Sounds great. Loving this so far.

I'd recommend to others to keep philosophy of science in mind. Philosophy of biology doesn't have the nicest things to say about evolutionary psychology (at least relative to other scientific disciplines). It's not about throwing evopsych out, it's about understanding its limitations in informing us about human nature.

Also, keep in mind an interesting truth I've noticed: you might feel in some cases that you're "in the truth." But that itself is qualitatively a culture like any other. If you justify a hierarchy based on, say, evopsych, you're not "in the truth", you're in yet another a culture that justifies its inequalities through a story (even if that story is scientific and truthful).

Edit: Adding the Stanford Encyclopedia of Philosophy entry on evolutionary psychology: https://plato.stanford.edu/entries/evolutionary-psychology/

Some of the machinery is optimized for evolutionary selection pressures that run directly counter to our declared goals in using it. Deliberately we decide that we want to seek only the truth; but our brains have hardwired support for rationalizing falsehoods. We can try to compensate for what we choose to regard as flaws of the machinery; but we can’t actually rewire the neural circuitry. Nor may martial artists plate titanium over their bones—not today, at any rate.

While the human brain has evolved for survival, its structure can limit our abstract reasoning abilities. One approach to overcoming these limitations is to differentiate between the learning and practicing phases when acquiring a new skill. Contrary to the common belief that "practice makes perfect," it is essential to understand that practice actually makes skills permanent, not necessarily perfect. By acknowledging this distinction, individuals can focus on perfecting their skills through learning processes, such as the Kolb cycle, before committing to practice for long-term retention and improvement.

The Kolb cycle, a well-established model in experiential learning, offers a four-stage process that includes concrete experience, reflective observation, abstract conceptualization, and active experimentation. By applying this process in the context of reasoning, we can iteratively refine our thought processes and become more adept at bypassing the evolutionary constraints of the brain.

I think that you can have a school for rationality, but the people who stick around should be those who achieve new and difficult accomplishments, and the default is that you do not advance or continue without accomplishing something difficult and great.

I suspect it is easier to teach rationality than to do rationality because it is easier to conceive of an ideal than it is to live it. A great athlete works many hours a day with focus and interest. A coach merely watches and pokes them when they're going off-course, or says some motivating words.

I would start a school by forming a set of teachers, but we would be the certifiers, not the certified. Coaches. Rationality coaches who help you in your journey, not rationality teachers who you aspire to be.