Practical rationality questionnaire

There are questions asking us to compare ourselves with populations of other people about whom we are likely to have only limited and unreliable knowledge, to which the answers "about the same, so far as I know" and "of course I have no idea, you silly survey-author" are not available. I think this is unfortunate.

The IQ question is broken in the sense that it doesn't specify the standard deviation people should give their responses in. If someone answers "148" (or any other single number), you have no way of knowing what that actually means. On some tests it is 2 standard deviations above the mean, on others 3 standard deviations, etc.

Nearly all tests in your country may have set the numerical scale in an identical way (I don't know), but there are other scales in use elsewhere.

Good survey, and I like the calibration questions: coming up with good ones is tough. But I suggest the following:

Create an "as happy as other people" for the happiness questions, instead of just "less" or "more"

Define "auto accident" better (I had one that sort of nicked my bumper)

Define "exercise" better (I walk everywhere I go, totalling at least an hour per day, but I don't go to gyms. Does that count?)

In "have you earned more or less than those you grew up with?", include an option for "I am in school" - I think a lot of us are earning less than our peers, but only because we're in some kind of graduate education while they're out making money

Can I go ahead and call a bias? People who earn less, are less happy, or believe they are less successful than their peers are less likely to fill out this survey.

Any progress/news on this?

Good survey. My comments on what could be improved:

"Do most people your age, who live where you live, have a driver's license?" A "I don't know" answer would have been appropriate here. I know many who do have, and some who don't, and loads that I have no idea of. But I ended up answering "no", because I assumed this was meant to control for the good/bad mass transport issue. If that interpretation was correct, I'm not entirely sure that this wording is the best way to control for it.

I had the same issue as Yvain on the "exercise" question.

"Do you plan to sign up for cryonics" could use both "maybe", and a "maybe, if it becomes better available in my country" options.

I found it odd that the "relative to others in your work..." question didn't have an "about average" option.

On the questions where you'll compare yourself to others, I expect that many people will use the "average / similar" replies as a stand-in for "don't know". Might be good to add a "how certain are you of this, on a scale from 1 to 3" subquestion to control for those.

I found it a bit odd that we were asked for "self-help, business, or productivity books", but nothing about other kinds of books.

The calibration questions were good.

A general comments box would be nice at the end to explain some of the end cases. I had to guess at a lot of numbers and gave some word answers to a few. Also, I had to guess at what some of the terms meant. I hope that was okay.

(Note) Take the survey before reading further.

Basic assumptions that I found amusing: questions comparing me to those I grew up with. I was homeschooled, so most of the people I grew up with were family.

It would be nice to list the answers to the confidence questions after the survey was submitted. Now I have to go look them up. :)

All told, interesting questions and I look forward to the results.

Some objections / suggestions from a non-American, not-very-young white nerdy male:

Are you romantically involved with anyone?

I'm married for about 12 years – does this count as a romantic involvement?

How satisfied are you with your current romantic arrangements, or lack of arrangements?

Again, this question should be broadened to include marriages. (Actually, this block of questions could explore more interesting opportunities, such as "What is your ratio of the number of romantic / sexual partners you had before marriage to your self-perceived sexual attractiveness rated 1 to 10?")

How many friends have you talked to in the last week?

Is the purpose of this question to figure out how many friends do I have, or how much actual conversations did I have with my friends? What if I consciously cut back on chit-chat by switching my Skype / ICQ / etc to 'Do not disturb' or not even launching them on start-up?

Edit: Also, do you mean strictly personal friends? Are other kinds of conversation partners included? For example, I don't chat much with personal friends, but have a lot of friendly conversations with co-workers (actually employees) -- does this count?

Have you ever been in an auto accident?

Does this question imply that I was a driver? I don't drive (will explain later), but I have been in an auto accident.

Do you have a current driver's license? Do most people your age, who live where you live, have a driver's license?

Is having a driver license a universally good thing for a person in an environment where everyone else has one?

I don't drive because the traffic accident mortality per million of population in Russia is 2.5 times higher than that of Europe (the Europe has about three times as much cars as Russia, so the per-car number is even more scary). That's an official statistic (which traditionally gets lowered here, as showing real raw stats would ruin the public performance ratings of involved officials), and some sources give greater numbers like 15 to 16 times (which is pretty believable given how much morons and noobs I see on the roads every day).

Some anecdotal data points:

1. Three members of my (extended) family have been involved in traffic accidents that happened due to someone else's disregard for traffic rules. For example, a father of my wife has spent a month in a hospital after being hit by a car while walking through a marked pedestrian crossing on his green light.

2. Every one of my driving co-workers regularly sees high-status people (huge black SUVs with license plates like "A-001-AA") blatantly and openly violating traffic rules and getting away with that.

3. My co-worker has met an illiterate guy in a driving school. Yes, I mean that, the guy was illiterate and innumerate – he couldn't dial a number on a mobile phone!

To sum up, I consider driving in today's Russia to be too dangerous for me. I consciously minimize time I spend in proximity to cars and high-traffic roads, and when I need to get somewhere quick, I contact a tested driver or, if he is busy, my preferred taxi service (for which I also have some criteria).

As for my ability to obtain a driver's license, I could do that easily – my father always was a driver, so I'm familiar with the inner workings of combustion engines since childhood, and my hand-eye coordination is more than enough for driving (I used to dominate the score table in Team Fortress 2 as almost any class until the combined wisdom of Tim Ferris and PJ Eby has eliminated that addiction :).

How many times have you exercised in the last week?

A better definition of 'exercise' would be helpful. For example, does it include long daily walks?

I also found "people I grew up with" strange. Just who these are? Average classmates?