Individual Deniability, Statistical Honesty
post by Alicorn · 2011-08-09T04:17:19.388Z · LW · GW · Legacy · 8 commentsContents
8 comments
If you have a lot of people to question about something, and they have a motivation to lie, consider this clever use of a six-sided die.
If the farmer tossed the die and got a one, they had to respond "yes" to the surveyor's question. If they got a six, they had to say "no." The rest of the time, they were asked to answer honestly. The die was hidden from the person who was conducting the survey, so they never knew what number the farmer was responding to.
Suddenly, the number of "yes" responses to the leopard question started coming up by more than just one-sixth.
8 comments
Comments sorted by top scores.
comment by Tesseract · 2011-08-09T09:18:06.789Z · LW(p) · GW(p)
The keywords here are "randomized response". There are some interesting variations (from the Wikipedia page):
The sensitive question is worded in two dichotomous alternatives, and chance decides, unknown to the interviewer, which one is to be answered honestly.
Alternative 1: "I have consumed marijuana." Alternative 2: "I have never consumed marijuana." The interviewed are asked to secretly throw a die and answer the first question only if they throw a 6, otherwise the second question.
comment by Tesseract · 2011-08-09T21:06:46.396Z · LW(p) · GW(p)
Also, it occurs to me that this is essentially an application of Bayes' Theorem. In an ordinary survey, the posterior probability (killed leopard|says yes) is 1, which is bad for the farmers, so they lie and therefore decrease the conditional probability (says yes|killed leopard), which is bad for the surveyors. Adding the die roll increases the unconditional probability of saying yes, so that the posterior probability no longer equals the conditional, and they can both get what they want.
comment by MatthewBaker · 2011-08-09T17:18:13.775Z · LW(p) · GW(p)
I cant believe its that simple but in retrospect its obvious.
Replies from: None↑ comment by [deleted] · 2011-08-09T20:00:55.286Z · LW(p) · GW(p)
http://en.wikipedia.org/wiki/Hindsight_bias
Replies from: MatthewBaker↑ comment by MatthewBaker · 2011-08-09T21:13:08.857Z · LW(p) · GW(p)
Agreed :) though i think its more the specific method that's so ingenious. Every anonymous survey ive ever taken has always told me at least 3 times it was anonymous but plausible dependability works so much better in hindsight.
comment by realitygrill · 2012-04-05T05:56:15.674Z · LW(p) · GW(p)
I reinvented this method, except using a coin flip, during an urban economics class. We were going to actually conduct surveys in the Detroit area and thus had to learn about the problems with surveys. However my professor didn't seem very excited and pointed out some incentive shortcomings (I was too disappointed to listen too closely), and I got the impression that this is a known method with known limitations.
comment by MugaSofer · 2013-01-21T16:54:32.069Z · LW(p) · GW(p)
Suddenly, the number of "yes" responses to the leopard question started coming up by more than just one-sixth.
I fear any actual "leopard question" will not be as good as the ones that I imagined on reading that sentence.
Especially as the survey was about poaching in African countries :(