Math. proof of the superiority of independent guesses?

post by Milton · 2020-07-19T02:38:39.725Z · LW · GW · 5 comments

This is a question post.

Contents

  Answers
    2 Davidmanheim
None
5 comments

Alice, Bob, Chris, Dana and Erica have set out to guess the number of candies in a glas jar just by looking at it. How do I mathematically show that the average guess will come closer to the real number if they guess independently, i.e without Bob hearing Alice's guess, Chris hearing Alice's and Bob's guess and so on?

And finally, I'm pretty confident I've read about this on LessWrong before, but I can't seem to find the specific post. Can anyone help me recollect?

Answers

answer by Davidmanheim · 2020-07-19T13:59:07.256Z · LW(p) · GW(p)

If the guesses are unbiased, the law of large numbers can be used to show this:

https://en.wikipedia.org/wiki/Law_of_large_numbers

(If you look at the proof, you can see where the independence assumption comes in.)

comment by Milton · 2020-07-19T14:45:27.488Z · LW(p) · GW(p)

Thanks!

5 comments

Comments sorted by top scores.

comment by Pattern · 2020-07-19T21:55:46.747Z · LW(p) · GW(p)

How do I mathematically show that the average guess will come closer to the real number if they guess independently, i.e without Bob hearing Alice's guess, Chris hearing Alice's and Bob's guess and so on?

Things like that can't be illustrated about the real world directly, i.e., just with math.

But if people's guesses are clustered around the number, then the average will be close to the number on account of the errors being in both directions (not biased). Maybe there's risk associated with "anchoring", but I haven't heard about it being a risk in that particular setup before.*

There was a setup involving a wheel with numbers written on it being spun, and then people being asked how many countries there are in the world.

*Usually the effectiveness of averaging guesses that way is demonstrated by having a lot of people write their guess down on a piece of paper.

 

the specific post.

Sounds like the Sequences, stuff about entropy, probability distributions, or biases.

Replies from: Milton
comment by Milton · 2020-07-21T09:34:44.584Z · LW(p) · GW(p)

Thanks! And sorry for being such a noob.

Concerning "anchoring", do you know where I can go to read more?

Replies from: Pattern
comment by Pattern · 2020-07-21T16:22:20.080Z · LW(p) · GW(p)

(I don't know the state of the research with regards to replication.)

 

Asking this question in the right subreddit might turn up better results from people up to date on where the field is today.

 

If you're interested in the research at the time the sequences was done, here's the bibliography, which might include what you're looking for (I've heard it's not complete overall, but there's 5 things that came up searching that page for "anchoring"):

https://www.readthesequences.com/Bibliography

That is old research (I think it's all from well before 2000*), and as for where things are at now, I'm not sure. I turned up this literature review (2011):

http://www.communicationcache.com/uploads/1/0/8/8/10887248/a_literature_review_of_the_anchoring_effect.pdf

 

*Some of the same stuff is covered on Wikipedia: Anchoring (Cognitive Bias):

In another study by Tversky and Kahneman, participants observed a roulette wheel that was predetermined to stop on either 10 or 65. Participants were then asked to guess the percentage of the United Nations that were African nations. Participants whose wheel stopped on 10 guessed lower values (25% on average) than participants whose wheel stopped at 65 (45% on average).[3] The pattern has held in other experiments for a wide variety of different subjects of estimation.

[Emphasis added - looking up those researchers might be a good source, if you're interested in the start of the field.]

There's more on Wikipedia, but that link in the quote above seems to be from a study published in 1974. https://arxiv.org/ doesn't have a paywall, but doesn't seem to have a category for psychology or biases. 

Replies from: Milton
comment by Milton · 2020-07-23T11:21:20.927Z · LW(p) · GW(p)

Thanks again!

I guess what I'm pointing to is that it might be individually rational to update on previous guesses (perhaps this could be called "deliberate anchoring"?), whilst it might not be group rational.

Replies from: Pattern
comment by Pattern · 2020-07-23T15:11:21.270Z · LW(p) · GW(p)

The relevant post sounds like "Hold off on proposing solutions".