List of arguments for Bayesianism

post by Aryeh Englander (alenglander) · 2024-06-02T19:06:47.474Z · LW · GW · 2 comments

This is a question post.

Contents

  Answers
    7 Radford Neal
None
2 comments

I've been trying to list out for myself the various arguments people give for going with Bayesian (or at least probabilistic) epistemology. Here's what I have so far:

  1. Intuitive representation for degrees of belief: It seems pretty obvious that beliefs come in degrees. Representing degrees of belief as numbers between 0 and 1 that follow probability theory (including Bayes' Theorem) seems intuitively straightforward.
  2. Cox's Theorem: Given some very plausible desiderata for rational thinking with degrees of belief, probability theory (including updating using Bayes' Theorem) follows.
  3. von Neumann - Morgenstern (VNM) Representation Theorem: Any agent following certain very plausible desiderata for rational decision making can be represented as a Bayesian utility maximizer for some (perhaps extremely complicated) utility function.
  4. Dutch Book arguments: Any agent violating Bayesian decision making can be "Dutch booked" with a set of deals that will result in a guaranteed loss for the agent.
  5. Philosophy of science: Many philosophers of science think that science is (ideally) just Bayesian reasoning, in that it is trying to infer the probability that a theory is correct given the evidence. Alternative approaches to philosophy of science (e.g., Popperian falsificationism) have serious problems.
  6. The Bayesian Brain hypothesis: Many cognitive scientists think that biological brains instantiate Bayesian reasoning as one of if not the primary thinking algorithm.
  7. Evidence from superforecasting: Phil Tetlock and colleagues found that the best forecasters use (mostly intuitive versions of) Bayesian reasoning, among other techniques.
  8. Paradoxes: Probabilistic reasoning helps resolve a bunch of philosophical paradoxes related to epistemology (e.g., Lottery Paradox, Preface Paradox, Raven Paradox).

    I'm pretty sure I'm missing some arguments though. What did I leave out?

    (Of course, there are also counterarguments to these given by opponents of Bayesianism, and there is also a long list of arguments people use *against* Bayesianism. But that's for next steps. At the moment I'm just trying to list out arguments people give *for* Bayesianism / Probabilism.)

Answers

answer by Radford Neal · 2024-06-02T21:24:46.771Z · LW(p) · GW(p)

An additional technical reason involves the concept of an "admissible" decision procedure - one which isn't "dominated" by some other decision procedure, which is at least as good in all possible situations and better in some. It turns out that (ignoring a few technical details involving infinities or zero probabilities) the set of admissible decision procedures is the same as the set of Bayesian decision procedures.

However, the real reason for using Bayesian statistical methods is that they work well in practice.  And this is also how one comes to sometimes not use Bayesian methods, because there are problems in which the computations for Bayesian methods are infeasible and/or the intellectual labour in defining a suitable prior is excessive.

2 comments

Comments sorted by top scores.

comment by cubefox · 2024-06-03T19:59:58.847Z · LW(p) · GW(p)

See section 4 here or (shorter) pages 2 to 4 here.

I would also note that your 3 is about decision theory, not narrowly about Bayesianism (either Bayesian epistemology or Bayesian statistics).

comment by Dagon · 2024-06-02T22:21:33.845Z · LW(p) · GW(p)

I may have missed this, but what's the default or alternative?  What are these arguments trying to move someone away from?