The impossibility of rationally analyzing partisan news

post by RationalDino · 2023-11-16T16:19:50.485Z · LW · GW · 4 comments

This is a response to Thinking About Filtered Evidence Is (Very!) Hard [LW · GW] that I thought deserved to be its own post.

The post said that it lacked a practical/interesting failure-case for Bayes' Law. Here is a case that is both practical and interesting.

Suppose that we have a variety of sources, divided into two camps. Each camp wishes to persuade us to their point of view. Each source within each camp has a different, unknown to us, amount of reliability. Critically, if we are persuaded by either camp, we will find most of the sources in that camp believable. And most in the other camp to be not believable.

We further know that each camp does contain reliable sources who are accurately reporting on filtered versions of the same underlying reality. We just don't know how common that is on either side.

This is hopefully recognizable as a description of trying to reconstruct the world from partisan news sources of varying quality. That makes it practical. I'll make it interesting by asserting some key facts about it.

1. Our set of beliefs in this scenario form a Bayesian network. (Straight from the definition.)
2. Correctly updating a Bayesian network after a single observation is an NP-complete problem. See "The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks".
3. Approximately updating a Bayesian network after a single observation to determine beliefs to any accuracy below 50% is ALSO NP complete. That is, one observation can be the difference between being confident that A is true to being confident that B is true. And it is computationally intractable to find which observation should do it. See On the hardness of approximate reasoning.
4. This particular network, where we flip from one set of reinforcing beliefs to the other set of reinforcing beliefs, is of the kind that demonstrates this exact type of numerical intractability.
5. Additionally sources may make statements of mathematical fact. Perhaps encoded as, say, a statement about economics. Thereby making updates computationally impossible as well as numerically intractable.

The result? It is both numerically intractable, and occasionally computationally impossible, to maintain rational opinions about what's true when your information comes filtered through partisan news networks.

Any struggles we have with cognitive biases come on top of that basic impossibility result.

4 comments

Comments sorted by top scores.