Clever arguers give weak evidence, not zero

post by dkl9 · 2023-07-18T17:07:27.126Z · LW · GW · 2 comments

This is a link post for https://dkl9.net/essays/clever_arguer.html

Contents

2 comments

Followup to: The Bottom Line [LW · GW]

We are warned that an argument made with a predecided conclusion does not evidentially entangle with the truth it claims to address, and thus is no evidence of that claim.

Recall that observation  is evidence for hypothesis  iff . What do the variables mean here?

What the commentary from "The Bottom Line" leaves out is that making a convincing argument is a nontrivial task. For many false claims, a clever arguer with ordinary resources cannot make a convincing argument. If it's typically easy to make a convincing argument for something false, you're convinced by the wrong things.

Thus , in this case, would usually be greater than . An argument for a claim from a clever arguer only clearly proves that the arguer wanted us to believe it. A convincing argument for a claim — and if the argument isn't convincing, you'd ignore it — proves that the claim has convincing arguments for it accessible to that level of arguer, which is correlated with the claim being true.

But maybe I decided at the start that clever arguments for predecided conclusions are actual evidence, thereby breaking the entanglement of the rest of this essay. Well, are you convinced anyway?

2 comments

Comments sorted by top scores.

comment by localdeity · 2023-07-18T17:25:51.437Z · LW(p) · GW(p)

Given that someone is being a clever arguer, the evidence of their argument may be taken to be evidence about the conclusion relative to what you might have expected they could come up with.

If a "clever arguer" says "Ten witnesses, named [...], all report seeing Bob murder Joe, and there are also multiple security cameras that caught it", then that's pretty damn strong evidence (assuming one follows up with the witnesses and gets the footage).

If a "clever arguer" says "Bob once got into a fight in middle school, so we see he has violent tendencies", and that's the best he managed to come up with, then it probably makes sense to update away from the conclusion that Bob murdered Joe.

Zvi has written about things of this ilk, vaguely connected to "bounded distrust [LW · GW]".  I'll see if I can find a link... Ok, this is a decent example [LW · GW] of the general principle, although the counterparty isn't a "clever arguer":

Then we need to consider what we saw relative to what we expected to see. In general, no news is good news. If ‘nothing happens’ regarding Omicron, that continuously makes us less worried, whereas most news will make us more worried. Getting a constant string of bad news is expected, but how much of it did we get, how fast and how bad?

[...]

The person linking to this ["Gauteng hospitalizations" going up rapidly] thought it was bad news, but given the rate at which cases are increasing, it looks to me like good news. Not easy to interpret, but the hospitalization rate per infection is what matters here. Note also that positive test rate is now >20%, which means a higher percentage of cases are being missed than before.

comment by Dagon · 2023-07-19T16:33:41.609Z · LW(p) · GW(p)

The comment at the bottom there is important:

This is intended as a caution for your own thinking, not a Fully General Counterargument against conclusions you don’t like.

It's a very lossy model to account for the arguer more than the arguments.  It's valid and important to remember that most fact aggregators are selective in what they say, with biases that don't match the underlying truth (which they often don't have access to either).  But it's not intended to be a formal literal "zero evidence".  It's intended only as a reminder not to take the arguments at face value.

Note that in the example EY used, it IS literally zero evidence - the clever arguer doesn't actually have any additional access to truth, or any evidence that the observer doesn't already have.  In this case, your inequality is false - there's no difference between H and ~H in terms of probability of E.