Conspiracy Theorists Aren't Ignorant. They're Bad At Epistemology.

post by omnizoid · 2024-02-28T23:39:39.192Z · LW · GW · 10 comments

Cross-post of my blog article on the topic.  

I probably know less about science than most people who think the earth is flat do.

Okay, that’s not quite true. I have knowledge of lots of claims of science—that the big bang happened, that evolution is true, that the earth is round, etc—that people who think the earth is flat don’t have. But in terms of my knowledge of the science surrounding how one shows the roundness of the earth, I, like most people who think the earth is round, probably know less about it than most people who think the earth is flat.

People are often baffled by the widespread success of conspiracy theories. Among well-educated liberals, for instance, there’s a common attitude that conspiracy theorists are just deeply ignorant about various facts. One might say something like “how do conspiracy theorists believe X when Y.” Yet if one actually talks to a conspiracy theorist, they’ll have something to say about Y—likely something that is hard to refute on the fly.

The problem with conspiracy theorists is not that they’re ignorant of a few basic facts. They often have a shockingly large store of knowledge—just watch a debate with this guy, for example. It’s that they are bad at thinking. They accept improbable theories, largely neglect higher-order evidence, and are bad at judging the plausibility of a view.

There was a guy who would often come to my campus to yell about the earth being flat. I’m sure he could win an argument on that topic with most random people—for he came with real arguments. They were not good arguments, but he had more things to say than most people. The problem with his thinking was not that he was ignorant of a basic fact, but that he thought that positing a global conspiracy with thousands of actors that has somehow been ascertained by disproportionately scientifically illiterate internet sleuths was a better theory than thinking that there is some unknown explanation for apparently strange features of water.

At one point, for instance, he started talking about there being two different kinds of eclipses that only makes sense if the earth is flat. The reason non-conspiracy theorists reject this is not that they have some specialized knowledge about eclipses, but because they accept, based on higher-order evidence, that there’s not some deep hole in our understanding of eclipses that has eluded all the top science journals.

This is why it’s very difficult to argue with conspiracy theorists. They probably know more about the subject than you do—and it’s hard to argue in a debate from higher-order evidence. Mostly the reason not to believe conspiracy theories is that the experts don’t, and it’s likelier you are wrong than that they are.

Yet failure to recognize this fact leads inexorably to people smugly dismissing conspiracy theorists as ignorant rubes. No, they’re not ignorant rubes. They’re bad epistemology rubes. As Scott Alexander says:

When I was a teenager I believed in a conspiracy theory. It was the one Graham Hancock wrote about in Fingerprints Of The Gods, sort of a modern update on the Atlantis story. It went something like this:

Did you know that dozens of civilizations around the world have oddly similar legends about a lost continent that sunk under the waves? The Greeks called it Atlantis; the Aztecs, Atzlan; the Indonesians, Atala.

Various ancient structures and artifacts appear to be older than generally believed. Geologists say that the erosion patterns on the Sphinx prove it must be at least 10,000 years old; some well-known ruins in South America have depictions of animals that have been extinct for at least 10,000 years.

There are vast underwater ruins, pyramids and stuff. We know where they are! You can just learn to scuba dive and go see them! Historians just ignore them, or say they’re probably natural, but if you look at them, they’re obviously not natural.

Teenage me was impressed by these arguments. But he also had some good instincts and wanted to check to see what skeptics had to say in response. Here are what the skeptics had to say:

“Haha, can you believe some people still think there was an Atlantis! Imagine how stupid you would have to be to fall for that scam!”

“There is literally ZERO evidence for Atlantis. The ONLY reason you could ever believe it is because you’re a racist who thinks brown people couldn’t have built civilizations on their own.”

“No mainstream historians believe in any of that. Do you think you’re smarter than all the world’s historians?”

Meanwhile, I learned to scuba dive and checked out a site where Hancock said there were underwater pyramids. They were definitely there!

Nobody was under any obligation to handhold me out of my Atlantis beliefs. But the #1 Google rank for “site about how Atlantis isn’t real” is a scarce resource. Article space on skeptic blogs (podcasts were still years into the dystopian future at this point) was a scarce resource. And when people frittered these scarce resources away on a thousand identical pieces saying “lol you’re stupid and racist if you believe this, haven’t you heard that conspiracies are always wrong?” - and never on any explanation of the GIANT UNDERWATER PYRAMIDS - yes, I feel like I was wronged.

Eventually I lifted myself up by my own bootstraps. I studied some of the relevant history myself (less impressive than it sounds, Wikipedia was just coming into existence around this time). I learned enough about geology to understand on a gut level how natural processes can sometimes produce rocks that are really really artificial-looking - yes, even as artificial-looking as the ones in the picture above.

More important, I learned something like rationality. I learned how to make arguments like the one I use in The Pyramid And The Garden. I realized that, for all their skill at finding anomalies, the Atlantis books couldn’t agree on a coherent narrative of their own. Some placed Atlantis in the Atlantic, others in the Pacific, others in Antarctica; some used it to explain artifacts from long after others said that it fell. For a while if I squinted I could sort of kind of smush them into a single story, but that story had even more anomalies than normal historians’. Eventually I gave up and joined the mainstream.

I’m not angry at Graham Hancock. I see no evidence he has ever been anything but a weird, well-meaning guy who likes pyramids a little too much. But I feel a burning anger against anti-conspiracy bloggers, anti-conspiracy podcasters, and everyone else who wrote “lol imagine how stupid you would have to be to believe in Atlantis” style articles.

Either these people didn’t understand the arguments for and against Atlantis, or they did. If they didn’t, they were frauds, claiming expertise in a subject they knew nothing about. If they did, then at any moment they could have saved me from a five year wild-goose-chase - but chose not to, because it was more fun to insult me.

This is very right! The reason I reject the Atlantis theory is not that I have some specific explanation of all the stories about lost continents, but it’s that I estimate the probability of there being some explanation out there as quite high.

Yet people have this hubristic notion that they know more than the conspiracy theorists, that they’d never fall for a conspiracy theory because they can do basic googling. This is not true. The reason most people reject conspiracy theories is that they are conformists—they just believe things that sound normal. This is a pretty good heuristic for forming true beliefs—if smart people mostly think your belief is crazy then it probably is. But it’s a huge mistake to think that you have identified the specific object-level reasons most conspiracy theories are wrong.

Not only does this hubris lead to people like Scott getting trapped believing in conspiracy theories for decades, it makes it so that when people end up debating conspiracy theorists, they get crushed. A recent hilarious example was a debate between YouTuber Tom Jump and Ryan Dawson. Dawson thinks that the Israeli and U.S. governments were intimately involved in 9/11.

Mr. Jump seemed to think it was a good idea to go into a debate with a guy who has been obsessively looking over a topic for 20 years with no prep. As a result, he was completely trounced, even though his position was probably correct. He didn’t appreciate the difficulty of arguing with a conspiracy theorist on the facts.

Conspiracy theories are mostly improbable. But arguing with them on the object level—haggling over the details of what happened on 9/11, for instance—is very difficult and requires a truly vast array of knowledge. The average person cannot do it, and the idea that conspiracy theorists are just ignorant of basic facts is a delusion that people cling in order to feel superior. The truth is, most conspiracy theorists probably know more about the topics that they discuss than you do.

 

 


 

10 comments

Comments sorted by top scores.

comment by romeostevensit · 2024-02-29T02:57:39.666Z · LW(p) · GW(p)

Conspiracy theories are a bad reference class due to the lumping together of real actions by nation-states with crackpot schizophrenic fantasies. This was intentional and you shouldn't buy into it.

comment by Ape in the coat · 2024-02-29T10:44:09.676Z · LW(p) · GW(p)

I've been planning to write a post around the same lines. Well done.

Due to a historically terrible name, people assume that conspiracy theories are about the existence of conspiracies. That everything that supposes that there may be a conspiracy - is a conspiracy theory. This makes such reference class extremely unhelpful. There have always been actual conspiracies. People lie and plot and conceal information. We can't put all the actual examples of conspiracies in the same category as Flat Earth and treat the whole category as a priory implausiable.

What conspiracy theories are actually about, the core flawed belief that unifies them all, and distincts them from valid hypothesises about the world is, what I call "conspiracy epistemology". Though maybe "minority epistemology" or even anti-epistemology would be a better term. This is the idea that the most of evidence about a cause is falsified and so we should give preference to a small minority of the counter evidence. ANd of course to explain how such falsification took place there have to be invoked a conspiracy that did it, but it's a symptom. Such belief is deeply anti-epistemological for obvious reasons. It's easier to faslsify the minority of evidence than the majority of it. Every attempt of forgery leaves some traces, more evidence to be discovered than can reveal the whole plot. Lie once and truth will forever become your enemy.

Most actual conspiracies actively propagate such minority anti-epistemology. They find or forge some minor amount of evidence in theor favour and then claim that everything else is not trustworthy, replacing the whole institutional mechanisms of human civilization that are supposed to catch lies with just themselves.

comment by CronoDAS · 2024-02-29T01:32:12.875Z · LW(p) · GW(p)

As Mark Twain supposedly once said: it's not what you don't know that gets you into trouble, it's what you know that just ain't so!

comment by CronoDAS · 2024-02-29T01:30:03.357Z · LW(p) · GW(p)

This is exactly why I often don't look at object level arguments. If I don't have an actual subject matter expert on hand, an argument based on unrefuted bullshit and blatant lies will seem just as plausible as one based on the actual truth. So I just nod, say "Yes, that sounds convincing, but I don't know enough to be able to tell if there's something wrong with it, so you'll have to take it up with the mainstream if you want me to believe you.

comment by StartAtTheEnd · 2024-02-29T13:27:37.059Z · LW(p) · GW(p)

I don't think talking about "conspiracy theories" as a category is very useful. Some have already been proven true, others are obviously wrong, and some are even satire which got taken seriously.

"The earth is hollow" and "The government is listening in on our phone-calls" have both been rather common theories, but I don't think it's fair to compare them. Depending on your view on conspiracies, you could argue that people who believe in the Covid lab theory are as crazy as flat-earthers, or reversely, that because MK Ultra happened, we should take the idea of lizardmen seriously.

This argument doesn't conflict with the post very much, only a little bit. I've been called "conspiracy theorist" before for saying things which definitely happened, and which aren't even burried or censored in any way, and I reject the idea that I'm "bad at epistemology" because I paid attention to the Snowden files. (I'm not saying that you will claim this about me, but it's a common false-positive which results when "conspiracy theories" are made equal, and when any skepticism is assumed to be skizophrenia rather than competence)

comment by Sabiola (bbleeker) · 2024-02-29T09:15:09.442Z · LW(p) · GW(p)

See also https://iai.tv/articles/misinformation-is-the-symptom-not-the-disease-daniel-walliams-auid-2690:
"Nevertheless, the model of misinformation as a societal disease often gets things backwards. In many cases, false or misleading information is better viewed as a symptom of societal pathologies such as institutional distrust, political sectarianism, and anti-establishment worldviews. When that is true, censorship and other interventions designed to debunk or prebunk misinformation are unlikely to be very effective and might even exacerbate the problems they aim to address.

To begin with, the central intuition driving the modern misinformation panic is that people—specifically other people—are gullible and hence easily infected by bad ideas. This intuition is wrong. A large body of scientific research demonstrates that people possess sophisticated cognitive mechanisms of epistemic vigilance with which they evaluate information.

If anything, these mechanisms make people pig-headed, not credulous, predisposing them to reject information at odds with their pre-existing beliefs. Undervaluing other people’s opinions, they cling to their own perspective on the world and often dismiss the claims advanced by others. Persuasion is therefore extremely difficult and even intense propaganda campaigns and advertising efforts routinely have minimal effects."

Replies from: Richard_Kennaway
comment by Richard_Kennaway · 2024-02-29T13:47:27.934Z · LW(p) · GW(p)

"...In many cases, false or misleading information is better viewed as a symptom of societal pathologies such as institutional distrust, political sectarianism, and anti-establishment worldviews.

Perhaps, in many cases, these "societal pathologies" are better viewed as symptoms of deeper pathologies, such as untrustworthy institutions, mainstream parties acting as sects competing for power, and corrupt establishment worldviews.

Replies from: bbleeker
comment by Sabiola (bbleeker) · 2024-02-29T14:57:29.222Z · LW(p) · GW(p)

Yes, exactly. From a bit later in the article:

"The causes of this distrust are complex and diverse. They include psychological traits that predispose some people towards paranoid worldviews; institutional failures, such as telling noble lies to manage public behaviour and dismissing legitimate ideas as conspiracy theories; and feelings—often justified—of exclusion from positions of power and influence."

comment by CronoDAS · 2024-02-29T19:41:43.934Z · LW(p) · GW(p)

Many of the alleged "conspiracies" that literal conspiracy theories propose are highly improbable. The more people involved in a secret conspiracy, the more likely it is for someone to leak the secret, either deliberately or accidentally. In order to maintain a conspiracy, it either has to be very small ("three can keep a secret, if two are dead"), or it has to be the case that most people, if they learned the secret, would agree that it should be kept secret; it has to be something closer to a Benevolent Conspiracy instead of an evil one.

One of the most successful large-scale "conspiracies" in recent history was the Manhattan Project, and it was able to be kept secret mostly because anyone who did learn about it would, by default, want to keep the secret. If you picked Americans at random until you found someone who would be willing to betray the Manhattan Project to the Axis powers, you'd have to go through a hell of a lot of people before you found one; despite the large number of people involved, nobody told the Germans or the Japanese. On the other hand, if you picked Americans at random and asked them if it should be kept secret from our allies in the Soviet Union, the percentage of people who would disagree would be much higher - and someone actually did leak the details to the Soviet Union.

comment by Vladimir_Nesov · 2024-02-29T14:28:51.260Z · LW(p) · GW(p)

Refuting something wrong in only useful when there are identifiable failures of local validity (which often only makes it stronger). Refuting something as a whole in better thought of as offering an alternative frame that doesn't particularly interact with the "refuted" frame. The key obstruction is unwillingness to contradict yourself, to separately study ideas that are clearly inconsistent with each other, without taking a side in the contradiction in the context of studying either point of view.

So a flat Earth theory might have a particular problem worth talking about, and hashing out the problem is liable to make a stronger flat Earth theory. Or the "refutation" is not about the flat Earth theory, it's instead an explanation of a non-flat Earth theory that's not at all a refutation, its subject matter is completely separate. The difficulty is when flat Earth conviction prevents a person from curious engagement with non-flat Earth details.