comment by cozy ·
2020-12-28T19:27:28.446Z · LW(p) · GW(p)
Here is the gist: we trust the data as much as we trust the source, regardless of how much the source trusts the data.
Rant incoming, apologies. This is, sadly, not correct from the get-go. In general, besides your example which more closely is attributed to some form of psychological bias, we tend to lend source importance based on the lack of trust from a source. However, that implies there is any source vetting whatsoever.
I am sure there are a number of individuals here who have worked intelligence, and I am lucky enough to have both worked intelligence and ditched intelligence, so I'm not very interested in my NDA.
There is something incredible about being source of raw intelligence to the point where I have trouble trusting anything I do not hear and verify for myself so many years later. This election drove me absolutely insane. Not only for a particular side's tendencies, but everyone's failure at source vetting. Abandon the 'source'. Find out the true source. I ordered 50 year old magazines to double check a transcription. Nice collector's piece, though. The transcription was right btw.
The source itself is not relevant unless you are the collector; then what matters is not how you present it, but who it goes to, and how it goes to them. However, when you are consuming collected intelligence/information, you have to weigh the medium against the data. All information is neccesarily useful, when used correctly, even misinfo. Misinformation and propaganda neccesarily tells the bias of the consumer/creator, and can lead you in trends, since propaganda tends to be single or sparsely-sourced.
For instance: You can get a reasonable understanding of an event minus all the important bits through the news media.
You can get zero understanding of an event, and a great amount of confusion, from social media.
When I read a news article, depending on the importance of the event (ie: Trump signs stimulus bill!), I will go make sure it is consistent across reporters. If it is, it tells me one of two possibilities:
a. The source all the reporters got was similar or the same. Specific details can tell you this quite easily.
b. All the reporters are in league together and conspiring against this particular news item
Since b is highly improbable (aside from the possibility of accidental conspiring, which is completely in realms of possibility), I generally stick with a.
If it's not very important, I don't waste my time. It was probably a waste of time reading the article; news reporters are very droll. Thankfully, they have mastered the art of the thesis statement.
Given my experience with classified info, how can I rate news media's accuracy or otherwise on relevant subjects they have reported on related to my career?
Absolutely awful, and generally mischaracterizing, if not completely libel. They are easily one of the most dangerous groups that can be unleashed on anything that has the word secret anywhere near it. It is really hard to manipulate the media; they would prefer to not report something if it is not potentially breaking. It's why I think the social media conspiracy is a particularly good one; I can completely believe the or a algorithm can be trained to filter out specific posts, because it's not very hard to do, and those posts are very predictable. I absolutely think it's happening. Was there voter fraud? Probably. Who did it? Probably not us. To bet on there being no foreign meddling in the USA's elections is already a lost bet.
Trump referred to this as more secure than Afghanistan's election. Well, we designed that for them. It was so bad, they agreed to just both be president. I wish I was joking. Ghani just bullied the other individual out and he got the title Peace Negotiator. Thankfully, Trump will get no such title.
This sounds unobjectionable on the surface. We tend to equate the reliability of the data with the subjectively perceived trustworthiness of the source of data whenever we have no independent means of checking the veracity of the data. What is lost in this near-automatic logic is one small piece: the credence the source itself assigns to the data.
You have no idea how the source assigns credence to the data. It is easy to obfuscate or lie. Lying happens even with people you trust. Imagine how it goes for everyone you don't care about. Well, we all know.
This all neglects source protections, which aren't as important unclassified. Suffice to say, there is nothing more important than the source itself, yet nothing as completely worthless. The importance lies in not understanding why the source is how it is, but rather in keeping it consistent.
Bad information is just as useful as good, what matters is whether you are cognizant of its quality without too much due effort (given the expiry date on data). That is most characterized by subject matter expertise.
/rantReplies from: shminux
↑ comment by shminux ·
2020-12-28T20:16:28.012Z · LW(p) · GW(p)
I think we are talking about different phenomena here. My point is that, if an average person trusts a source, they tend to assume that the validity of the data are the same as the validity of the source (high!) even if the source themselves takes their own data with the grain of salt, and advises others to do so. You are not an average person by any means, so your approach is different, and much better.
My personal experience with anything published is that it is 50% lie and 50% exaggeration. And yet I still rely on the news to get a picture of something I have no first-hand access to. But that's the usual Gell-Mann amnesia. I am describing something different: forgetting to account of the source's own uncertainty even if it is spelled out (like in the case of potential life artifacts on Venus) or easily queried or checked (e.g. for a stock tip from a trusted source: "how much did you personally invest in it based on your data?").