Anthropic signature: strange anti-correlations

post by Stuart_Armstrong · 2014-10-21T16:59:11.282Z · LW · GW · Legacy · 26 comments

Contents

26 comments

Imagine that the only way that civilization could be destroyed was by a large pandemic that occurred at the same time as a large recession, so that governments and other organisations were too weakened to address the pandemic properly.

Then if we looked at the past, as observers in a non-destroyed civilization, what would we expect to see? We could see years with no pandemics or no recessions; we could see mild pandemics, mild recessions, or combinations of the two; we could see large pandemics with no or mild recessions; or we could see large recessions with no or mild pandemics. We wouldn't see large pandemics combined with large recessions, as that would have caused us to never come into existence. These are the only things ruled out by anthropic effects.

Assume that pandemics and recessions are independent (at least, in any given year) in terms of "objective" (non-anthropic) probabilities. Then what would we see? We would see that pandemics and recessions appear to be independent when either of them are of small intensity. But as the intensity rose, they would start to become anti-correlated, with a large version of one completely precluding a large version of the other.

The effect is even clearer if we have a probabilistic relation between pandemics, recessions and extinction (something like: extinction risk proportional to product of recession size times pandemic size). Then we would see an anti-correlation rising smoothly with intensity.

Thus one way of looking for anthropic effects in humanity's past is to look for different classes of incidents that are uncorrelated at small magnitude, and anti-correlated at large magnitudes. More generally, to look for different classes of incidents where the correlation changes at different magnitudes - without any obvious reasons. Than might be the signature of an anthropic disaster we missed - or rather, that missed us.

26 comments

Comments sorted by top scores.

comment by Arenamontanus · 2014-10-21T19:44:00.570Z · LW(p) · GW(p)

Neat. The minimal example would be if each risk had 50% chance of happening: then the observable correlation coefficient would be -0.5 (not -1, since there is 1/3 chance to get neither risk). If the chance of no disaster happening is N/(N+2), then the correlation will be -1/(N+1).

It is interesting to note that many insurance copula methods are used to make size-dependent correlations, but these are nearly always of the type of stronger positive correlations in the tail. This suggests - unsurprisingly - that insurance does not encounter much anthropic risk.

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-21T19:49:11.873Z · LW(p) · GW(p)

When I read this, my first reaction was "I have to show this comment to Anders" ^_^

Replies from: Arenamontanus
comment by Arenamontanus · 2014-10-21T23:53:43.899Z · LW(p) · GW(p)

It is pretty cute. I did a few Matlab runs with power-law distributed hazards, and the effect holds up well: http://aleph.se/andart2/uncategorized/anthropic-negatives/

comment by gwern · 2014-10-21T19:15:09.347Z · LW(p) · GW(p)

The effect is even clearer if we have a probabilistic relation between pandemics, recessions and extinction (something like: extinction risk proportional to product of recession size times pandemic size). Then we would see an anti-correlation rising smoothly with intensity.

So something like the plot of asteroid impact sizes vs time in "The Anthropic Shadow" where the upper-right corner is empty?

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-21T19:34:25.198Z · LW(p) · GW(p)

Similar in that one quadrant is empty, otherwise a distinct effect.

Replies from: Arenamontanus
comment by Arenamontanus · 2014-10-23T00:50:01.113Z · LW(p) · GW(p)

This is incidentally another way of explaining the effect. Consider the standard diagram of the joint probability density and how it relates to correlation. Now take a bite out of the upper right corner of big X and big Y events: unless the joint density started in a really strange shape this will tend to make the correlation negative.

Replies from: Sarunas
comment by Sarunas · 2014-10-23T19:08:44.658Z · LW(p) · GW(p)

This is known as Berkson's paradox and it is ubiquitous. A lot of people have written about it and its implications, e.g. Yvain (underlying reasons why anti-correlations arise are very similar).

comment by Dr_Manhattan · 2014-10-24T22:00:56.620Z · LW(p) · GW(p)

Should we be expecting people who could have hastened AGI to die before their time?

comment by witzvo · 2014-10-27T05:07:42.662Z · LW(p) · GW(p)

Interesting. Something's a bit odd, though. If the events are rare, then it's hard to know what the correlations are with any precision. If the events are common, then, yes, we should be able to see the anti-correlation, but this would be a really bad sign -- there'd be no reason to think that the disastrous event where both co-occur isn't right around the corner.

ETA: I exaggerate a bit. There'd be no reason if the independence model was true. If, in reality, there was some circumstance specially protecting us somehow the situation wouldn't have to be dire.

comment by Cyan · 2014-10-22T03:50:15.549Z · LW(p) · GW(p)

In the biz we call this selection bias. The most fun example of this is the tale of Abraham Wald and the Surviving Bombers.

Replies from: othercriteria
comment by othercriteria · 2014-10-23T05:47:59.043Z · LW(p) · GW(p)

While maybe not essential, the "anti-" aspect of the correlations induced by anthropic selection bias at least seems important. Obviously, the appropriate changes of variables can make any particular correlation go either positive or negative. But when the events all measure the same sort of thing (e.g., flooding in 2014, flooding in 2015, etc.), the selection bias seems like it would manifest as anti-correlation. Stretching an analogy beyond its breaking point, I can imagine these strange anti-correlations inducing something like anti-ferromagnetism.

comment by avturchin · 2024-11-17T23:14:44.571Z · LW(p) · GW(p)

There is a strange correlation between paradox of young Sun (it had lower luminosity) and stable Earth temperature which was provided by higher greenhouse effect. As sun goes brighter, CO2 declined. It was even analyses as evidence of anthropic effects. 

 



In his article "The Anthropic Principle in Cosmology and Geology" [Shcherbitsky, 1999], A. S. Shcherbakov thoroughly examines the anthropic principle's effect using the historical dynamics of Earth's atmosphere as an example. He writes: "It is known that geological evolution proceeds within an oscillatory regime. Its extreme points correspond to two states, known as the 'hot planet' and 'white planet'... The 'hot planet' situation occurs when large volumes of gaseous components, primarily carbon dioxide, are released from Earth's mantle...

As calculations show, the gradual evaporation of ocean water just 10 meters deep can create such greenhouse conditions that water begins to boil. This process continues without additional heat input. The endpoint of this process is the boiling away of the oceans, with near-surface temperatures and pressures rising to hundreds of atmospheres and degrees... Geological evidence indicates that Earth has four times come very close to total glaciation. An equal number of times, it has stopped short of ocean evaporation. Why did neither occur? There seems to be no common and unified saving cause. Instead, each time reveals a single and always unique circumstance. It is precisely when attempting to explain these that geological texts begin to show familiar phrases like '...extremely low probability,' 'if this geological factor had varied by a small fraction,' etc...

In the fundamental monograph 'History of the Atmosphere' [Budyko, 1985], there is discussion of an inexplicable correlation between three phenomena: solar activity rhythms, mantle degassing stages, and the evolution of life. 'The correspondence between atmospheric physicochemical regime fluctuations and biosphere development needs can only be explained by random coordination of direction and speed of unrelated processes - solar evolution and Earth's evolution. Since the probability of such coordination is exceptionally small, this leads to the conclusion about the exceptional rarity of life (especially its higher forms) in the Universe.'"

comment by diegocaleiro · 2014-10-25T23:36:08.197Z · LW(p) · GW(p)

Great Post.

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-27T12:14:49.105Z · LW(p) · GW(p)

I value objective feedback like that ;-)

comment by NancyLebovitz · 2014-10-22T16:31:13.632Z · LW(p) · GW(p)

You should probably include war as another resource-depleting event which amplifies the effects of an epidemic.

Replies from: Nornagest
comment by Nornagest · 2014-10-24T22:12:30.049Z · LW(p) · GW(p)

War also has a way of throwing lots of stressed people together under unsanitary conditions. Soldiers, refugees, people in bomb shelters, etc.

The canonical example of a war coinciding with a pandemic is probably the 1918 Spanish Flu, which killed more people than WWI did.

comment by owencb · 2014-10-23T11:56:34.326Z · LW(p) · GW(p)

This is nice in principle, although I'm not sure if there's much chance of finding enough events to observe a real effect.

It might be easier to detect a positive correlation on small events that goes missing on larger ones?

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-23T12:03:46.713Z · LW(p) · GW(p)

That could also work.

comment by juked07 · 2014-10-22T10:12:04.308Z · LW(p) · GW(p)

Should the first blurb begin "Imagine that civilization would definitely be destroyed by" instead of "Imagine that the only way that civilization could be destroyed was by"? That's what it seems like to me based on the second blurb.

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-22T12:10:34.565Z · LW(p) · GW(p)

It's easier to reason with a single cause of destruction: see http://lesswrong.com/lw/hw8/caught_in_the_glare_of_two_anthropic_shadows/

Replies from: juked07
comment by juked07 · 2014-10-23T01:11:50.758Z · LW(p) · GW(p)

Then maybe "Imagine that civilization would definitely be destroyed iff there was a..."?

The rest of the post still reads to me as if pandemic + recession is sufficient, not just necessary, for implying extinction. To be explicit, it sounds like you have ruled out the possibility of observing pandemic + recession + non-extinction, I would have thought you'd want to say that pandemic + recession = extinction, rather than the weaker statement that extinction requires pandemic + recession.

Replies from: Stuart_Armstrong
comment by Stuart_Armstrong · 2014-10-23T09:15:43.008Z · LW(p) · GW(p)

Go with iff for that example.

comment by TheAncientGeek · 2014-10-21T19:04:08.954Z · LW(p) · GW(p)

Would resources have been of use in fighting pandemics before modern medicine?

Replies from: Stuart_Armstrong, bramflakes, gwern
comment by Stuart_Armstrong · 2014-10-21T19:33:55.051Z · LW(p) · GW(p)

The pandemic/recession example is almost certainly wrong; it was just an illustration of the concept.

comment by bramflakes · 2014-10-22T10:27:30.965Z · LW(p) · GW(p)

Yes, resources let you have an organized, strong state, which is vital to enforce quarantines. Milan and Venice managed almost completely to shield themselves from the Black Death through stringent isolation of the sick.

comment by gwern · 2014-10-21T19:13:59.920Z · LW(p) · GW(p)

Sure. You can supply food and water and other forms of palliative care (if you don't have food and water, Ebola might kill you but thirst & starvation definitely will kill you), and resources can be used to enforce quarantines like posting watchmen to sealed-up houses or soldiers to bottlenecks.