TAG's Shortform

post by TAG · 2020-08-13T09:30:22.058Z · LW · GW · 17 comments

Contents

18 comments

17 comments

Comments sorted by top scores.

comment by TAG · 2021-10-21T16:21:22.975Z · LW(p) · GW(p)

"Politics is the mind-killer" is a special case of "tribalism is the mind killer".

comment by TAG · 2023-05-17T13:37:30.599Z · LW(p) · GW(p)

"– it’s not as though epistemic rationality can be traded off for gains in instrumental rationality. Only apparently, and to think one should do this is a trap."

Has this been proven, anywhere?

comment by TAG · 2020-08-13T09:30:22.526Z · LW(p) · GW(p)
  1. It’s impossible to reach that world from ours, it’s entirely causally disconnected, and
  1. That world “really exists

That's exactly what decoherent many worlds asserts!

Replies from: Dagon
comment by Dagon · 2020-08-13T17:02:26.933Z · LW(p) · GW(p)

"really exists" is insufficient to affect decisions, though. Two more assertions must be made

3. That world is a valid moral target, which I care about. (Debatable. Stipulated for this purpose.)

4. That world is sufficiently different from my causally-reachable light-cone that I should behave differently than I would if I only cared about "my" world.

#4 is the tricky one IMO. Maybe it is, but how could I know how it differs or what decisions I should make differently?

Replies from: TAG
comment by TAG · 2020-08-13T17:37:37.694Z · LW(p) · GW(p)

Many worlds strongly implies that you make all possible decisions, so it undermines the very basis of decision theory -- you have no freedom to perform one act while refraining from another.

Replies from: rhollerith_dot_com, Viliam, mikkel-wilson
comment by RHollerith (rhollerith_dot_com) · 2023-05-20T14:00:47.423Z · LW(p) · GW(p)

Many worlds strongly implies that you make all possible decisions

It would imply that only if every decision I make is the result of a "quantum measurement", which is not the case.

In fact, any organism that can reason (maintain a model of its environment or express any preference for one outcome over another) cannot make all its decisions that way because such a decision cannot increase the mutual information between the environment and the organism's preferences, the necessity of which is explained in Eliezer's 2007 blog post What is evidence? [LW · GW]

In other words, a quantum measurement splits the universe into 2 branches, but in both branches, the organism has no information about its environment that it did not have before the split, so quantum measurements cannot be the only kind of decisions made by the organism.

Let us get concrete. Many-world physics tells us that the universe will split many times while a computation is running on my computer. Suppose I use my computer to factor a large integer. It is not a consequence of many-world physics that there is another branch of the universe in which the computation resulted in a different answer, i.e., different prime factors. Moreover, if there is another branch that gets a different answer, then any competent computer scientist who has taken the time to examine my computer and the factorization program in sufficient detail (even one who does not believe in many-worlds physics) will conclude that there is a bug in one or the other: a sufficiently-well-designed computer and factorization program will get the same answer in every one of the thousands of branches that exist at the end of the computation -- and designing computers and programs sufficiently well is not beyond the capabilities of people living right now -- at least for simple programming tasks like factoring integers.

Replies from: TAG
comment by TAG · 2023-05-21T17:26:54.586Z · LW(p) · GW(p)

Ok, a programme is decfacto deterministic: it must do whatever it can do, even though that is only one thing.

But what's the reason to think the brain is deterministic?

In fact, any organism that can reason (maintain a model of its environment or express any preference for one outcome over another) cannot make all its decisions that way because such a decision cannot increase the mutual information between the environment and the organism’s preferences, the necessity of which is explained in Eliezer’s 2007 blog post What is evidence?

Any decision made any way will.increase the mutual information between the organism and it's environment because the consequences of the decision will become part of the environment.

In any case, EY wasn't describing how decision making must occur, or how belief formation must occur, but how belief formationshould occur.

Replies from: rhollerith_dot_com
comment by RHollerith (rhollerith_dot_com) · 2023-05-24T17:23:05.478Z · LW(p) · GW(p)

Any decision made any way will increase the mutual information between the organism and its environment because the consequences of the decision will become part of the environment.

If I make a "quantum measurement" (the kind of thing that routinely causes the world to split, e.g., measuring the spin of an electron) then I receive one bit of information, namely, which branch I ended up in. Information is conserved; I only received one bit of information; one entire bit is required to indicate which branch I ended up in; consequently, I must have learned nothing about the original unsplit world. Do you see now?

EY wasn’t describing how decision making must occur, or how belief formation must occur, but how belief formation should occur.

There's a joke patterned after an old TV commercial (about seatbelt wearing) of the 1960s or 1970s: "Gravity: it's not just a good idea; it's the the law". The same thing is true about Eliezer post "What is evidence?": namely, for any organism or system to use beliefs to maintain homeostasis, to survive or to steer reality at all requires mutual information between the organism and its environment. It is not just a good idea.

Replies from: TAG
comment by TAG · 2023-05-24T17:38:56.661Z · LW(p) · GW(p)

I see that you didn't learn anything about the pre-split world, but I don't see why that matters. Again, the epistemic rule that you can only learn from evidence that is causally related to the thing it is evidence of....doesn't obviously apply to action. Learning has a world->mind arrow, action has a mind->world arrow.

The same thing is true about Eliezer post “What is evidence?”: namely, for any organism or system to use beliefs to maintain homeostasis, to survive or to steer reality at all requires mutual information between the organism and its environment.

Again, action does not destroy mutual information. If an indetrministic event occurs, you gain at least subjective infuriation about it. If the event happens to be your own undetermined decision...the same applies. If your decision was determined, no objective information is gained or lost. If your decision was predictable to yourself, no sujective information is gained or lost.

comment by Viliam · 2020-08-17T15:37:56.876Z · LW(p) · GW(p)

Saying "in many worlds you make all possible decisions" is technically true, but it is important to add that some actions happen with large probabilities, and some of them happen with microscopic probabilities. That doesn't undermine decision theory; you can still use it to do the right thing with 99.9999% probability.

(Unless you believe in a version of "many worlds" that says that everything happens with the same measure, which is not what physicists believe. If that was true, then quantum computers would be useless for any purpose other than generating perfectly random numbers.)

(And if your objection is that you can't make "decisions" when the atoms in your brain are following the laws of physics, then 1. this is unrelated to quantum or classical physics, and 2. yes you can, this is exactly how evolution designed us by selecting for configurations of atoms that were more likely than random to do the right thing.)

Replies from: TAG, rhollerith_dot_com
comment by TAG · 2020-08-17T16:06:53.134Z · LW(p) · GW(p)

That doesn’t undermine decision theory; you can still use it to do the right thing with 99.9999% probability.

If it's possible to use decision theory in a deterministic universe, then MWI doesnt make things worse except by removing refraining. However, the role of decision theory in a deterministic universe is pretty unclear, since you can't freely decide to use it to make a better decision than the one you would have made anyway.

(And if your objection is that you can’t make “decisions” when the atoms in your brain are following the laws of physics, then 1. this is unrelated to quantum or classical physics,

Deterministic physics excludes free choice. Physics doesn't.

Replies from: max-kaye
comment by Max Kaye (max-kaye) · 2020-08-31T04:35:23.708Z · LW(p) · GW(p)

If it's possible to use decision theory in a deterministic universe, then MWI doesnt make things worse except by removing refraining. However, the role of decision theory in a deterministic universe is pretty unclear, since you can't freely decide to use it to make a better decision than the one you would have made anyway.

[...]

Deterministic physics excluded free choice. Physics doesn't.

MWI is deterministic over the multiverse, not per-universe.

Replies from: TAG
comment by TAG · 2023-05-17T16:29:31.171Z · LW(p) · GW(p)

Yes, and it still precludes free choice, like single universe determinism, as well as precluding refraining

comment by MikkW (mikkel-wilson) · 2020-08-14T03:19:06.587Z · LW(p) · GW(p)

I feel this misses the mark

The probability density of an agent (e.g. person) operating under a given decision theory (realistically, with a given set of internal causal gears) making a certain decision varies from potential decision to potenial decision. So, although every possible decision has non-zero probability density of happening, there are meaningful differences in frequency between various actions

Replies from: TAG
comment by TAG · 2020-08-14T10:05:51.631Z · LW(p) · GW(p)

But MW is deterministic. Under single universe determinism, you can't actually choose to perform an action you would not have performed. (Decision theory is either a step in the process or irrelevant). What MWI adds to that inability is a further inability to refrain. If MWI allowed freely willed agents to change the measures of their actions, then they could lower the measures of the less favoured ones...but it doesn't.

Replies from: mikkel-wilson
comment by MikkW (mikkel-wilson) · 2020-08-14T22:10:57.588Z · LW(p) · GW(p)

Probability is still a well-defined concept, even in a deterministic many worlds model

Replies from: TAG
comment by TAG · 2020-08-15T10:01:56.673Z · LW(p) · GW(p)

And you still can't refrain.