What can thought-experiments do?

post by Cleo Nardo (strawberry calm) · 2023-01-17T00:35:17.074Z · LW · GW · 3 comments

Contents

  Introduction
  What counts as a decision-theoretic difference?
  1. Bob's Secret Third Option
  2. Real life is particular, but the hypothetical is universal.
  Conclusion and further work.
None
3 comments

Introduction

What's the difference between actually being in a situation and just thinking about the situation? In other words, what's the difference between a real-life ethical dilemma and a hypothetical ethical dilemma?

There are many differences.

• Some differences are phenomenological. A real-life dilemma feels very different from a hypothetical dilemma.
• Some differences are decision-theoretic. For example, the action-space of the real-life dilemma isn't isomorphic to the action-space of the hypothetical dilemma.
• Some differences are cognitive. There are particular cognitive processes/algorithms that can be used to solve real-life dilemmas that can't be used to solve hypothetical dilemmas. And vice-versa.
• Some differences are social. The social norms governing real-life dilemmas differ from those governing hypothetical dilemmas.
• E.t.c, e.t.c.

In this post, I'll discuss two decision-theoretic differences, and I'll reach this conclusion:

For almost every real-life dilemma, there will not exist a hypothetical dilemma which has the same decision-theoretic properties as the real-life dilemma.

In subsequent posts, I might discuss other differences, and I expect to reach these conclusions:

• Many people underestimate the difference between hypothetical dilemmas and real-life dilemmas.
• Often people should replace thinking about hypothetical dilemmas with thinking about corresponding real-life dilemmas (especially for ethics, decision theory, and LessWrong).

What counts as a decision-theoretic difference?

A good hypothetical dilemma should capture all the decision-theoretic properties of the real-life dilemma. Here's what I mean:

Suppose Alice is faced with a real-life dilemma — she sees a child drowning in a pond, but saving the child would ruin her expensive shoes. So Alice has two options: save the child, or leave the child.

And suppose Bob is faced with the corresponding hypothetical dilemma: "you see a child drowning, but saving the child would ruin your expensive shoes." Bob has two options: hypothetically save the child, or hypothetically leave the child.

This is a faithful hypothetical dilemma if and only if Bob's decision is decision-theoretically equivalent to Alice's. In formal terms, there must exist an order-preserving isomorphism between Alice's options and Bob's options.

But this is rarely the case. I'll' explain two ways that Bob's decision differs from Alice's.

1. Bob's Secret Third Option

Firstly, there is a secret third option open to Bob which isn't open to Alice — namely, disengaging from the hypothetical. Here's the difference between Alice's and Bob's dilemmas:

• Alice has two options: (A1) save the child, or (A2) leave the child.
• Bob has three options: (B1) hypothetically save the child, (B2) hypothetically leave the child, or (B3) cease hypothesising anything.

Alice is faced with a real-life dilemma, so she must make a decision between A1 and A2. This "must" is a physical necessity — Alice must make a decision in the same way that she must have a mass.

Bob is faced with a hypothetical dilemma, but he doesn't actually need to make a hypothetical decision (i.e. pick B1 or B2). It's physically possible for Bob to pick B3, even though that would violate the rules of the game.

Of course, we might tell Bob "you must make a decision!". But this "must" isn't a physical necessity — instead, it's a ludic necessity (where "ludic" means "related to games"). In other words, Bob must make a hypothetical decision in the same way that a chess player must move the bishop along diagonal squares. It's physically possible, but not ludically possible, to move the bishop along orthogonal squares.

Is Bob's secret third option decision-theoretically relevant? I think so.

Both of Alice's options are harmful — in A1 her shoes are ruined and in A2 a child dies. She picks the least harmful option, which presumably will be A1. This is the option most people would pick without much hesitation.

But which option is best for Bob? B1 causes "psychic harm" by imagining one's shoes ruined. B2 causes "psychic harm" by imagining a child dying. And B3 causes social harm by violating the rules-of-the-game. Now, the psychic harm of B1 is pretty mild, so Bob will probably pick B1. But there are hypothetical ethical dilemmas where B3 is better than both B1 and B2. This is often the case when the hypothetical dilemma is between two really bad options, such as a trade-off between sacred values.

I think B3 is a very common move. What does B3 look like in practice?

• Bob might question various presuppositions, even if he wouldn't question those presuppositions in more convenient contexts.
• Bob might query the meaning of certain words, even if he wouldn't query the meaning of those words in more convenient contexts.
• Bob might claim "we shouldn't engage in hypotheticals", even if he engages in hypotheticals in more convenient contexts.

If someone picks B3 but you want them to pick a proper hypothetical option, then you should try to make the dilemma real! This is especially useful if the "someone" is yourself. Does this mean actually drowning a child in a pond? Kind of. It means considering a situation in your own life which already has the appropriate form of the hypothetical dilemma. Instead of considering the question "should I hypothetically save a hypothetical child at the hypothetical cost of my hypothetical shoes?", Bob should instead consider the question "should I actually save an actual child at the actual cost of my actual shoes?"

(Of course, sometimes the hypothetical dilemma has no real-life equivalent, and the hypothetical can't be actualised without severe negative externalities. In these cases, a hypothetical might be the next best thing.)

2. Real life is particular, but the hypothetical is universal.

There's a second important decision-theoretic difference between real-life dilemmas and hypothetical dilemmas: the real-life dilemma is particular, but the hypothetical is (by design) universal.

Alice's dilemma is about a particular situation $s$. She's watching a particular child drown (the $s$-child) and she is wearing a particular pair of shoes (her $s$-shoes). Whether she saves the child (A1) or leaves the child (A2), then that will be a particular event. There's only one configuration of atoms conforming to Alice's situation $s$.

But Bob's dilemma isn't about a particular situation, but rather it's about a universal situation. This universal is a set of situations $T$. Note that there are quintillions of configurations of atoms conforming to $T$. This is because Bob's brain is finite, so his imagination can only pin down a small amount of information about the situation. This problem doesn't face Alice because her environment contains the remaining information required to pin down her exact situation.

How is that difference decision-theoretically relevant? Let me explain.

When Alice picks either A1 or A2, she is determining what transpires in her particular situation $s$. But there are also other situations $s^{\prime }$ which are very similar to $s$ (maybe the atoms are configured slightly differently), and what transpires in $s^{\prime }$ is heavily correlated with what transpires in $s$. So Alice is also determining whether the children in these slightly different situations are saved or not.

Compare this with Bob. When Bob picks either B1 or B2, he is determining what transpires in the hypothetical situation $T$. There are many situations $t$ which are elements of the set $T$. What transpires in the situations $t$ is slightly correlated with Bob's hypothetical decision. And what transpires in situations $t^{\prime }$ is also slightly correlated with Bob's hypothetical decision, where $t^{\prime }\notin T$ is a situation which is very similar to $t\in T$. 

So we can see a difference between Alice's and Bob's decisions: Alice will heavily influence a small number of situations. Bob will weakly influence a large number of situations.

Normally, when you add up all the influences, the real-life decision is more influential than the hypothetical decision. But in some cases, the hypothetical decision is more influential than the real-life decision.

Is there a trick to circumvent this problem?

Well, there are two kinds of problems with hypothetical dilemmas.

1. The hypothetical is too influential.
2. The hypothetical isn't influential enough.

Maybe the hypothetical is too influential — Bob's hypothetical decision will pathologically influence the decisions of his parallel selves. In this case, Bob should make the dilemma more particular. If there exists a similar dilemma in his actual life, he should focus on that. Or if there are no negative externalities to actualising the dilemma, then he should do that. Or if there's a historic example, then he should consider that one. This way the hypothetical situation $T$ will cover fewer situations.

Maybe the hypothetical isn't influential enough — Bob's hypothetical decision will fail to influence the decisions of his parallel selves. In this case, Bob should make the dilemma more universal. This way the hypothetical situation $T$ will cover more situations. Moreover, he should commit more strongly to his hypothetical decision, which increases the correlation between his hypothetical decision and the outcomes in those situations.

Conclusion and further work.

I think that these two decision-theoretical differences establish that hypothetical dilemmas and real-life dilemmas are quite different. You should be careful not to conflate them. I might explore some other differences in later posts.

3 comments

Comments sorted by top scores.