Investigating Fabrication

post by LoganStrohl (BrienneYudkowsky) · 2023-05-18T17:46:52.783Z · LW · GW · 14 comments

Contents

  1. Motivation
  2. Approach
  3. Lab Work, Part 1
    Finally, there is a feeling like a dungeon wall falling away to reveal a sunny meadow, which, if I watch closely enough, has some kind of stuttering dream-like quality to it. It’s as though I had to fall asleep, or trip through a magical door, or slip somehow, before I could experience it. But the d...
  4. Lab Work, Part 2
  5. Field Work, Part 1
    painting—or, perhaps i should say "fabrication", because this i think is the precise cognitive activity at the heart of "fabricated options"—has a characteristic *lightness*. there is no inertia. there is no resistance, no need for exertion or endurance. there is only dream-like ease. it's like gymn...
  6. Field Work, Part 2
  7. No Conclusion; Current Direction
    My main conclusion so far from my dalliance with fabricated options is that fabrication is a response to feeling trapped. That’s where it comes from, and what it’s made of. It’s a strategy for getting out of a too-tight possibility space, and its downfall is the way it moves only in imagination with...
  Appendix
None
14 comments

Note 1: This was originally published in 2021. I'm now re-publishing it in 2023 as the penultimate post in The Nuts and Bolts Of Naturalism [? · GW], as a demonstration of the method. I intend to publish a collection of much-more-complete demonstrations in the future, and I plan for them to explicitly discuss each step as I've described it in the sequence. For now, though, I hope that this partial demo will give you a taste of one way the overall process can go.

(For a similarly partial demo by someone other than me, check out "Maps of Maps, and Empty Expectations [LW · GW]" by Nora Ammann.)

Note 2: This essay was written in response to “Lies, Damn Lies, and Fabricated Options [LW · GW]”. I expect it’ll be pretty confusing to read this one without having read that one first. However, I’m not the boss of you, and it isn’t obvious to me anyway which reading order is best overall. If prolonged confusion makes you grumpy, I recommend reading Duncan’s essay first. But if you try it backwards, I’d love to hear how that goes.

---

1. Motivation

When I read Duncan's essay "Lies, Damn Lies, and Fabricated Options [LW · GW]," it seemed to me to point toward something that's worth knowing for real, rather than just worth knowing about.

I think it does a good job of helping the reader build a new concept that could conceivably be taken as a hypothesis in important situations. The hypothesis is, “Perhaps this thing that seems to me like an option isn’t really a possibility, and it only seems like one because I’m in the grips of a map/territory conflation.” (Or, at least, “Perhaps the person I’m arguing with thinks their made-up option is real because [etc.].”)

But I wasn’t satisfied with my new concept “fabricated options”. There were some super important questions that I’d need to answer before I could put it to use.

For instance, 

• Which situations are the crucial ones for promoting this hypothesis to attention?
• How do I actually move my mind to recognize that the option I’m considering might be fabricated?
• Once I’ve posed the hypothesis, how do I confirm or deny it?
• When I’ve successfully identified a fabricated option, how can I prevent the usual harm?
• And, my favorite: How can I stop making this kind of mistake in the first place?

So I set out to investigate option fabrication (the act), and what my brain is up to in the moments just before a fabricated option appears. I hoped that if I could learn where fabricated options come from, and what they are made of, I’d be a long way toward answering many of the practical questions on my list.

---

2. Approach

I did naturalism [? · GW] to this. (One of the reasons this essay felt worth writing and sharing is to give people more chances to see what naturalism looks like in practice.)

I assumed that there's sometimes A Thing Going On in my brain that in some ways resembles what Duncan called "fabricated options", and that my default understanding of the Thing is worse than I'd prefer. I set out to observe the Thing myself, directly and in real time, and to gradually build my own understanding of whatever I found. I tried to observe the Thing both in the "field" (as it occurs naturally in the course of daily life) and in the "lab" (as it occurs when I deliberately create controllable conditions that might give rise to it).

This was not a full naturalist study (which usually takes at least a month), but was instead a "let's see what comes of a week or two" dalliance. Still, it turned out to follow the arc of a mostly complete study: Sensitization, zooming in, zooming out, and experimentation. [ETA: Though I used different terms here, these correspond to Locating Fulcrum Experiences [? · GW], Getting Your Eyes On [? · GW], Collection [? · GW], and Experimentation [? · GW].]

---

3. Lab Work, Part 1

In accordance with the “try it immediately” heuristic, I started out with a relatively lab-like exercise right after reading the essay. I asked myself, "What is it like to fabricate options?" and in a search for relevant data, I began to scan my recent memories for "options" I might have "fabricated".

Multiple topics came to mind right away. One of them was “top surgery”, which I was scheduled to have in just a few days.

A thought occurred to me; it was one I've had before (it felt familiar as it arose), though it wasn't one I’d examined closely, or tried to put into words. I tried this time, though, with extra attention:

"Here's what I will do. I will have top surgery, but I’ll skip all those awful parts with pain and anesthesia drugs and so forth. I’ll just push a button, and my boobs will be gone. Simple.”

Although this was pretty clearly an instance of a “fabricated option”, I was at this point less interested in the thought itself, and more interested in what led me to turn my attention toward "top surgery" in the first place. What caused me to (correctly) expect to find The Thing there? I wanted to know in what directions I should open my introspective sense if I want to pick up more information about fabricated options. What properties does “top surgery” have that mark it as the natural habitat of the “fabricated options” creature I would like to study?

The “boob elimination button” thought was one I seemed to recreate frequently as I considered “top surgery”, so I had several opportunities to observe the conditions that gave rise to it. Here’s what always preceded it:

When I thought about top surgery, I felt good things, and I also felt bad things. As I imagined having a masculine chest and never having breasts again, I felt good. As I imagined going through surgery and recovering from it, I felt bad. And when my attention fell on the fact that I had scheduled top surgery, that it was in my future by default, I began to do and feel something I call “trying to squirm out from under the problem”.

“Trying to squirm out from under the problem” felt like this: 

When I thought about top surgery, it was like finding that something hard and heavy was on top of me. I did not like being under the hard heavy thing, and I didn’t know how to lift it. I was getting squished. It was uncomfortable under there, so I squirmed: I pushed up on this part of it with this hand, and that part of it with that foot, and I wriggled and writhed and tried to work myself out sideways. 

That’s what it felt like, in my body and my emotions.

The thoughts that happened while I was squirming went like this: 

Top surgery is scheduled? Ugh, I don’t like it. 

Maybe I could cancel top surgery? No, that doesn’t work, because then I’d keep having boobs. 

How about I go through with top surgery then? No, that’s no good either, because then I’d have to experience surgery and recovery. 

Well, let’s see… Maybe… Maybe I could cancel top surgery? 

*sigh* Still no, for the same reasons as last time.

I watched this pattern with multiple other topics, too, and it went almost exactly the same way with each of them, always with the same feelings of being trapped, squirming, and repeatedly hitting walls. The general form:

Well, [problem]. I don't like it.

I guess I could [option]? No, because [cost].

How about [second option]? No not that either.

Well maybe [the first thing again]? Still no.

I go through this cycle a few times, and as I do, it’s as though I’m banging my head, elbows, and knees against the walls of a much-too-small space. Inevitably, though, I at some point have a thought that goes,

What if [good parts of first option, and good parts of second option], but not [bad parts of either option]?

In the moments leading up to this new kind of thought, I usually feel frustration, restlessness, and desperation. There’s a bright flash of a moment that I want to label, “FINE!”, as shouted by someone stamping their foot or slamming a door. Then there is a “grasping” and a “stitching”, as I weave together “just the good things” and “without the bad ones”. 

Finally, there is a feeling like a dungeon wall falling away to reveal a sunny meadow, which, if I watch closely enough, has some kind of stuttering dream-like quality to it. It’s as though I had to fall asleep, or trip through a magical door, or slip somehow, before I could experience it. But the dreaminess is quiet, and it’s largely drowned out by relief (if only briefly).

Another thought I found by searching for a prolonged squirming feeling was, “I know! What I will do is, I will experience winter, with snow and Christmas and all of that, and instead of getting depressed like usual, this time I just won't get depressed!” 

---

4. Lab Work, Part 2

The other thing I did right after reading Duncan’s essay was order a gyroscope. Three days later, I played with it.

The main question I was investigating was, "What exactly is it like to imagine a gyroscope that's not weird?" 

This turned out to be a bit of a wrong question. Not wrong in the sense that I should have focused my attention on a different question instead; but wrong in the sense that I was employing some nonsensical concepts while asking it.

I tried very carefully to "imagine a gyroscope that's not weird". And what I found is that I'm not capable of imagining a gyroscope. Or an apple, or anything else. Not in the way I naively tend to think.

What I can do is conjure a blurry round-ish image and label it "spinning disk". I can conjure a crisp, bright tactile sensation of a sharp pressure on my finger and call it "where the gyroscope balances". I can conjure the sensations I'd expect to feel while tilting my wrist as my hand grasps a gyroscope, and I can imagine the pressure changing just as it would if I were holding a ball, or a phone, or a non-spinning gyroscope.

And if I'm not very slow and careful, it turns out, I can conclude from this imagining that some gyroscopes behave like solid objects even while their disks are spinning. Because hey, I've got a gyroscope in my imagination right now, and it's not being weird at all!

Only, I don’t have a gyroscope in my imagination.

It turns out that my brain is confused about imagination. 

It conjures visual images and textures and stuff, things that resemble "a gyroscope" or "an apple" or "the way my mother drives a car". It conjures them in order to manipulate them, to see what would happen under various circumstances. “What if I threw an apple at the wall?” I imagine doing so, and the thing I'm imagining goes thud-smoosh as it bounces off the other thing I’m imagining. This is most of how I predict stuff.

The problem is, my brain sort of thinks that when it manipulates a shiny red fruit-smelling object in imagination, what it's manipulating is an apple.

What it's really manipulating is part of itself, its own expectations and associations and so forth. When I use my own expectations to answer a question like, "What if I threw an apple at the wall?", of course the answer I get from imagination is whatever I already expected.

If my expectations are wrong, how will my imagination discover my error? It might let me discover my error by showing me that I have two conflicting expectations, which could give me space to ask whether one of them is wronger than the other (or something). Which is why it’s often worthwhile to deliberately investigate my expectations. This is (part of) what's going on when people change their mind when asked to bet, or when they do CFAR-style Murphyjitsu.

But imagination won't let me check a single expectation by itself, because it's taking that expectation as input. It's expectation working with expectation. My imagination is going to play along with itself. Even if I expect to notice some kind of contradiction, and cause myself to imagine that I've noticed the expectation being broken in some way, that brokenness isn't necessarily going to correspond to anything in the territory. I can tell my brain to see how a fantasy is a fantasy, and it's going to succeed, but that success will be another fantasy.

Reality, by contrast, resists individual mistaken expectations, and it does so lawfully.

Noticing the total lack of any feeling of resistance is what turned out to be so important about this session with the gyroscope. Whatever thing I was doing as I attempted to “imagine a gyroscope, but not weird” was full of ease, at least after I skipped over the question of what exactly the thing in my imagination was made of. The experience was full of effortlessness. It was full of “of course” and “simple” and “just”.

And the particular flavor of ease I found here was similar to the “open meadow” from before, the way I could slide into planning for “just the good things, without the bad”. It’s like shifting a car into neutral. There’s a tiny skip, and then all the resistance is gone.

---

5. Field Work, Part 1

By "field work," what I mean is that rather than engineering experiences specifically for the purpose of trying to investigate The Thing ("fabricated options," or whatever it is), I instead went about my day hoping to run into The Thing in a more natural, unplanned way. I hoped to encounter the phenomenon in its natural habitat, so to speak. 

Based on my early lab work, I made some guesses about what I might see or feel if my brain was just about to start doing The Thing, or had just done The Thing, or if I might be near The Thing in some other way. Whenever I ran into something that made me think I might benefit from paying extra attention, I snapped my fingers and took a moment to check what was going on in my thoughts and in my environment. Sometimes, I made a note in my phone to record my observations for later review.

I snapped my fingers many times. Each time, I updated a little bit about how I would know, next time, that this is among the experiences I’m watching for. I started with the squirming-out-from-under-a-problem feeling, but the longer I watched myself thinking and feeling in daily life, the more a sensation of discontinuity in imagination seemed like the bright shining landmark indicating that “the important thing about fabricated options lives here”.

“Discontinuity in imagination” wore a few different phenomenological guises.

One was “sliding”, like slipping down a wet hill over a patch of algae. I’d be imagining something, then I’d imagine the next part of the thing, and in between I did not so much “concretely imagine” as “slide” or “slip over”.

Sometimes it felt like “skipping” or “tripping”, catching my shoe on a root and falling blankly for a moment before resuming my gait as before.

Sometimes it felt like a hollowness, or an empty space. In fact, in most cases where I took the time to watch closely after snapping my fingers, I discovered an emptiness behind some kind of superficial imagining. Something like a facade.

I happen to have recorded my thoughts in a log entry as I observed an experience that involved both hollow-facade-ness and sliding. Here's an excerpt that goes into detail on that experience, with apologies for its length; this is optimized for me talking to myself more than for being nice to readers.

i can easily ask myself, "what's the fairy tale fantasy world thing you want here?" and it's an obvious question, a question that completely fits the feeling of this mental space, and the answer is also obvious: i want to stay up late relaxing and fucking around and acting like i have all the time in the world and not trying to do anything in particular at all, and i also want to wake up in the morning refreshed awake alive alert enthusiastic. what i want is for there to be an additional six hours tonight, just inserted between the usual hours of 22:00 and 23:00.

there's a click when i describe the extra hours. there's even a flow or a gravity toward filling in the details. the clock would say "22:59", then it would say "22:60", then "22:61", and it would just keep going like that until "22:419". 

the filling in of details responds somewhat to little concerns i have, hints that something is wrong: after imagining "22:419", i feel a tug, and when i follow the tug i think about "other people". i try out a couple of things. "maybe they're all asleep and they don't notice?" but no, many of them are still awake. i try again: "a time bubble. there's a bubble around just my room where six extra hours happen tonight." and as i think that, there's a relaxation, and then a part of me that's watching all of this is laughing as though at a puppy trying to carry a too-long stick through a narrow doorway.

it's very interesting, though, this relaxation after "time bubble". it's actually a space bubble, right? it's a bubble of space in which time is different, whatever that might mean. my calling it a time bubble hilights how not-even-a-concept this is. it's like an Old West movie set with just the fronts of the buildings and nothing behind them. i can't describe the architecture of the time bubble because it's not even a building.

yet the facade is convincing enough that some part of me reacts as though it's arrived in town and now it can drink the last of the water in its canteen because there's obviously a saloon right there on the corner. "it's ok, there's a time bubble. let's move on to the next question."

what's that like from the inside? it's like painting, and also like pong. a concern hurtles toward the fantasy of "six extra hours", and in response to it i throw some paint up on just the right part of the canvas to block it. there aren't any details yet, but that's ok, because i only need to block the concern on the surface, i only need to convince it to turn away. “what about other people? time bubble!” and if the concern doesn't immediately turn away, that's also all right, because i have no shortage of paint. the more time i spend thinking about it, the more detail i can imagine.

and perhaps the most interesting thing, here, is the way that this sort of imagining feels like discovery. answers like this come from the depths of the association network, from the source of lateral thinking and mnemonic skill. it's not slow deliberate reasoned thought whose pieces you can easily see. the feeling of discovery is accurate, in that i'm discovering how my mind is shaped.

but if i watch closely, there's a sliding. i feel the "discovery", and i sneakily, slippingly infer that i'm discovering the shape of the external world. i slip-slidingly infer that i'm learning about how time bubbles work.

discovering the external world feels different. knowing what feels different in discovering the external world vs discovering the shape of your own association network may be the way to recognize that you are painting in response to the pong balls, rather than noticing when the pong balls bounce off of pre-existing walls.

painting—or, perhaps i should say "fabrication", because this i think is the precise cognitive activity at the heart of "fabricated options"—has a characteristic *lightness*. there is no inertia. there is no resistance, no need for exertion or endurance. there is only dream-like ease. it's like gymnastics in super low gravity. it's like Minecraft in creative mode. it's like casting "accio solution" in the Harry Potter universe and watching things fly across the room right into your hands.

---

6. Field Work, Part 2

Here are some other times when I snapped my fingers.

How about I eat the chocolate chip cookie but not the calories?

This one’s classic. I tried to combine the good parts of two options while leaving out the bad. The fabrication revealed itself most memorably in the way it felt to answer my own probing questions: 

How will I avoid eating the calories? 

They’ll leak out first.

How will I cause this leaking?

I’ll break the cookie in half.

What do calories look like as they leak out?

Little golden musical notes.

This had the easy, automatic quality of facade-painting I’d identified before. “Accio solution!”

My toes should not touch each other. 

I caught a hint of “confused imagining” while wearing regular socks instead of toe socks. I usually wear toe socks because I don’t like my toes touching each other. 

It took me a while to figure out why “my toes touching” caused me to snap my fingers (I'm deliberately loose/generous with the finger-snapping rather than limiting myself to finger-snaps I already know I can justify), but I did eventually zero in on it. I was trying to force my toes not to stick together by imagining (incessantly) that although they touched, the skin experienced no friction. (“See, world? Here’s an existence proof, right here in my imagination. Update!”)

There was a blankness and a tripping-over feeling between “imagining toes touching” and “imagining no friction between them”. If you’d asked me, “How is there no friction?” I wouldn’t have been able to immediately respond with something like “the skin lacks texture”. I was skipping over that part. I would only have given you, “I don’t know how there’s no friction, there just isn’t!”

It’s not a central example of a “fabricated option”, but it’s the same mental patterns played out at a pretty low sensory level. I suspect that many instances of “frustrated should” involve something like this.

“I’ll just be fine.”

This was the first time that what I’ve so far learned from this study seemed to assert itself and cause a substantially different outcome from the default.

I was in San Francisco on my way to a doctor's appointment. There were a lot of sounds. The parking garage elevator said "Eeerrrrr! Eeerrrrr! Eeerrrrr!" in a terribly grating voice. The cars whooshed and honked. The crowds of strangers shouted to each other. It was all horribly chaotic and unfamiliar. I could feel myself closing off internally, contracting as though preparing to huddle down into a ball on the floor in some concrete corner.

But I had a mission. Not only did I want to make it to the appointment, but I wanted to talk with the doctor, to ask him questions and to understand what he said.

There was a moment of gathering forces. A moment of forcefully moving the outer shell of my mind into a strong protective shape. And with the gathering, I started to say to myself, as though declaring or proclaiming, "I'll just be fine." I began to decide that instead of being overwhelmed, I would "just" "be fine".

I say "began", because I didn't get very far.

I noticed something that indicated an instance of this thing I've been studying. It wasn't the word "just" that stood out, even though that could have tipped me off. 

Instead, it was the discontinuity. There was a feeling like tripping over uneven flagstones. It came from the way the outer shell of my mind had shifted, without more central parts having followed. It was a feeling that reminded me of "pulling one over on myself".

I paused, to pay attention to what was happening. 

I checked whether I really believed I could "just be fine", and the answer was "sort of". I knew that I definitely could do something with my mind that would allow me to walk through the city, and get all the way through my appointment, while barely even noticing my own distress, let alone exhibiting it outwardly. I could do something that would allow me to cross the street safely, to ask the questions that mattered, and to understand the responses.

The facade I'd begun to paint, though, left out a crucial component of this "deciding to be fine": the price. The neurotypical mask is heavy, and there is always a price for wearing it. I pay in exhaustion and future dysregulation.

I did actually decide to pay that price, in this case. But the decision I ended up making was "pay the price for 'being fine'". “Just be fine" was never a real option.

---

7. No Conclusion; Current Direction

The question I was left with, after the experience in San Francisco, was "Why did I try to deceive myself like this in the first place?"

If I hadn't caught myself in the middle of fabricating an option, I would still have paid the price for "being fine" in downtown San Francisco. I would even have paid a higher price than necessary, because I would have been relatively profligate with my masking, instead of having turned my conscious attention to the tradeoffs. So what was the point of fabrication?

I’m not sure yet, but I have a pretty confident guess.

I was already terribly overwhelmed when this happened, and I was desperate for a way out. Desperate enough that I was willing to hallucinate a temporary escape. The hallucination couldn't actually cause me to escape the situation, but it could let that one desperate time slice experience a piece of relief.

My main conclusion so far from my dalliance with fabricated options is that fabrication is a response to feeling trapped. That’s where it comes from, and what it’s made of. It’s a strategy for getting out of a too-tight possibility space, and its downfall is the way it moves only in imagination without staying in touch with the real world.

I suspect that if I'm going to get things right around "fabricated options" in the long run, I will need a handful of alternative strategies to directly address the sources of the distress. My brain engages in fabrication for a reason. If I want it to do something different, I’ll need to address that reason in some other way. The causal need isn't just [LW · GW] going to stop being a causal need.

I would bet that the most successful alternative strategies will be space-making.  Things like:

• bother to fully notice that I’m uncomfortable
• take three breaths
• find one way to reduce input
• do one fewer thing at a time
• reprioritize
• name one simple innocuous thing nobody can stop me from doing, then do it (e.g. “spin around”)
• ask for help
• lower the stakes

If I find myself making up fake options to escape the bind I seem to be in, I think it’s likely I’ve focused so much of my attention on that one particular bind that I’m no longer aware of the ways I’m not trapped. If I make myself more aware of the spaces through which I am free to move, I might find I’m less desperate to hallucinate an escape, and more comfortable with patiently investigating the true shape of the world.

---

Appendix [LW(p) · GW(p)]

14 comments

Comments sorted by top scores.