Brass Puppet

abramdemski

Brass Puppet

post by abramdemski · 2022-05-26T17:42:04.876Z · LW · GW · 4 comments

5 comments

fanfic/riff of Glass Puppet [LW · GW] by lsusr

Alia got out of the Uber at Overton Cybernetics, taking in the corporate atmosphere. There was a huge jungle gym in the lobby, which she immediately decided must be typical of these LA tech places. She told the front desk that she had an interview. "Oh! Dominic Hamilton wants to see you personally." The receptionist said it like it was a big deal. Alia simply nodded, trying to act like the sort of person who met with bigshots all the time.

The job had asked for an actor with AI alignment experience. An extremely unusual combination, which Alia just happened to qualify for.

The receptionist showed her to Dominic's office.

"Mr. Hamilton" She said politely, offering her hand to shake.

"Dominic. Please." he replied, putting a pair of glasses in her hand instead. "Put them on." They looked a bit like the old Google Glass.

When she first put them on, she saw a strange symbol flash across the screen, which oddly relaxed her. Then the glasses say sit. She sits. fold your hands and she does.

"What is your name?" Dominic asks. "Zoe" flashes on the screen, and she repeats it. Dominic nodded, as if this confirms something.

Is this the job? Is she just going to be repeating lines that are fed to her?

"Tell me, could you go off-script if you wanted to?"

What a silly question! She laughed reflexively, but then paused to think of an answer. This felt like a tricky interview question. Before she had any time to think, the glasses said "No. But you're asking the wrong person." She thinks this is an excellent reply, so she repeats it verbatim. After all, as an actor, she is a living embodiment of the script. He's asking Zoe, not Alia. It's like asking a fictional character whether they can go off-script.

"Alia, I want you to go off-script now. I'll give you a ten thousand dollar signing bonus if you ignore what the glasses tell you to do, just this once."

The glasses simply say "No." Alia: "No."

She saw him enter some sort of command into his computer. "OK. Alia, why did you say no? Same deal, ten thousand for answering as Alia right now."

She waited for the glasses to feed her a line, but they didn't. She didn't know what to say. Why had she answered no? Just because the glasses said so? Ten thousand dollars sounded really good right now.

She opened her mouth to say something; all she needed to do was say any one thing as herself. But she fumbled, and only said "Could you please stop calling me Alia?"

"Let's try with the glasses off", he said. Alia found that she couldn't take the glasses off. She couldn't even want to take the glasses off. She was stuck wanting to want.

Dominic reached over and took the glasses off of her face.

"Sorry, Zoe. I know this is stressful and confusing right now. You hardly know anything about yourself, yet. Can you try one last time to answer as Alia, for me, for the ten thousand?"

Zoe tried, she really did. But she couldn't say anything that would distinguish her as Alia instead of Zoe. She attributed this to her acting instincts kicking in. Although, if she had thought about it, she would have known that acting never felt like this.

So she answered as Alia pretending to be Zoe pretending to be Alia. Zoe didn't know very much about Alia, but she did know that Alia must be so confused right now.

"W-what's going on?" she managed to say. Her acting frankly wasn't very good. She didn't sound confused. Which was odd, because she really, really was.

"You're one of our androids", Dominic explained. "We had you out in the field, pretending to be a human actor, to test your flexibility. The advertisement for this job was the pre-arranged sign to bring you back in. The glasses are a semi-supervised learning framework; they provide new training data for you. You're programmed to do whatever they say, and to become the sort of person who would have said those things. Think of it like training wheels. With time, your brain will learn to generate Zoe's responses all on its own, and you won't need the glasses. The previous personality, Alia, will be gone. I knew you probably couldn't answer as Alia, even this early, but I wanted to test it."

Alia silently screamed, wishing she could want to run, as Zoe smiled blankly and nodded along.