Subagents of Cartesian Frames

post by Scott Garrabrant · 2020-11-02T22:02:52.605Z · LW · GW · 6 comments

Contents

  1. Definitions of Subagent
    1.1. Categorical Definition
    1.2. Currying Definition
    1.3. Covering Definition
  2. Equivalence of Definitions
    2.1. Equivalence of Categorical and Covering Definitions
    2.2. Equivalence of Covering and Currying Definitions
  3. Mutual Subagents
  4. Universal Subagents and Superagents
None
6 comments

Here, we introduce and discuss the concept of a subagent in the Cartesian Frames [LW · GW] paradigm.

Note that in this post, as in much of the sequence, we are generally working up to biextensional equivalence [LW · GW]. In the discussion, when we informally say that a frame has some property or is some object, what we'll generally mean is that this is true of its biextensional equivalence class.

 

1. Definitions of Subagent

1.1. Categorical Definition

Definition: Let $C$ and $D$ be Cartesian frames over $W$. We say that $C$'s agent is a subagent of $D$'s agent, written $C◃D$, if for every morphism $\varphi :C\to \perp$ there exists a pair of morphisms ${\varphi }_0:C\to D$ and ${\varphi }_1:D\to \perp$ such that $\varphi ={\varphi }_1\circ {\varphi }_0$.

Colloquially, we say that every morphism from $C$ to $\perp$ factors through $D$. As a shorthand for "$C$'s agent is a subagent of $D$'s agent," we will just say "$C$ is a subagent of $D$."

At a glance, it probably isn't clear what this definition has to do with subagents. We'll first talk philosophically about what we mean by "subagent", and then give an alternate definition that will make the connection more clear.

When I say "subagent," I am actually generalizing over two different relationships that may not immediately seem like they belong together.

First, there is the relationship between the component and the whole. One football player is a subagent of the entire football team.

Second, there is the relationship between an agent before and after making a precommitment or a choice. When I precommit not to take a certain action, I am effectively replacing myself with a weaker agent that has fewer options. The new agent with the commitment is a subagent of the original agent.

These are the two notions I am trying to capture with the word "subagent". I am making the philosophical claim that we should think of them primarily as one concept, and am partially backing up this claim by pointing to the simplicity of the above definition. In a future post, we will discuss the formal differences between these two kinds of subagent, but I think it is best to view them as two special cases of the one simple concept.

(My early drafts of the "Embedded Agency [? · GW]" sequence used the word "subagent" in the title for both the Subsystem Alignment [LW · GW] and Robust Delegation [? · GW] sections.)

 

1.2. Currying Definition

Definition: Let $C$ and $D$ be Cartesian frames over $W$. We say that $C◃D$ if there exists a Cartesian frame $Z$ over $\text{Agent}\left(D\right)$ such that $C\simeq D^{\circ }\left(Z\right)$.

Assume for this discussion that we only care about frames up to biextensional equivalence. In effect, the above definition is saying that "$C$ is a subagent of $D$" means "$C$'s agent is playing a game, $Z$, where the stakes are to help decide what $D$'s agent does." (And this game may or may not have multiple players, and may or may not fully cover all the options of $D$'s agent.)

Letting $C=(A,E,\cdot )$ and $D=(B,F,\star )$, it turns out (as we will see later) that we can explicitly construct $Z$. $Z=(A,X,\diamond )$, where $X$ is the set of all morphisms from $C$ to $D$, and $\diamond :A\times X\to B$ is given by $a\diamond (g,h)=g\left(a\right)$.

We will later prove the categorical and currying definitions equivalent, but let's first interpret this definition using examples.

$Z$ is a Cartesian frame whose agent is the agent of $C$ and whose world is the agent of $D$. This seems like the kind thing we would have when $C$ is a subagent of $D$.

Thinking about the football example: We have the football player $A$ as the agent in a Cartesian frame $C$ over the world $W$. We also have the football team $B$ as the agent in a Cartesian frame $D$ over the same world $W$.

$Z$ is a Cartesian frame over the football team; and the agent of this frame is again the football player $A$. $X$, the environment of $Z$, represents the rest of the football team: the player's effect on the team as a whole (here treated as the player's world) is a function of what the player chooses and what the rest of the team chooses. We can think of $Z$ as representing a  "zoomed-in" picture of $A$ interacting with its local environment (the team), while $C$ represents a "zoomed-out" picture of $A$ interacting with its teammates and the larger world (rival teams, referees, etc.).

$D^{\circ }\left(Z\right)=(A,X\times F,\bullet )$, so $E$ is equivalent to $X\times F$, which is saying that the environment for the football player in its original frame ($C$) is equivalent to the Cartesian product of the rest of the team $X$ with the team's environment $F$.

Thinking about the precommitment example: $C$ has made a precommitment, so there is an inclusion morphism $\iota :A\to B$, which shows that $C$'s agent's options are a subset of $D\text{'s}$ agent's options. $Z$ is just ${\text{CF}}^{\ast }\left(\right\{\iota \left\}\right)$, so $X=\left\{\iota \right\}$ is a singleton. $D^{\circ }\left(Z\right)=(A,X\times F,\bullet )$, so $E$ is equivalent to $X\times F=F$, so here $A$ is a subset of $B$ and $E$ is equivalent to $F$.

Although the word "precommitment" suggests a specific (temporal, deliberative) interpretation, formally, precommitment just looks like deleting rows from a matrix (up to biextensional equivalence), which can represent a variety of other situations.

A Cartesian frame $Z=(A,X,\diamond )$ over $B$ is like a nondeterministic function from $A$ to $B$, where $X$ represents the the nondeterministic bits. When changing our frame from $(B,F,\star )$ to $(A,E,\cdot )\simeq (A,X\times F,\bullet )$, we are identifying with $A$ and externalizing the nondeterministic bits $X$ into the environment.

 

1.3. Covering Definition

The categorical definition is optimized for elegance, while the currying definition is optimized to be easy to understand in terms of agency. We have a third definition, the covering definition, which is optimized for ease of use.

Definition. Let $C=(A,E,\cdot )$ and $D=(B,F,\star )$ be Cartesian frames over $W$. We say that $C◃D$ if for all $e\in E$, there exists an $f\in F$ and a $(g,h):C\to D$ such that $e=h\left(f\right)$.

We call this the covering definition because the morphisms from $C$ to $D$ cover the set $E$.

 

2. Equivalence of Definitions

2.1. Equivalence of Categorical and Covering Definitions

The equivalence of the categorical and covering definitions follows directly from the fact that the morphisms from $C$ to $\perp$ are exactly the elements of $\text{Env}\left(C\right)$.

Claim: The categorical and covering definitions of subagent are equivalent.

Proof: Let $C=(A,E,\cdot )$ and let $D=(B,F,\star )$. First, observe that the morphisms from $C$ to $\perp$ correspond exactly to the elements of $E$. For each $e\in E$, it is easy to see that $(g,h):C\to (W,\{j\},\diamond )$, given by $h\left(j\right)=e$ and $g\left(a\right)=a\cdot e$, is a morphism, and every morphism is uniquely defined by $h\left(j\right)$, so there are no other morphisms. Let ${\varphi }_e$ denote the morphisms with $h\left(j\right)=e$.

Similarly, the morphisms from $D$ to $\perp$ correspond to the elements of $F$. Let ${\psi }_f$ denote the morphisms corresponding to $f\in F$.

Thus, the categorical definition can be rewritten to say that for every morphism ${\varphi }_e:C\to \perp$, there exist morphisms $(g,h):C\to D$ and ${\psi }_f:D\to \perp$, such that ${\varphi }_e={\psi }_f\circ (g,h)$. However, ${\psi }_f\circ (g,h):C\to (W,\{j\},\diamond )$ sends $j$ to $h\left(f\right)$, and so equals ${\varphi }_e$ if and only if $e=h\left(f\right)$. Thus the categorical definition is equivalent to the covering definition. $\square$

 

2.2. Equivalence of Covering and Currying Definitions

Claim: The covering definition of subagent implies the currying definition of subagent.

Proof: Let $C=(A,E,\cdot )$ and $D=(B,F,\star )$ be Cartesian frames over $W$. Assume that $C◃D$ according to the covering definition.

Let $X$ be the set of all morphisms from $C$ to $D$, and let $Z=(A,X,\diamond )$ be a Cartesian frame over $B$, with $\diamond$ given by $a\diamond (g,h)=g\left(a\right)$. We have that $D^{\circ }\left(Z\right)=(A,X\times F,\bullet )$, with

$$\begin{array}{cc}a\bullet \left(\right(g,h),f)& =(a\diamond (g,h\left)\right)\star f\\ & =g\left(a\right)\star f\end{array}$$

for all $a\in A$, $(g,h)\in X$, and $f\in F$.

To show that $C\simeq D^{\circ }\left(Z\right)$, we need to construct morphisms $g_0,h_0:C\to D^{\circ }\left(Z\right)$ and $g_1,h_1:D^{\circ }\left(Z\right)\to C$ which compose to something homotopic to the identity in both orders.

We will let $g_0$ and $g_1$ be the identity on $A$, and we let $h_0:X\times F\to E$ be given by $h_0\left(\right(g,h),f)=h\left(f\right)$. Finally, we let $h_1\left(e\right)=\left(\right(g,h),f)$ such that $h\left(f\right)=e$. We can always choose such a $(g,h)\in X$ and $f\in F$ by the covering definition of subagent.

We have that $(g_0,h_0)$ is a morphism, since

$$\begin{array}{cc}{g}_0\left(a\right)\bullet \left(\right(g,h),f)& =a\bullet \left(\right(g,h),f)\\ & =g\left(a\right)\star f\\ & =a\cdot h\left(f\right)\\ & =a\cdot h_0\left(\right(g,h),f).\end{array}$$

Similarly, we have that $(g_1,h_1)$ is a morphism since $h_1\left(e\right)=\left(\right(g,h),f)$, where $h\left(f\right)=e$, so

$$\begin{array}{cc}{g}_1\left(a\right)\cdot e& =a\cdot e\\ & =a\cdot h\left(f\right)\\ & =g\left(a\right)\star f\\ & =a\bullet \left(\right(g,h),f)\\ & =a\bullet h_1\left(e\right).\end{array}$$

It is clear that $(g_0,h_0)$ and $(g_1,h_1)$ compose to something homotopic to the identity in both orders, since $g_0$ and $g_1$ are the identity on $A$. Thus, $C\simeq D^{\circ }\left(Z\right)$. $\square$

Claim: The currying definition of subagent implies the covering definition of subagent.

Proof: Let $C=(A,E,\cdot )$ and $D=(B,F,\star )$ be Cartesian frames over $W$. Let $Z=(Y,X,\diamond )$ be a Cartesian frame over $B$, and let $C\simeq D^{\circ }\left(Z\right)$. Our goal is to show that for every $e\in E$, there exists a $(g,h):C\to D$ and $f\in F$ such that $e=h\left(f\right)$. We will start with the special case where $C=D^{\circ }\left(Z\right)$.

We have that $D^{\circ }\left(Z\right)=(Y,X\times F,\bullet )$, where $y\bullet (x,f)=(y\diamond x)\star f$. First, note that for every $x\in X$, there exists a morphism $(g_x,h_x):D^{\circ }\left(Z\right)\to D$ given by $g_x\left(y\right)=y\diamond x$, and $h_x\left(f\right)=(x,f)$. To see that this is a morphism, observe that

$$\begin{array}{cc}{g}_x\left(y\right)\star f& =(y\diamond x)\star f\\ & =y\bullet (x,f)\\ & =f\bullet h_x\left(f\right)\end{array}$$

for all $y\in Y$ and $f\in F$.

To show that $D^{\circ }\left(Z\right)◃D$ according to the covering definition, we need that for all $(x,f)\in X\times F$, there exists an $f^{\prime }\in F$ and a $(g,h):D^{\circ }\left(Z\right)\to D$ such that $h\left(f^{\prime }\right)=(x,f)$. Indeed we can take $(g,h)=(g_x,h_x)$ and $f^{\prime }=f$.

Now, we move to the case where $C\simeq D^{\circ }\left(Z\right)$, but $C\ne D^{\circ }\left(Z\right)$. It suffices to show that under the covering definition of subagent, if $C_0◃D$, and $C_1\simeq C_0$, then $C_1◃D$.

Let $C_i=(A_i,E_i,{\cdot }_i)$, and let $(g_0,h_0):C_0\to C_1$ and $(g_1,h_1):C_1\to C_0$ compose to something homotopic to the identity in both orders. Assume that $C_0◃D$. To show that $C_1◃D$, let the possible environment $e\in E_1$ be arbitrary.

$h_0\left(e\right)\in E_0$, so there exists an $f\in F$ and $(g,h):C_0\to D$ such that $h\left(f\right)=h_0\left(e\right)$. Consider the morphism $(g^{\prime },h^{\prime }):C_1\to D$, where $g^{\prime }=g\circ g_1$, and $h^{\prime }\left(f\right)=e$ and $h^{\prime }\left(f^{\prime }\right)=(h_1\circ h)\left(f^{\prime }\right)$ on all $f^{\prime }\ne f$. To see that this is a morphism, observe that for all $a\in A_1$, we have

$$\begin{array}{cc}{g}^{\prime }\left(a\right)\star f& =g\left(g_1\right(a\left)\right)\star f\\ & =a{\cdot }_1{h}_1\left(h\right(f\left)\right)\\ & =a{\cdot }_1{h}_1\left(h_0\right(e\left)\right)\\ & =a{\cdot }_{1}e\\ & =a{\cdot }_1{h}^{\prime }\left(f\right),\end{array}$$

while for $f^{\prime }\in F$, $f^{\prime }\ne f$, we have

$$\begin{array}{cc}{g}^{\prime }\left(a\right)\star f^{\prime }& =g\left(g_1\right(a\left)\right)\star f^{\prime }\\ & =a{\cdot }_1{h}_1\left(h\right(f^{\prime }\left)\right)\\ & =a{\cdot }_1{h}^{\prime }\left(f^{\prime }\right).\end{array}$$

Now, notice that for our arbitrary $e\in E_1$, $(g^{\prime },h^{\prime }):C_1\to D$ and $f\in F$ satisfy $h^{\prime }\left(f\right)=e$, so $C_1◃D$ according to the to the covering definition.

Thus, whenever $C\simeq D^{\circ }\left(Z\right)$, we have $C◃D$ according to the covering definition, so the currying definition implies the covering definition of subagent. $\square$

 

3. Mutual Subagents

The subagent relation is both transitive and reflexive. Surprisingly, this relation is not anti-symmetric, even up to biextensional equivalence.

Claim: $◃$ is reflexive. Further, if $C\simeq D$, then $C◃D$.

Proof: Let $C=(A,E,\cdot )$ and $D=(B,F,\cdot )$ be Cartesian Frames over $W$, with $C\simeq D$. Consider the Cartesian frame $Z$ over $B$ given by $Z=(B,\{x\},\diamond )$, where $b\diamond x=b$. Observe that $D\cong D^{\circ }\left(Z\right)$. Thus $C\simeq D^{\circ }\left(Z\right)$, so $C◃D$, according to the currying definition. $\square$

Claim: $◃$ is transitive.

Proof: We will use the categorical definition. Let $C_0◃C_1$ and $C_1◃C_2$. Given a morphism, ${\varphi }_0:C_0\to \perp$, since $C_0◃C_1$, we know that ${\varphi }_0={\varphi }_1\circ {\varphi }_2$ with ${\varphi }_1:C_1\to \perp$ and ${\varphi }_2:C_0\to C_1$. Further, since $C_1◃C_2$, we know that ${\varphi }_1={\varphi }_3\circ {\varphi }_4$ with ${\varphi }_3:C_2\to \perp$ and ${\varphi }_4:C_1\to C_2$. Thus,

$$\begin{array}{cc}{\varphi }_0& =({\varphi }_3\circ {\varphi }_4)\circ {\varphi }_2\\ & ={\varphi }_3\circ ({\varphi }_4\circ {\varphi }_2),\end{array}$$

with ${\varphi }_3:C_2\to \perp$ and ${\varphi }_4\circ {\varphi }_2:C_0\to C_2$, so $C_0◃C_2$. $\square$

As a corollary, we have that subagents are well-defined up to biextensional equivalence.

Corollary: If $C_0\simeq C_1$, $D_0\simeq D_1$, and $C_0◃D_0$, then $C_1◃D_1$.

Proof: $C_1◃C_0◃D_0◃D_1$. $\square$

Sometimes, there are Cartesian frames $C\simeq ̸D$ with $C◃D$ and $D◃C$. We can use this fact to define a third equivalence relation on Cartesian frames over $W$, weaker than both $\cong$ and $\simeq$.

Definition: For Cartesian frames $C$ and $D$ over $W$, we say $C\bowtie D$ if $C◃D$ and $D◃C$.

Claim: $\bowtie$ is an equivalence relation.

Proof: Reflexivity and transitivity follow from reflexivity and transitivity of $◃$. Symmetry is trivial. $\square$

This equivalence relation is less natural than $\cong$ and $\simeq$, and is not as important. We discuss it mainly to emphasize that two frames can be mutual subagents without being biextensionally equivalent.

Claim: $\bowtie$ is strictly weaker than $\simeq$, which is strictly weaker than $\cong$.

Proof: We already know that $\simeq$ is weaker than $\cong$. To see that $\bowtie$ is weaker than $\simeq$, observe that if $C\simeq D$, then $C◃D$ and $D◃C$, so $C\bowtie D$.

To see that $\simeq$ is strictly weaker than $\cong$, observe that $\top \oplus \top \simeq \top$ (both have empty environment and nonempty agent), but $\top \oplus \top ≆\top$ (the agents have different size).

To see that $\bowtie$ is strictly weaker than $\simeq$, observe that $\top \bowtie \text{null}$ (vacuous by covering definition), but $\top \simeq ̸\text{null}$ (there are no morphisms from $\text{null}$ to $\top$). $\square$

I do not have a simple description of exactly when $C\bowtie D$, but there are more cases than just the trivial ones like $C\simeq D$ and vacuous cases like $\top \bowtie \text{null}$. As a quick example:

$\left(\begin{array}{c}x\\ y\end{array}\right)\bowtie \left(\begin{array}{cc}x& x\\ y& y\\ x& y\end{array}\right)$.

To visualize this, imagine an agent that is given the choice between cake and pie. This agent can be viewed as a team consisting of two subagents, Alice and Bob, with Alice as the leader.

Alice has three choices. She can choose cake, she can choose pie, or she can delegate the decision to Bob. We represent this with a matrix where Bob is in Alice's environment, and the third row represents Alice letting the environment make the call:

$\left(\begin{array}{cc}x& x\\ y& y\\ x& y\end{array}\right)$.

If we instead treat Alice-and-Bob as a single superagent, then their interaction across the agent-environment boundary becomes agent-internal deliberation, and their functional relationship to possible worlds just becomes a matter of "What does the group decide?". Thus, Alice is a subagent of the Alice-and-Bob team:

$\left(\begin{array}{cc}x& x\\ y& y\\ x& y\end{array}\right)◃\left(\begin{array}{c}x\\ y\end{array}\right)$.

However, Alice also has the ability to commit to not delegating to Bob. This produces a future version of Alice that doesn't choose the third row. This new agent is a precommitment-style subagent of the original Alice, but using biextensional collapse, we can also see that this new agent is equivalent to the smaller matrix. Thus:

$\left(\begin{array}{c}x\\ y\end{array}\right)\simeq \left(\begin{array}{cc}x& x\\ y& y\end{array}\right)◃\left(\begin{array}{cc}x& x\\ y& y\\ x& y\end{array}\right)$.

It is also easy to verify formally that these are mutual subagents using the covering definition of subagent.

I'm reminded here of the introduction and deletion of mixed strategies in game theory. The third row of Alice's frame is a mix of the first two rows, so we can think of Bob as being analogous to a random bit that the environment cannot see. I informally conjecture that for finite Cartesian frames, $C\bowtie D$ if and only if you can pass between $C$ and $D$ by doing something akin to deleting and introducing mixed strategies for the agent.

However, this informal conjecture is not true for infinite Cartesian frames:

$\left(\begin{array}{cccccc}z& x& z& z& z& \cdots \\ z& y& z& z& z& \cdots \\ z& z& x& z& z& \cdots \\ z& z& y& z& z& \cdots \\ z& z& z& x& z& \cdots \\ z& z& z& y& z& \cdots \\ z& z& z& z& x& \cdots \\ z& z& z& z& y& \cdots \\ ⋮& ⋮& ⋮& ⋮& ⋮& \ddots \end{array}\right)\bowtie \left(\begin{array}{cccccc}z& y& z& z& z& \cdots \\ z& z& x& z& z& \cdots \\ z& z& y& z& z& \cdots \\ z& z& z& x& z& \cdots \\ z& z& z& y& z& \cdots \\ z& z& z& z& x& \cdots \\ z& z& z& z& y& \cdots \\ ⋮& ⋮& ⋮& ⋮& ⋮& \ddots \end{array}\right)$.

We can see that these frames are mutual subagents by noting that one can transition back and forth by repeatedly committing not to take the top row.

I do not know of any examples of $\bowtie$ that look qualitatively different from those discussed here, but I do not have a good understanding of exactly what the equivalence classes look like.

 

4. Universal Subagents and Superagents

We can view $\top$ as a universal subagent and $\perp$ as a universal superagent.

Claim: $\top ◃C◃\perp$ for all Cartesian frames $C$.

Proof: We use the categorical definition. That $\top ◃C$ is vacuous, since there is no morphism from $\top$ to $\perp$. That $C◃\perp$ is also trivial, since any $\varphi :C◃\perp$ is equal to $\varphi \circ {\text{id}}_{\perp }$. $\square$

Since $\text{null}\bowtie \top$, we also have $\text{null}◃C$ for all $C$.

We also have a that ${\perp }_S$ is a superagent of all Cartesian frames with image in $S$.

Claim: $C◃{\perp }_S$ if and only if $\text{Image}\left(C\right)\subseteq S$.

Proof: Let $C=(A,E,\cdot )$, and let ${\perp }_S=(S,\{f\},\star )$, with $s\star f=s$.

First, assume $\text{Image}\left(C\right)\subseteq S$. We will use the covering definition. Given an $e\in E$, let $(g,h):C\to {\perp }_S$ be given by $g\left(a\right)=a\cdot e$ and $h\left(f\right)=e$. We have that $g$ is well-defined because $\text{Image}\left(C\right)\subseteq S$, and $(g,h)$ is a morphism because for all $a\in A$, 

$$\begin{array}{cc}a\cdot h\left(f\right)& =a\cdot e\\ & =g\left(a\right)\\ & =g\left(a\right)\star f.\end{array}$$

Thus, there is a morphism $(g,h):C\to {\perp }_S$ and an element $f\in \left\{f\right\}$ such that $h\left(f\right)=e$ for an arbitrary $e\in E$, so $C◃{\perp }_S$.

Conversely, assume $\text{Image}\left(C\right)⊈S$, so let $a\in A$ and $e\in E$ be such that $a\cdot e\notin S$. If we assume for contradiction that $C◃{\perp }_S$, then by the covering definition, there must be a morphism $(g,h):C\to {\perp }_S$ such that $h\left(f\right)=e$. But then we have that

$$\begin{array}{cc}a\cdot e& =a\cdot h\left(f\right)\\ & =g\left(a\right)\star f\\ & =g\left(a\right)\end{array}$$

must be both inside and outside of $S$, a contradiction. $\square$

Convention: We will usually write $C◃{\perp }_S$ instead of $\text{Image}\left(C\right)\subseteq S$, as it is shorter.

Corollary: $S\in \text{Obs}\left(C\right)$ if and only if $C\simeq C_0\&C_1$ for some $C_0◃{\perp }_S$ and $C_1◃{\perp }_{W\setminus S}$.

Proof: This is just rewriting our definition of observables from "Controllables and Observables, Revisited [LW · GW]." $\square$

 

In the coming posts, we will introduce multiplicative operations on Cartesian frames, and use these to distinguish between additive and multiplicative subagents and superagents.

6 comments

Comments sorted by top scores.