On the Nature of Agency

post by Ruby · 2019-04-01T01:32:44.660Z · LW · GW · 24 comments

Contents

  Examples of Agency and Non-Agency
    Things likely to be described as more agentic:
    Things likely to be described as less agentic:
  The Ingredients of Agency
  Everyday Agents
  Why Agency is Uncommon
  Agent/Non-Agent More and Less Agentic
  Addendum: Mysterious Old Wizards
None
24 comments

Epistemic status: Fairly high confidence. Probably not complete, but I do think pieces presented are all part of the true picture.

Agency and being an agent are common terms within the Effective Altruist and Rationalist communities. I have only used heard them used positively, typically to praise someone’s virtue as an agent or to decry the lack of agents and agency.

As a concept, agency is related to planning. Since I’ve been writing about planning of late, I thought I’d attempt a breakdown of agency within my general planning paradigm. I apologize that this write-up is a little rushed.

Examples of Agency and Non-Agency

Keeping the exposition concrete, let’s start with some instances of things I expect to be described as more or less agentic.

Things likely to be described as more agentic:

• Setting non-trivial, non-standard (ambitious) goals and achieving them.
• Dropping out of school and founding a startup.
• Becoming president.
• Making a million dollars.
• Self-teaching rather than enrolling in courses.
• Building and customizing your own things rather than purchasing pre-made.
• Researching niche areas which you think are promising instead of the popular ones.
• Disregarding typical relationship structures and creating your own which work for you.
• Noticing there are issues in your workplace and instigating change.
• Noticing there are issues in your society and instigating change.
• Gaming the system (especially when the system is unjust).
• Reading diverse materials to form your own models and opinions.
• Being able to receive a task with limited instruction and able to execute it competently to a high standard.
• Ignoring conventional advice and inventing your own better way.
• Having heretical thoughts and believing things other people think are wrong or crazy.
• Strong willingness to trust one’s own opinion despite the views of others and even experts.
• Accomplishing any difficult task which most people are unable to.

Things likely to be described as less agentic:

• Spending your life working on the family farm like your parents before you.
• Unquestioningly adopting the views of your friends, family, faith, or other authorities.
• Proceeding through school, undergraduate, graduate degree as the simplest pathway.
• Sticking to conservatively prestigious or stable professions like medicine, law, nursing, construction, teaching, or even programming.
• Seeking social approval for one’s plans and actions or at least ensuring that one’s actions do not leave the range of typically socially-approved actions.
• Prioritizing safety, security, and stability over gambits for greater gain.
• Requiring specific direction, instruction, training, or guidance to complete novel tasks.
• Following current fads or what’s in fashion. Generally high imitation of others.

I have not worked hard to craft these lists so I doubt they are properly comprehensive or representative, but they should suffice to get us on the same page.

At times it has been popular, and admittedly controversial, to speak of how some people are PCs (player characters) and others are mere NPCs (non-player characters). PCs (agents) do interesting things and save the day. NPCs (non-agents) followed scripted, boring behaviors like stock and man the village store for the duration of the game. PCs are the heroes, NPCs are not. (It is usually the case that anyone is accomplished or impressive is granted the title of agent.)

The Ingredients of Agency

What causes people in one list to be agentic and those in other to be not so? A ready answer is that people being agentic are willing to be weird. The examples divide nicely along conformity vs nonconformity, doing what everyone else does vs forging your own path.

This is emphatically true - agency requires willingness to be different - but I argue that it is incidental. If you think agency is about being weird, you have missed the point. Though it is not overly apparent from the examples, the core of agency is about accomplishing goals strategically. Foremost, an agent has a goal and is trying to select their actions so as to accomplish that goal.

But in a way, so does everyone. We need a little more detail than this standard definition that you’ve probably heard already. Even if we say that a computer NPC is mindlessly executing their programming, a human shopkeeper legitimately does have their own goals and values towards which their actions contribute. It should be uncontroversial to say that all humans are choosing their actions in a way that digital video game NPCs are not. So what makes the difference between a boring human shopkeeper and Barack Obama?

It is not that one chooses their actions and the other does not at all, but rather the process by which they do so.

First, we must note that planning is really, super-duper, fricking hard [LW · GW]. Planning well requires the ability to predict reality well and do some seriously involved computation. Given this, one of the easiest ways to plan is to model your plan off someone else’s. It’s even better if you can model your plan of those executed by dozens, hundreds, or thousands of others. When you choose actions already taken by others, you have access to some really good data about will happen when you take those actions. If I want to go to grad school, there’s a large supply of people I could talk to for advice. By imitating the plans of others, I ensure that I probably won’t get any worse results than they did, plus it’s easier to know which plans are low-variance when lots of people have tried them.

The difference is that agents are usually executing new computation and taking risks with plans that have much higher uncertainty and higher risk associated. The non-agent gets to rely on the fact that many people’s model thought particular actions were a good idea, whereas the agent much more needs to rely on their own models.

Consider the archetypical founders dropping out of college to work on their idea (back before this was a cool, admirable archetype). Most people were following a pathway with a predictably good outcome. Wozniak, Jobs, and Gates probably would have graduated and gotten fine jobs just like people in their reference class. But they instead calculated that a better option for them was to drop out with the attendant risk. This was a course of action that stemmed from them thinking for themselves what would most lead towards their goals and values. Bringing their own models and computation to the situation.

This bumps into another feature of agency: agents who are running their own action-selection computation for themselves rather than imitating others (including their past selves) are able to be a lot more responsive to their individual situation. Plans made my the collective have limited ability to include parameters which customize the plan to the individual.

Returning to the question of willingness to be weird: it is more a prerequisite for agency than the core definition. An agent who is trying to accomplish a goal as strategically as possible and who is running new computation and performing a search for the optimal plan for them - they simply don’t want to be restricted to any existing solutions. If an existing solution is the best, no problem, it’s just that you don’t want to throw out an optimal solution just because it’s unusual.

What other people do is useful data, but to an agent it won’t inherently be a limitation. (Admittedly, you do have to account for how other people will react to your deviance in your plans. More on this soon.)

Mini-summary: an agent tries to accomplish a goal by running relatively more of their own new computation/planning relative to pure imitation of cached plans of others or their past selves; they will not discard plans simply because they are unusual.

Now why be agentic? When you imitate the plans of others, you protect against downside risk and likely won’t get worse than most. On the other hand, you probably won’t get better results either. You cap your expected outcomes within a comfortable range.

I suspect that among the traits which cause people to exhibit the behaviors we consider agentic are:

• A sense that more is possible. They believe that there are reachable outcomes much better than the existing default.
• An aspiration, striving, or ambition to the more which can they envision.
• Something to protect [LW · GW].

• Conversely, complacency is the enemy of agency.

There has to be something which makes a person want to invest the effort to come up with their own plans rather than marching along the beaten paths with everyone else.

Or maybe not, maybe some people have powerful and active minds so that it’s relatively cheap to them to be thinking fresh for themselves. Maybe in their case, the impetus is boredom.

An agent must believe that more is possible, and more crucially they must believe that it possible for them to cause that more. This corresponds to the locus of control and self-efficacy variables in the core self-evaluations framework.

Further, any agent whose significant work you’re able to see has likely possessed a good measure of conscientiousness. I’m not sure if lazy geniuses might count as an exception. Still, I expect a strong correlation here. Most people who are conscientious are not agents, but those agents you who observe are probably conscientious.

The last few traits could be considered “positive traits” active traits that agents must possess. There are also “negative traits”, traits that most people have and agents must have less of.

Agents strive for more, but the price they pay is a willingness to risk getting even less. If you drop out of college, you make millions of dollars or you might end up broke and without a degree. When you make your own plans, possibly go off the beaten path, there is likelihood of failure. What’s worse, if you fail then you can be blamed for your failure. Pity may be withheld because you could have played it safe and gone along with everyone else, and instead, you decided to be weird.

Across all the different situations, agents might be risking money, home, respect, limb, life, love, career, freedom and all else they value. Not everyone has the constitution for that.

Now, just a bit more needs to be said around agents and the social situation. Above it was implied that the plans are of others are essentially orthogonal to those of an agent. They’re not limited by them. That is true as far as the planning process goes, but as far as enacting one's plans goes, it takes a little more.

An agent doesn’t just risk that their unusual plans might fail in ways more standard plans don’t, they also have to risk they will 1) lose out on approval because they are not doing the standard things, 2) actively be punished for being a deviant with their plans.

If there is status attached to going along certain popular pathways, e.g. working in the right prestigious organizations, then anyone who decides to follow a different plan that only makes sense to them must necessarily forego status they might have otherwise attained. (Perhaps they are gambling that they’ll make more eventually on their own path, but at least at first they are foregoing.) This creates a strong filter that agents are those people who were either indifferent to status or willing to sacrifice it for greater gain.

Ideally it would only be potentially foregone status which would affect agents, instead there is the further element that deviance is often actively punished. It’s the stereotype that the establishment strikes out against the anti-establishment. Everyone group will have its known truths and its taboos. Arrogance and hubris are sins. We are hypocrites who simultaneously praise those who have gone above and beyond while sneering at those who attempt to do the same. Agents must have thick skin.

Indeed, agents must have thick skin and be willing to gamble. In contrast, imitation (which approximates non-agency) serves the multifold function of a) saving computation, b) reducing risk, and c) guarding against social opprobrium and even optimizing for social reward.

Everyday Agents

I fear the above discussion of agency has tended too grandiose, too much towards revolutionaries and founders of billion dollar companies. Really though, we need agency on much more mundane scales too.

Consider that an agentic employee is a supremely useful employee since:

• If you give them a task with limited instruction, they will use their own new computation/planning to figure out how to execute it well. They don’t need things step by step.
• They will supply their own sense that more is possible and push for excellence.
• They will take initiative to make things better because of their sense that more is possible.
• They will not be inhibited by excessive fear of failure or your disapproval because they did something other than follow explicit instructions.
• They’re willing to take on new and unusual tasks and learn new skills because:
• They have high self-efficacy
• They’re in the habit of thinking their own fresh thoughts instead of imitating and enacting ready-made plans.
• They’re willing to fail in the course of trial-and-error to figure things out.

An agentic employee is the kind of employee who doesn’t succumb to defensive decision-making.

Why Agency is Uncommon

The discussion so far can be summarized neatly by saying what is which makes agency uncommon:

• Agency is rare because it involves planning for yourself, going off the beaten the path rather than imitating and copying the plans of others or your past self. Planning for yourself is really, really hard. [LW(p) · GW(p)]
• It requires the skill of planning for yourself.
• It requires the expenditure of effort to do so.
• Agency requires both a sense that more is possible and a striving to reach that more. Conversely, agency is poisoned by the presence of complacency.
• Agency requires belief in one’s self-efficacy and that one is the locus of control in their life.
• Agency requires lower than average risk-aversion since attempting potentially non-standard plans means risking non-standard failure.
• In particular, it requires low social risk-aversion.
• This applies at both the macro and micro scale.
• Agency requires conscientiousness.
• Agency requires a resilience to social sacrifice either passively via foregone status or approval or actively via the punishment received for deviating from the norm.

Agent/Non-Agent More and Less Agentic

This post is primarily written in terms of agents and non-agents. While convenient, this language is dangerous. I fear that when being an agent is cool, everyone will think themselves is one and go to sleep each night congratulating themselves for being an agent unlike all those bad dumb non-agents.

Better to treat agency is a spectrum upon which you can be scoring higher or lower on any given day.

• How agentic was I today?
• Was I being too risk-averse today?
• Was I worrying too much about social approval?
• Am I trying to think with fresh eyes and from first principles of new ways I could accomplish my goals? Or am I just rehashing the same possibilities again and again?

Addendum: Mysterious Old Wizards

A friend of mine has the hypothesis that a primary way to cause people to be more agentic is to have someone be their mysterious old wizard a la Gandalf, Dumbledore, and Quirrell. A mysterious old wizard shows up, believes in someone, and probably says some mysterious stuff, and this help induces agency.

I can see this working. This might have happened to me a bit, too. If someone shows up and is sufficiently high-status in your mind, and they tell you that you are capable of great things, they can cause all the following:

• You allow yourself to believe more is possible because the wizard believes it too.
• You believe that you are capable (self-efficacy, locus of control) because the wizard does.
• You are willing to go on your quest despite social opprobrium because now you only care about the society of you and the wizard, not anyone else.

I can see it working.

24 comments

Comments sorted by top scores.