What Are You Tracking In Your Head?

I was thinking you had all of mine already, since they're mostly about explaining and coding. But there's a big one: When using tools, I'm tracking something like "what if the knife slips?". When I introspect, it's represented internally as a kind of cloud-like spatial 3D (4D?) probability distribution over knife locations, roughly co-extentional with "if the material suddenly gave or the knife suddenly slipped at this exact moment, what's the space of locations the blade could get to before my body noticed and brought it to a stop?". As I apply more force this cloud extends out, and I notice when it intersects with something I don't want to get cut. (Mutatis mutandis for other tools of course. I bet people experienced with firearms are always tracking a kind of "if this gun goes off at this moment, where does the bullet go" spatial mental object)

I notice I'm tracking this mostly because I also track it for other people and I sometimes notice them not tracking it. But that doesn't feel like "Hey you're using bad technique", it feels like "Whoah your knife probability cloud is clean through your hand and out the other side!"

This post is probably right that illegible skills rely on tracking non-obvious bits of information. But I don't think that discovering that info is as simple as asking "What Are You Tracking in Your Head". Remember that there's a lot of inferential distance between the you and an expert, and they've likely forgotten all that you don't know. 

Thankfully the problem of getting tacit knowledge out of someone has a growing literature on it that is quite useful. The field of  Naturalistic Decision Making developed some techniques to do this, one of which is fairly simple. It is called Applied Cognitive Task Analysis. Here's a summary of it from CommonCog ^[1]:

There are four techniques in ACTA, and all of them are pretty straightforward to put to practice:

1. You start by creating a task diagram. A task diagram gives you a broad overview of the task in question and identifies the difficult cognitive elements. You'll want to do this at the beginning, because you'll want to know which parts of the task are worth focusing on.
2. You do a knowledge audit. A knowledge audit is an interview that identifies all the ways in which expertise is used in a domain, and provides examples based on actual experience.
3. You do a simulation interview. The simulation interview allows you to better understand an expert’s cognitive processes within the context of an single incident (e.g. a firefighter arrives at the scene of a fire; a programmer is handed an initial specification). This allows you to extract cognitive processes that are difficult to get at using a knowledge audit, such as situational assessment, and how such changing events impacts subsequent courses of action.
4. You create a cognitive demands table. After conducting ACTA interviews with multiple experts, you create something called a ‘cognitive demands table’ which synthesises all that you’ve uncovered in the previous three steps. This becomes the primary output of the ACTA process, and the main artefact you’ll use when you apply your findings to course design or to systems design.

The blog post goes in depth on this method, the theory that undergirds it and how to notice and acquire the perception that experts possess.

As to your actual question, I guess I'd say that the same holds true for video games. If you want to beat a difficult boss, then try to gather info first on what the timing is like, what cues there are for attacks and so forth. 

Another area is when doing QFT calculations, you need to keep track of the interaction terms in the lagrangian and the free field terms in order to turn the time translation operator into a series of Feynman diagrams without ever bother to expand out the power series and use Wick's theorem and whatever. Makes writing out scattering amplitudes less of a chore.

Also, Feynman's trick applies to reading near anything. Keep an example in your head and see if it matches what the text says about it. Most of the time when I get confused by a text, doing this will clear things up. 

P.S.

This is unrelated to your post, but if you could 

choose anyone to work on AI alignment, who'd you pick? 

1. ^{^}

   A fantastic blog that is concerned with applied rationality. It outlines how to find and acquire tacit knowledge. I'd recommend starting from the Tacit Knowledge Series.

Seems at least partially related to cognitive apprenticeship, a type of teaching that aims at explicitly making the teacher's "thinking visible", so that the pupils can find out what it is that the teacher is tracking at any moment when solving the problem. For instance, they might carry out an assignment in front of pupils and try to explicitly speak out loud their thoughts while doing it.

For instance, when writing an essay:

Assignment

(Suggested by students)

Write an essay on the topic “Today’s Rock Stars Are More Talented than Musicians of Long Ago.”

THINKING-ALOUD EXCERPT

I don’t know a thing about modern rock stars. I can’t think of the name of even one rock star. How about, David Bowie or Mick Jagger… But many readers won’t agree that they are modern rock stars. I think they’re both as old as I am. Let’s see, my own feelings about this are… that I doubt if today’s rock stars are more talented than ever. Anyhow, how would I know? I can’t argue this… I need a new idea… An important point I haven’t considered yet is… ah… well… what do we mean by talent? Am I talking about musical talent or ability to entertain—to do acrobatics? Hey, I may have a way into this topic. I could develop this idea by…

or doing math:

A MATHEMATICIAN THINKS OUT LOUD

(from Schoenfeld, 1983)

Problem

Let P(x) and Q(x) be two polynomials with "reversed" coefficients:

$P\left(x\right)=an{x}^n+an-1x^{n-1}+...+a2x^{2}a1x+a0$

$Q\left(x\right)=a0x^n+al{x}^{n-1}+...+an-2x^{2}an-1x+an,$

 where an ≠ 0 ≠ a0. What is the relationship between the roots of P(x) and those of Q(x)? Prove your answer.

Expert Model

What do you do when you face a problem like this? I have no general procedure for finding the roots of a polynomial, much less for comparing the roots of two of them. Probably the best thing to do for the time being is to look at some simple examples and hope I can develop some intuition from them. Instead of looking at a pair of arbitrary polynomials, maybe I should look at a pair of quadratics: at least I can solve those. So, what happens if

$P\left(x\right)=a{x}^2+bx+c$

and

$Q\left(x\right)=c{x}^2+bx+a?$

The roots are

$(-b\pm \surd (b2-4ac\left)\right)/2a$

and

$(-b\pm \surd (b2-4ac\left)\right)/2c$

respectively.

That's certainly suggestive, because they have the same numerator, but I don't really see anything that I can push or that'll generalize. I'll give this a minute or two, but I may have to try something else...

Well, just for the record, let me look at the linear case. If P(x) = ax + b and Q(x) = bx + a, the roots are –b/a and –a/b respectively.

They're reciprocals, but that's not too interesting in itself. Let me go back to quadratics. I still don't have much of a feel for what's going on. I'll do a couple of easy examples, and look for some sort of a pattern. The clever thing to do may be to pick polynomials I can factor; that way it'll be easy to keep track of the roots. All right, how about something easy like (x + 2)(x + 3)?

Then P(x) = x²+ 5x + 6, with roots -2 and -3. So, Q(x) = 6x² + 5x + 1 = (2x + 1)(3x + 1), with roots - 1/2 and -1/3.

Those are reciprocals too. Now that's interesting.

How about P(x) = (3x + 5)(2x - 7) = 6x² - 11x - 35? Its roots are -5/3 and 7/2; Q(x) = -35x² - 11x + 6 = -(35x² + 11x - 6) = -(7x - 2)(5x + 3).

All right, the roots are 2/7 and -3/5. They're reciprocals again, and this time it can't be an accident. Better yet, look at the factors: they're reversed! What about

P(x) = (ax + b)(cx + d) = acx² + (bc + ad)x + bd? Then

Q(x) = bdx² + (ad + bc)x + ac = (bx + a)(dx + c).

Aha! It works again, and I think this will generalize…

At this point there are two ways to go. I hypothesize that the roots of P(x) are the reciprocals of the roots of Q(x), in general. (If I'm not yet sure, I should try a factorable cubic or two.) Now, I can try to generalize the argument above, but it's not all that straightforward; not every polynomial can be factored, and keeping track of the coefficients may not be that easy. It may be worth stopping, re-phrasing my conjecture, and trying it from scratch:

Let P(x) and Q(x) be two polynomials with "reversed" coefficients. Prove that the roots of P(x) and Q(x) are reciprocals.

All right, let's take a look at what the problem asks for. What does it mean for some number, say r, to be a root of P(x)? It means that P(r) = 0. Now the conjecture says that the reciprocal of r is supposed to be a root to Q(x). That says that Q(1/r) = 0. Strange. Let me go back to the quadratic case, and see what happens.

Let P(x) = ax² + bx + c, and Q(x) = cx² + bx + a. If r is a root of P(x), then P(r) = ar² + br + c = 0. Now what does Q(1/r) look like?

Q(1/r) = c(1/4)² + b(1/4) + a = (c + br + ar²)/r² = P(r)/r² = 0

So it works, and this argument will generalize. Now I can write up a proof.

Proof:

Let r be a root of P(x), so that P(r) = 0. Observe that r ≠ 0, since a₀ ≠ 0. Further, Q(1/r) = a₀(1/r)ⁿ + a₁(1/4)^n-1+… +a_n-2(1/r) + a_n = (1/rⁿ)(a₀ + a₁r + a₂r² +… + a_n-2r^n-2 + a_n-1r^n-1 + a_nrⁿ) – (1/rⁿ)P(r) = 0, so that (1/r) is a root of Q(x).

Conversely, if S is a root of Q(x), we see that P(1/S) = O. Q.E.D.

All right, now it's time for a postmortem. Observe that the proof, like a classical mathematical argument, is quite terse and presents the results of a thought process. But where did the inspiration for the proof come from? If you go back over the way that the argument evolved, you'll see there were two major breakthroughs.

The first had to do with understanding the problem, with getting a feel for it. The problem statement, in its full generality, offered little in the way of assistance. What we did was to examine special cases in order to look for a pattern. More specifically, our first attempt at special cases—looking at the quadratic formula—didn’t provide much insight. We had to get even more specific, as follows: Look at a series of straightforward examples that are easy to calculate, in order to see if some sort of pattern emerges. With luck, you might be able to generalize the pattern. In this case, we were looking for roots of polynomials, so we chose easily factorable ones. Obviously, different circumstances will lead to different choices. But that strategy allowed us to make a conjecture.

The second breakthrough came after we made the conjecture. Although we had some idea of why it ought to be true, the argument looked messy, and we stopped to reconsider for a while. What we did at that point was important, and is often overlooked: We went back to the conditions of the problem, explored them, and looked for tangible connections between them and the results we wanted. Questions like "what does it mean for r to be a root of P(x)?", "what does the reciprocal of r look like?" and "what does it mean for (1/r) to be a root of Q(x)?" may seem almost trivial in isolation, but they focused our attention on the very things that gave us a solution.

Kinda surprised you didn't mention purpose-tracking, for while you're trying to do a thing--any thing. Arguably the most important skill I acquired from the Sequences [LW · GW], and that's a high bar.

"Your sword has no blade. It has only your intention. When that goes astray you have no weapon."

In resource management games, I typically have a set of coefficients in my head for the current relative marginal values of different resources, and my primary heuristic is usually maximizing the weighted sum of my resources according to these coefficients.

In combat strategy games, I usually try to maximize (my rate of damage) x (maximum damage I can sustain before I lose) / (enemy rate of damage) x (damage I need to cause before I win).

These don't seem especially profound to me.  But I've noticed a surprising number of video games that make it distressingly hard to track these things; for instance, by making it so that the data you need to calculate them is split across three different UI screens, or by failing to disclose the key mathematical relationships between the public variables and the heuristics I'm trying to track.  ("You can choose +5 armor or +10 accuracy.  No, we're not planning to tell you the mathematical relationship between armor or accuracy and observable game outcomes, why do you ask?")

It's always felt odd to me that there isn't widespread griping about such games.

As a result of reading this post, I have started explicitly tracking two hypotheses that I wasn't before:  (1) that the value of tracking things-like-these is much less obvious than I think, and (2) that a lot of people lack the spare cognitive capacity to track the things I'm tracking.

Though I'm not sure yet whether they're going to steal much probability from my previous leading hypothesis, "most players are not willing to do mental multiplication in order to play better."

Another example from Feynman: Besides the object level of what the math or physics described symbolically, he was tracking what that meant in real life. Not as obvious as you'd think. See, e.g., the anecdote about Brewster's angle. The most common form is Guessing the Teacher's Password [LW · GW] - which happens if there is no spare capacity to track what all these symbols mean in real life. Tracking the symbols is difficult enough if you are at the limits of your ability (though it might also result from investing as little effort as possible to pass).   

Nice post!

One of my fears is that the True List is super long, because most things-being-tracked are products of expertise in a particular field and there are just so many different fields.

Nevertheless:

• In product/ux design, tracking the way things will seem to a naive user who has never seen the product before.
• In navigation, tracking which way north is.
• I have a ton of "tracking" habits when writing code:
  • types of variables (and simulated-in-my-head values for such)
  • refactors that want to be done but don't quite have enough impetus for yet
  • loose ends, such as allocated-but-not-freed resources, or false symmetry (something that looks like it should be symmetric but isn't in some critical way), or other potentially-misleading things that need to be explained
  • [there are probably a lot more of these that I am not going to write down now]

There is an interview technique called Experiential Array which is designed to pull out this sort of information (and some other stuff too). Matt Goldenberg conducted this type of interview on me on the topic of designing and running events. This experience gave me the ability to communicate the invisible parts of event design.

Read here for more details 

While writing, track an estimate of the mental state of a future reader - confusion, excitement, eyes glossing over, etc.

This may be true if you write a scientific paper, an essay or a non-fiction book. As a professional writer, when I write a novel, I usually don't think about the reader at all (maybe because, in a way, I am the reader). Instead, I track a mental state of the character I'm writing about. This leads to interesting situations when a character "decides" to do something completely different from what I intended her to do, as if she had her own will. I have heard other writers describe the same thing, so it seems to be a common phenomenon. In this situation, I have two options: I can follow the lead of the character (my tracking of her mental state) and change my outline or even ditch it completely, or I can force her to do what the outline says she's supposed to do. The second choice inevitably leads to a bad story, so tracking the mental state of your characters indeed seems to be essential to writing good fiction. 

I assume that readers do a similar thing, so if a character in a book does something that doesn't fit the mental model they have in mind, they often find it "unbelievable" or "unrealistic", which is one of the reasons while "listen to your characters" seems to be good advice while writing.

Not type tracking seems to be the thing that makes people susceptible to bad philosophical intuition pumps. In particular, that the referent of a token shifts between a proposition being used at different points in the problem.

In Advanced Driving courses a key component was (and may still be -it’s been awhile) commentary driving. You sit next to an instructor and listen to them give a commentary on everything they are tracking, for instance other road users, pedestrians, road signs,  bends, obstacles, occluders of vision etc; and how these observations affect their decision making, as they drive.  Then you practice doing the same, out loud, and, ideally, develop the discipline to continue practising this after the course. I found this was a very effective way of learning from an expert, and I’m sure my driving became the safer because of it.

I have a couple frameworks that seem to fit into this:

One is the Greek word "kairos," which means... something kinda like "right now," but in the context of rhetoric means something more like "the present environment and mood." A public speaker, when giving a speech, should consider the kairos and tailor their speech accordingly. This cashes out in stuff like bands yelling out, "How are you tonight, Houston?!" or a comedian riffing off of a heckler. It's the thing that makes a good public speaker feel like they're not just delivering a canned speech they've given hundreds of times before, even if they have.

The other framework to me is the "language" of objects. When you're first learning to drive a car, for example, you don't fully understand the way the steering wheel affects the direction the car will turn, or how the angle of the gas pedal affects the acceleration. But as you get more adept, you can "speak" the language of the car. You know what every growl of the engine means, or the quirks of adjusting the seatbelt, or the spaces you can squeeze into. At one point, I was calling this the "machine spirit" of the object--there's almost an animistic sense to this idea. You act, and the object "responds" in some way. A rubber band gives moments before it snaps, or the tone of a kettle changes as the water starts to boil. 

My comment here is a bit narrow, but re

• While working on math, physics, or a program, track types/units

A lot of people get surprised at how quickly and easily I intuit linear algebra things, and I think a major factor is this. For linear algebra, you can think of vector spaces as being the equivalent of types/units. E.g. the rotation map for a diagonalization maps between the original vector space and the direct sum of the eigenvectors. Sort of.

It's always the first question I ask when I see a matrix or a tensor - what spaces does it map between?

Tracking an estimate of how warm food is while being cooked and how its consistency changes (ex. what the bottom of a slice of eggplant looks like without flipping it over).

Precisely estimating the note I will sing before singing it. I'm never totally accurate, but I find it extremely helpful in order to become more accurate.

Tracking an estimate of how my/another's body will feel after I massage it in an area/move it in a way.

Tracking an estimate of the risk of germs on my hands.

Tracking an estimate of the line that is at the center of my body's mass and runs in the direction of gravity's force (helps me balance).

Tracking an estimate of what percentage of people will read my entire post.

My ears are stopped up, and I can't hear as much as I normally can. I was petting my fuzzy chair and couldn't hear it when I expected to be able to.

I estimated what I would hear if I were able to and wondered if my mind might be able to pick up on analogous cues (the feeling or smell of the fuzz) until, after practice, I could actually hear, but through other sensory mechanisms than my ears.

I track how helpful this idea may be for informing the connection between mechanical senses and experience.

I track how much clearer of an insight I might be able to share if I spend more time thinking about this.

Curated. I think figuring out how to transfer hidden/illegible skills is a major bottleneck and like this post for digging into that. 

I do agree with Algon's comment [LW · GW] that simply asking an expert what they're tracking may not be good enough – some expert's brains seem nicely legible and accessible to themselves, sometimes they're tracking so much stuff it's  hard to articulate.

Great post. Would add as an example: "While thinking about something and trying to figure out your viewpoint on it, track internal feelings of cognitive dissonance and confusion"

While in a conversation tracking how the other person is trying to interpret the motives behind what I'm saying and trying to control that by what I say.  This can get multiple levels of complex fast.  I recently had a really important conversation and I ended up saying things like "I mean exactly what I'm saying" and "I'm not anxious, I just can't afford to let you misunderstand me".  Unfortunately this made it seem like I was definitely anxious, and meant something other than I was saying.

The world is full of scale-free regularities that pop up across topics not unlike 2+2=4 does. Ever since I learned how common and useful this is, I've been in the habit of tracking cross-domain generalizations. That bit you read about biology, or psychology, or economics, just to name a few, is likely to apply to the others in some fashion.

ETA: I think I'm also tracking the meta of which domains seem to cross-generalize well. Translation is not always obvious but it's a learnable skill.

As a complement or intro to this technique, I find it helpful to create checklists. This helps me identify the most important items to track. I can either do it in my head, or externally via the checklist. It's often easy to come up with a reasonable checklist if you can define the topic specifically enough. Once I've created a checklist, and worked with it enough to commit it to memory, I find that new relevant information is easy to synthesize. If I encounter new information with no checklist, on the other hand, it's very hard for me to remember or make sense of it.

Hmm, I don't think this kind of tacit knowledge and skills is at all obvious to the holder. In most cases it's like asking a centipede how exactly it walks. Feynman was unusually introspective about this, not an easy example to follow for mere mortals. 

A lot of items in your list are about modeling other agents and yourself. In an embedded agency abstraction hierarchy it would be close to the top (model the general environment, model other agents, model self), so probably a recent evolutionary development, not very well entrenched into the genome, that's why we have trouble "just doing it" and need to introspect to make it make sense.

I'm a pretty good poet. I usually don't share my poetry except with close friends, but take my word for it, my poetry is good enough that I think the majority of people who heard it would like it. What am I tracking when I write a poem?

Well, it happens almost automatically - if I have inspiration, the poem just comes out; if I don't have inspiration, I can sort of try to write something but it doesn't work. So it's a partly subconscious process already and not necessarily something that can be analyzed like this; but I know at the very least I am tracking meter, rhyme, and alliteration.

It seems like, if this hypothesis is correct, there must be other things I am tracking - you can be great at meter, rhyme, and alliteration and not make a very interesting poem - but I'm not sure what else.

Style and themes, perhaps. But both of those are very "needs a neural net to recognize and can't be explicitly defined" things.

I think this concept is important. It feels sort of... incomplete. Like, it seems like there are some major follow threads, which are:

• How to teach others what useful skills you have.
• How to notice when an expert has a skill, and 
  • how to ask them questions that help them tease out the details.

This feels like a helpful concept to re-familiarize myself with as I explore the art of deliberate practice [LW · GW], since "actually get expert advice on what/how to practice" is one of the most centrally recommended facets.

While absorbing claims/information, track an estimate of the physical process which produced the information, and how that process entangles the information with physical reality.

Can you give an example?

I track my confidence in a given step of a hypothesised chain of mathematical reasoning via a heuristic along the lines of “number of failed attempts at coming up with a counterexample”.

This post reminded me of the exercises in Calibrating with Cards [LW · GW], a post which very nicely advises what to pay attention to during magic practice.

I  started writing down things I am tracking.

I actually never realized I am tracking so many things.

The problem and issue is, I rarely remember or know what to do with the tracked information.

Lets say I am trying to be engaging and have a discussion.

There could be a number of things to track, from motives, meanings, or specific reasons something is said.

Other thing to track is filling in the gaps. Lets say someone says something incomplete, one should when engaged fill in the gaps and ask question or find a way to follow up.

Another thing is to know you are actually communicating the things you think you are communicating.

Or further when you track your words whether they actually are understood or misinterpreted while maybe simultaneously trying to get feedback form the person, be it verbal or non verbal reaction.

For me big part is also facial expression, or being properly engaged. 

Lets say I have a good focus and aim to do this.

Well realistically this will have no real impact as its a massive number of tasks. 

Not to mention being self conscious in the moment about the various errors. 

The other key factor for me is keep track of communication to know that whatever I said or made clear, is actually inline with my intent. 

I also have to track what not to say or do. Which depends on context and that can be rather trick to figure in the moment now.

Finally, the obvious question: what extra information do you mentally track, which is crucial to performing some task well?

I track the age of data.

Here are a couple examples of how this is helpful:

1. Wikipedia has case counts by country for the 2022 monkeypox outbreak. Portugal was one of the leading countries for a while in number of confirmed cases, but it has since been surpassed by others. However, on closer inspection, the numbers for Portugal haven't been updated since the 7th of July, 5 days ago. In the context of exponential growth, that matters a lot!
2. I'm developing an aptamer for my MS thesis. Currently, I'm looking at the highest-affinity aptamers in the main online database, which has ~750 examples. This aptamer has impressive affinity, in the fM range. However, I notice that the paper announcing it was published in 1997. This suggests either that the database is not well-maintained (in which case I shouldn't rely on it to be an accurate representation of the state of the field), or that the field of aptamer research is not improving in terms of its ability to produce high-affinity aptamers (in which case that is a worrisome sign for either technology itself or capacity of the research community to achieve its potential).

An "isthmus" and a "bottleneck" are opposites. An isthmus provides a narrow but essential connection between two things (landmass, associations, causal chains). A bottleneck is the same except the connection is held back by its limited bandwidth. In the case of a bottleneck, increasing its bandwidth is top priority. In the case of an isthmus, keeping it open or discovering it in the first place is top priority.

I have a habit of making up pretty words for myself to remember important concepts, so I'm calling it an "isthmus variable" when it's the thing you need to keep mentally keep track of in order to connect input with important task-relevant parts of your network.

When you're optimising the way you optimise something, consider that "isthmus variables" is an isthmus variable for this task.

One answer to the question for me:

While writing, something close to "how does this 'sound' in my head naturally, when read, in an aesthetic sense?"

I've thought for a while that "writing quality" largely boils down to whether the writer has an intuitively salient and accurate intuition about how the words they're writing come across when read. 

Now that I read this, I notice that I automatically do this when i'm in school, and that it's much more automatic and frequent in subjects I find easy (I wonder whether it's the tracking that makes it easy, or whether less effort frees up brain space to track?).

In history class, I always keep a mental map of when something happened, why it happened, and what resulted from it. I was very surprised when I found out none of my friends do anything similar, because it's such an obvious tool for seeing the bigger picture and remembering how things fit together for me.

I also tend to track "what do think was the creator's though process was here?" a lot, both casually and critically. Highly recommend, it helps you see the work and thought that went into it much better, which I personally enjoy a lot (though it also significantly raised my standards for practically all kinds of media as well, so it might not be for everyone). 

Tracking seems crucial to deeper understanding of abstract things, and put like this, I believe most people who are very good at something specific probably track something automatically all the time. Either way, it seems promising to test your hypothesis. I will definitely be asking some people the "what are you tracking in your head?", maybe something useful will come of it.

Another immediate question is "for what tasks you don't have to do that?", partly because then one can ask the following question of why. For example, I think now that one doesn't have to track extra information when feeding livestock. (A not-too-variable time-consuming routine.) But I haven't yet really tracked what I do when I do that.

minor feedback...

Mentally tracking extra information is exactly the sort of technique you’d expect to benefit a lot from excess cognitive capacity, i.e. high g-factor. Someone who can barely follow what’s going on already isn’t going to have the capacity to track a bunch of other stuff in parallel.

note that as one practices tracking something, the effort needed to track it goes down.

i don't think it makes sense to think of it like needing excess cognitive capacity to track things. i think our skill improves to the point of needing little to no excess cognitive capacity. so we only need excess cognitive capacity for new things we want to track. 

It may be critical to note that tracking estimates of the internal states of other entities often feels like just having a clue about what's going on. If someone asks us how we came to our intuitions, without careful introspection, we might answer with "I just know" or "I pay attention is how!" or similar.

To unpack a mundane example, here's a somewhat rambly account of some of what I'm tracking in my head while I operate a motor vehicle:

When I'm driving, I don't actively scan through all the sounds and smells and tactile events and compare them with past experiences with this and other vehicles. But I sure notice if the steering is a little tight when my foot is on the brake! Likewise, I couldn't tell you anything about steering and pedal angles, but I can note subtle differences in the way I'm operating the car when there's reason to believe the road may be slick.

Interrogating these facts can reveal that I must be tracking things like the weather, what drive mode I'm in, the sounds of the engine and the tires on the road, the texture of the steering feedback, &c.; but I notice that actually catching myself doing that monitoring can be tricky - especially if I want to perform the task of driving without error. Doing so can detract from my ability to effectively monitor other things like the position of my vehicle on the road, the configuration of traffic in my immediate vacinity, the current distance to my next turn, the distance I'm keeping from the vehicle in front of me relative to my current speed and road conditions ...

But monitoring an estimate of my own internal state is a skill that can be practiced too, and one I must develop if I am to drive safely! I can rightly think of my body-mind-complex as a component in the system I'm trying to operate here, and if the body is drowsy or hungry or the attention is variable in this moment I would do well to adjust my driving to compensate.

Add to this the process of continuously correlating the behavior of other driver-vehicle-systems with possible and likely future movements.

I'm not sure if driving is unusually complex, or if most things go this deep. (Somebody do walking or typing or eating and see if those activities are similarly complicated.) I do know I didn't list everything I know goes into building my intuitions on the road. (Feel free to shout out the important things I missed.)

Two thoughts:

Many with unusually high "g"appear to have a tendency toward social blindness and trouble with "theory of mind" and tracking others internal states. I wonder if many have reminded themselves to consciously track any cues to other's internal states. Example: hmm that person is exhibiting signs of boredom and body language indicating a desire to flee when I discuss the coding problem I've been struggling with.

As someone prone to impulsivity in youth I've come to appreciate a tendency toward intrusive terrible images or "intrusive thoughts". They dont require any conscious effort but if I'm engaged in something where a lack of attention or a wrong move could cause devastation my mind will happily flash a fully formed detailed image of an intense, exaggerated unpleasant potential outcome. Though I have had to develop ways to dissipate the images so they don't cling.

There’s something really odd about that: it made me notice that I have either trouble tracking many things like that, or trouble bothering to track these things (since it wasn’t so much of an issue a few years ago, maybe the latter is more likely). Can anyone relate or am I weird? How do I learn to track more?

Also, the advice of asking mentors what they track seems really good!

When outside, I'm usually tracking location and direction on a mental map. This doesn't seem like a big deal to me but in my experience few people do it. On some occasions I am able to tell which way we need to go while others are confused.

This reminds me of dual N-back training. Under this frame, dual N-back would improve your ability to track extra things. It's still unclear to me whether training it actually improves mental skills in other domains.

When thinking about a physics problem or physical process or device, I track which constraints are most important at each step. This includes generic constraints taught in physics classes like conservation laws, as well as things like "the heat has to go somewhere" or "the thing isn't falling over, so the net torque on it must be small".

Another thing I track is what everything means in real, physical terms. If there's a magnetic field, that usually means there's an electric current or permanent magnet somewhere. If there's a huge magnetic field, that usually means a superconductor or a pulsed current. If there's a tiny magnetic field, that means you need to worry about the various sources of external fields. Even in toy problems that are more like thought experiments than descriptions of the real world, this is useful for calibrating how surprised you should be by a weird result (e.g. "huh, what's stopping me from doing this in my garage and getting a Nobel prize?" vs "yep, you can do wacky things if you can fill a cubic km with a 1000T field!").

Related to both of these, I track which constraints and which physical things I have a good feel for and which I do not. If someone tells me their light bulb takes 10W of electrical power and creates 20W of visible light, I'm comfortable saying they've made a mistake*. On the other hand, if someone tells me about a device that works by detecting a magnetic field on the scale of a milligauss, I mentally flag this as "sounds hard" and "not sure how to do that or what kind of accuracy is feasible".

*Something else I'm noticing as I'm writing this: I would probably mentally flag this as "I'm probably misunderstanding something, or maybe they mean peak power of 20W or something like that"

The extent to which you can benefit from asking what someone is tracking in their head, and the degree to which they can usefully explain it to you, will depend critically on how much information, basic to the topic at hand, you two of you already share.

You can learn more from a master, using this technique, the more you already knew.

If “cognitive capacity” is the amount of information useful to some specific domain of problem solving one has in one’s head, then everyone on Earth has more or less the same cognitive capacity (excepting only people with some diagnosable mental disability). Everyone has, more or less, the same amount of information in their long term memory as everyone else, applicable to the problems they have had the most experience with during their lives to that point (controlling for age).

If you ask why some people demonstrate greater ability to master certain problem-solving domains than other people do, then the answer lies in the way that human long term memory is organized. Our ability to learn new categories of things depends on our prior possession of categories of similar things: people assimilate new knowledge to old knowledge that shares similar characteristics. For example, the more types of animals one already knows, the easier it is to add another type of animal to memory, which will allow that person to make finer distinctions between specific animals (that’s not just a cat, it’s an American Longhair).

“Tracking” information while considering someone’s explanation of a problem probably includes observing how closely new information corresponds to previously encoded categories. That certainly seems to be what Feynman was doing: he was able to apply a schema based on the characteristics of balls, along with information he knew about set theory, to a proposed set of new information from another expert in his field. When the new information deviated significantly from what he knew about sets of actual balls, he concluded that the new idea was “false” (ie, he could not assimilate the new information into the categories he already had).

Therefore, my prediction is that the more advanced the student in a specific domain, the more they will be able to benefit from asking the teacher what they are tracking in their head, and the more elaborate the set of knowledge categories the teacher has already developed the easier it will be for the teacher to report tracking something that would be of benefit to the student (plus the degree to which the teacher is able to self-reflect on what is going on in their own head, an entirely different set of skills).

In other words, it’s a technique that is most appropriate for advanced students, and skilled teachers.

When programming, I track a mixed bag of things, top of which is readability: Will me-6-months-from-now be able to efficiently reconstruct the intention of this code, track down the inevitable bugs, etc.?

"Finally, the obvious question: what extra information do you mentally track, which is crucial to performing some task well?"

When I try to cook something complicated by recipe, I go over each line of the recipe and previsualize all the corresponding physical actions.
I previsualize the state, amount, location and the transitions for each  object. Objects = {pots, pans, ingredients, oil, condiments, package, piece of trash, volume of water, stove, task-completion times, hands, free seconds/minutes for cleaning during the cook, towel, tissue paper...}.
This tells me where the recipe is underspecified or needs to be adapted to my kitchen and allows me to fix the uncertainty beforehand, instead of giving me a puzzle in the moment where a bunch of parralelized tasks severely limit the estimated available interruption-free cognitive capacity. I try to go for a high-fidelity visual simulation and run it multiple times (obviously I speed it up). 
If the recipe is already chunked into stages, I mentally review them seperately. I also think of the "why" of the steps within the recipe. It's far easier to memorize a complex structure, if I can logically appreciate why it looks like that. Also I mentally set markers for expected free minutes, where I have time to re-review the next stage.

If I do all of that, cooking something complex becomes quite joyful and easy, instead of stressful.
I am not really a visual thinker. Visual thinking is aversive to me.
Or perhaps... it's more anti-mimetic, as it's just not a cognitive option that naturally occurs to me. Because I'm just far more performant in thinking by combining verbal abstractions. Path dependency and all that.
However, intellectually I know, that if I could sharpen and practice my visual thinking subskill, I can in time dramatically increase my cognitive capabilities.
For example, I recently found the recursive formula for cubes, just by visualizing it whilst drinking coffee in my gym. (no written notes)
m:= n+1
m^3= n^3 + 3n^2 + 3n + 1
[normally, you'd only use n instead of defining m as the successor, but I find this to be needlessly difficult, because it causes a ton of interference for me]

It was a bit challenging, but also something that I just started spontaneously doing for fun. And I'm pretty sure I could find the general formula for n^m (m being a natural number) too, next time I have a liminal context, that usually ends up seeing me preoccupied with fantasies and mentally rehearsing arguments.
For a true visual thinker, this probably is "just obvious" but this is me shrinking the gap. So... baby steps.

But during my day-to-day cognitive operations the hyerbolic utility functions (fancy way of saying "impatience") means, I don't want to use those underdeveloped skills.
Practicing unusual thought patterns with no clear momentary payoff is frustrating and cognitively exhausting. And if I'm drained like that, I'm at very high risk for the YouTube/book/daydreaming/websurfing-etc. -cognitohazards.

But for cooking something difficult, visualization has proven so extremely useful, that I'll always do it there now. Because when I am lazy and just read and execute the recipe as I go along (my prior default), the whole process is far more cumbersome, frustrating and the outcome is unsatisfying. And I don't actually get much better or more comfortable at cooking itself. Because visualization has such incredibly high applicability in this domain, I actually have far less internal resistance when using it. Therefore can visualize far better in this context, than normally. And by updating what I'm actually already capable of, I'm slowly making it more salient/less anti-mimietic/less aversive as an option.

In the main, isn’t this post mostly representing the idea of tacit knowledge, albeit under a different name?

https://en.m.wikipedia.org/wiki/Tacit_knowledge

This sounds a lot like mindfulness.  :-)

The example that immediately popped into my head was the difficulty I had training lawyers to conduct a jury trial.

You spend so much time building up a persuasive story to tell, but at trial most of your mental effort is elsewhere.

You have the jury, individual jurors, the judge, the witnesses, and opposing counsel, your story, the opposing story, and rules of evidence and procedure. All of these things are moving and changing at the same time.

It felt unteachable. I've said things like "it takes extreme observation".

Cool post :)

This is essentially what machine learning, especially ANN, is.