What is the subjective experience of free will for agents?

how do I talk about how someone makes a decision and what a decision is from outside the subjective uncertainty of being the agent in the time prior to when the decision is made.

I am confused... Are you asking how would Omega describe someone's decision-making process? That would be like watching an open-source program execute. For example, if you know that the optimization algorithm is steepest descent, and you know the landscape it is run on, you can see every step it makes, including picking one of several possible paths.

I must admit I can't make any sense of your objections. There aren't any deep philosophical issues with understanding decision algorithms from an outside perspective. That's the normal case! For instance, A*

Eliezer is only answering the question of what the algorithm is like from the inside;

Do we have a good reason to think an algorithm would feel like anything from the inside?

it doesn’t offer an complete alternative model, only shows why a particular model doesn’t make sense;

Which particular model?

and so we are left with the problem of how to understand what it is like to make a decision from an outside perspective, i.e. how do I talk about how someone makes a decision and what a decision is from outside the subjective uncertainty of being the agent in the time prior to when the decision is made.

I can't see why you shouldn't be able to model subjective uncertainty objectively.

Okay, so now that I've had more time to think about it, I do really like the idea of thinking of "decisions" as the subjective expression of what it feels like to learn what universe you are in, and this holds true for the third-person perspective of considering the "decisions" of others: they still go through the whole process that feels from the inside like choosing or deciding, but from the outside there is no need to appeal to this to talk about "decisions". Instead, to the outside observers, "decisions" are just resolutions of uncertainty about what will happen to a part of the universe modeled as another agent.

This seems quite elegant for my purposes, as I don't run into the problems associated with formalizing UDT (at least, not yet), and it let's me modify my model for understanding human values to push "decisions" outside of it or into the after-the-fact part.

But indeterminism doens't state that the present moment happened inevitably, so what you are saying is not a genuine objection to indeterminism. And merely observing that something happened is not evidence that it happened inevitability, because inevitability is not a sense-datum.

I feel like we have a lot of evidence via our models of physics that are deterministic working that let us infer with high likelihood that the universe is deterministic. What is the specific alternative you are trying to offer (as in, what exactly does "indeterminism" mean), and what are your reasons for thinking it worth consideration?