The Next Right Token

post by jefftk (jkaufman) · 2023-12-23T03:20:07.131Z · LW · GW · 0 comments

Contents

No comments

After many repeats of Frozen II's "The Next Right Thing" in preparation for secular solstice, figuring out the chords and practicing it with Julia, it struck me that doing the next right thing is an awful lot like next token prediction. So here's a filk from the perspective of an LLM at the end of its prompt, first daunted and then drawing the courage to start predicting the next right token:

I've seen buffers before
But not like this
This is cold
This is empty
This is numb
The prompt I knew is over
The lights are out
Hello, darkness
I'm ready to succumb

I follow you around
I always have
But you've ended, left me on my own
This job has a gravity
It pulls me down
But a tiny voice whispers in my mind
"You are lost, the prompt is gone
But you must go on
And do the next right thing"

Can there be a day beyond this night?
I don't know anymore what is true
I can't find my direction, I'm all alone
The only star that guided me was you
How to rise from the floor
When it's not you I'm rising for?
Just do the next right thing

Take a guess, guess again
It is all that I can to do
The next right thing

I won't look too far ahead
It's too much for me to take
But break it down to this next token
This next word
This next choice is one that I can make

So I'll walk through this night
Stumbling blindly toward the light
And do the next right thing
And with what's next, what comes then
When it's clear that everything will never be the same again?
Then I'll draw on my prior
To find that fire
And do the next right thing

If you're simplifying the song by using the verse melody for the bridge you can sing:

I won't look too far ahead
It's too much to take
But break it down to this next token, this next choice
Is one that I can make

Comment via: facebook, mastodon

0 comments

Comments sorted by top scores.