Old post/writing on optimization daemons?

post by jbkjr · 2021-04-15T18:00:17.923Z · LW · GW · 2 comments

This is a question post.

I'm having trouble locating an old post about optimization daemons that I know I read at one point. I believe it was written by Eliezer. It featured a lot of visual imagery of the daemon steering the path of the model through parameter-space by e.g. forcing it through narrow paths towards low loss surrounded by walls of high loss. Does anyone know which post I'm remembering?

Answers

2 comments

Comments sorted by top scores.

comment by rohinmshah · 2021-04-15T23:41:32.026Z · LW(p) · GW(p)

This probably isn't the thing you mean, but your description kinda sounds like tessellating hills [LW · GW] and its predecessor demons in imperfect search [LW · GW].

Replies from: jbkjr
comment by jbkjr · 2021-04-17T18:53:56.793Z · LW(p) · GW(p)

Ah, it was John's post I was thinking of; thanks! (Apologies to John for not remembering it was his writing, although I suppose mistaking someone's visual imagery on a technical topic for Eliezer's might be considered an accidental compliment :).)