Old post/writing on optimization daemons?
post by jbkjr · 2021-04-15T18:00:17.923Z · LW · GW · 2 commentsThis is a question post.
Contents
2 comments
I'm having trouble locating an old post about optimization daemons that I know I read at one point. I believe it was written by Eliezer. It featured a lot of visual imagery of the daemon steering the path of the model through parameter-space by e.g. forcing it through narrow paths towards low loss surrounded by walls of high loss. Does anyone know which post I'm remembering?
Answers
2 comments
Comments sorted by top scores.
comment by Rohin Shah (rohinmshah) · 2021-04-15T23:41:32.026Z · LW(p) · GW(p)
This probably isn't the thing you mean, but your description kinda sounds like tessellating hills [LW · GW] and its predecessor demons in imperfect search [LW · GW].
Replies from: jbkjr↑ comment by jbkjr · 2021-04-17T18:53:56.793Z · LW(p) · GW(p)
Ah, it was John's post I was thinking of; thanks! (Apologies to John for not remembering it was his writing, although I suppose mistaking someone's visual imagery on a technical topic for Eliezer's might be considered an accidental compliment :).)