Comment by wkey55 on Self-supervised learning & manipulative predictions · 2020-11-27T08:53:27.500Z · LW · GW

I used your idea of "a" vs. "an" agreement with the following word as the basis of a GPT-3 experiment to show that GPT-3 indeed probably does do lookahead. The details are at https://www.reddit.com/r/GPT3/comments/k0mvf3/experiment_that_shows_that_gpt3_can_probably_plan/.