Comment by dulleh on GPT-3: a disappointing paper · 2020-07-24T22:13:35.848Z · LW · GW

I would like to see it be given a list of the natural numbers (in order) as a prompt and then asked to do basic arithmetic. I wonder if the scores would improve over what's been reported. In particular, would be interesting to see if '1 2 3 4 ... N, what is 14 + 15?' type prompts improve on the zero shot performance?