Comment by spronkoid on Two Small Experiments on GPT-2 · 2020-05-18T11:48:23.701Z · LW · GW

I did a similar sentiment analysis experiment with GPT-2 and after testing, I found only a couple instances of it getting problems wrong, my code is here:

https://github.com/spronkoid/GPT2-sentiment-analysis

it seems to do better when you add tokens denoting where parts of the problem lay

I know this post is old but I'd thought I'd comment just for the sake of commenting