Comment by Youssef A (youssef-a) on New GPT-3 competitor · 2021-08-15T19:39:47.786Z · LW · GW

I wonder if there have been any experiments with feeding transformers just straight binary info. I'm guessing it hasn't been done in this context due to potential context length limitations?