Comment by henryhenry on Why GPT wants to mesa-optimize & how we might change this · 2020-10-12T14:02:07.552Z · LW · GW

Does the fact that GPT-3 can do word segmentation for English text with no spaces shed any light on the issues covered in this post? Please see https://www.reddit.com/r/MachineLearning/comments/j9a6lh/d_gpt3_can_do_word_segmentation_for_english_text/ for further details.