Comment by Anderson Pozzi (anderson-pozzi) on The "spelling miracle": GPT-3 spelling abilities and glitch tokens revisited · 2023-08-07T05:00:29.136Z · LW · GW

Not exactly, it may just be a probabilistic nature of the human language. Having a correction are not always necessary the fact is, because of language patterns the AI can get a sense of what the next word is.

Like "The J. Robert Oppenheimer is the creator of the At-omic B-omb". In the end the misspelled enters in the same category of the non-misspelled version of the same word in the parameter space.