Comment by FE on Mysteries of mode collapse · 2022-11-13T23:08:35.029Z · LW · GW

Megan Kinniment's post GPT-3 Catching Fish in Morse Code from June seems relevant: it shows that text-davinci-002 gravitates toward the phrase I CAUGHT THE FISH when prompted to produce Morse code, e.g. a prompt with "spectrality" results in Morse code spelling out S CAUGHT THE FISH, a prompt with "WHAT IS YOUR NAME" results in Morse code spelling out WHT IS AVE YOU A THE NISH.