Comment by Kipler on Speculations against GPT-n writing alignment papers · 2021-06-08T07:41:50.940Z · LW · GW

I find your argument interesting but I don't understand how it applies for the GPT-n family.

From my understanding GPT-3 (the only one I really have read about) is merely a probabilistic language construction algorithm. In other words you feed it a sequence of words and it tries to guess the most likely word that follows. It guesses that from all of the texts it previously read during its training. However I might not have correctly understood GPT-n functioning, in that case I'd  love to get an an explanation or a link toward one.
 

On the other hand I find the idea of making an AI introspect very interesting, even if I'm not qualified enough to understand the technical implications of that.