Comment by Marco Aniballi (marco-aniballi) on The idea that ChatGPT is simply “predicting” the next word is, at best, misleading · 2023-02-25T14:29:08.547Z · LW · GW

While Wolfram's explanation is likely the fundamental premise upon which ChatGPT operates (from an initial design perspective), much of this article assumes a deeper functioning that, as is plainly admitted by the author, is unknown. We don't KNOW how LLMs work. To attribute anything more than reasonably understood neural weighting algos to its operations is blue sky guessing. Let's not waste time on that, nor on speculation in the face of limited accessible evidence one way or the other.