Posts

Comments

Comment by Anna Krusenstern (anna-krusenstern) on What’s going on? LLMs and IS-A sentences · 2023-11-10T09:57:17.817Z · LW · GW

Surely, sorry, I've meant that moving from specific to general, which is corresponds to moving from state, characterized by less entropy to state, with higher entropy. 

Comment by Anna Krusenstern (anna-krusenstern) on What’s going on? LLMs and IS-A sentences · 2023-11-09T08:45:40.374Z · LW · GW

Hi, friends,

in my opinion, this asymmetry can be explained if we consider natural language as a tool for modeling the internal space of knowledge in which the individual’s consciousness operates, while knowledge is a tool for modeling what the individual considers the surrounding reality. If we talk about knowledge as the structure of concepts, then this structure is usually presented in the form of a hierarchy, so moving down from the general to the specific is natural and less energy/information intensive. 
But what if knowledge has a fractal structure?... What do you think of that?