Comment by fhomeson on Phallocentricity in GPT-J's bizarre stratified ontology · 2024-02-21T00:35:39.153Z · LW · GW

Did you try getting the centroid of all words, rather than all tokens? The set of token will contain a lot of nonsense fragments.