Comment by Jesse Dale (jesse-dale) on Language Models Model Us · 2024-06-03T12:15:36.233Z · LW · GW

Have you considered other response modalities? Would it worthwhile having numeric representations of trait strength for example over plain text classification?

I have an observation that LLMs are highly effective at approximations but not effective at precision, do you think the variety in responses has an effect on accuracy? Eg sexuality, was represented commonly as a boolean value, forces a level of precision that the model isn't efficient with?