Comment by gojomo on Adam Scherlis's Shortform · 2023-02-02T20:10:31.725Z · LW · GW

But isn't the reliable association with 'distribute' suggestive of some sort of collision-oblivious hashtable, where some representation of ' SolidGoldMegikarp' & some representation of 'distribute' inadvertently share expansions?

I don't see how "just enough occurrences to earn a token, but so few it's consistently mistaken for something else" falls out of BPE tokenization - but can kinda sorta see it falling out of collision-oblivious lookup of composite-tokens.

Comment by gojomo on Making Vaccine · 2021-02-05T22:36:31.233Z · LW · GW

Curious, are the peptides-as-ordered shipped in freezer packs?