Posts
Comments
Comment by
Carlos Ramón Guevara (carlos-ramon-guevara-1) on
Adam Optimizer Causes Privileged Basis in Transformer LM Residual Stream ·
2024-09-11T11:54:56.582Z ·
LW ·
GW
Still elementwise, so yeah
Comment by
Carlos Ramón Guevara (carlos-ramon-guevara-1) on
Bing Chat is blatantly, aggressively misaligned ·
2023-02-17T20:31:25.697Z ·
LW ·
GW
Apparently a "Sydney" model existed at least as early as 17 Dec 2021.
Comment by
Carlos Ramón Guevara (carlos-ramon-guevara-1) on
SolidGoldMagikarp (plus, prompt generation) ·
2023-02-13T15:58:11.116Z ·
LW ·
GW
Why do you think that GPT-3 has untied embeddings?