Comment by gpt_4_all on QAPR 5: grokking is maybe not *that* big a deal? · 2023-09-25T21:41:06.098Z · LW · GW

Got it, thanks!

Comment by gpt_4_all on QAPR 5: grokking is maybe not *that* big a deal? · 2023-09-25T04:19:14.863Z · LW · GW

Hey! Out of curiosity, has grokking been observed in any non-algorithmic dataset to date, or just these toy, algorithmic datasets?