Posts

Comments

Comment by FL33TW00D on Do humans really learn from "little" data? · 2025-01-14T11:00:27.616Z · LW · GW

I think you're missing a trick here purely focusing on waking seconds.

Demis explains this beautifully in this talk here:

TLDW:

The brain replays memories stochastically during sleep, and replays them OOMs faster than they were experienced. This "multi epoch training" allows the brain to learn much more from the environment, and it can prioritise salient experiences.