Hebbian Learning Is More Common Than You Think

post by Aleksi Liimatainen (aleksi-liimatainen) · 2022-06-19T15:57:08.378Z · LW · GW · 2 comments

Epistemic status: locating the hypothesis. I have my private confidence but you shouldn't take my word for it.

I originally got the idea from this video interview of professor Richard A. Watson where he explains how learning networks could arise naturally and be an important factor in evolution. The meat starts around 15 minutes in.

First, an intuition pump: If you had a suspended network of non-ideal springs, loading the network would slightly change the resting lengths of the springs for the next iteration. In effect, even a spring network has (admittedly limited) learning potential.

Dr. Watson focuses on evolution and makes his strongest case in that domain. In short, ecological stressors impose evolutionary pressures on individuals that cause the ecological relationships between species to change over evolutionary time in a manner consistent with Hebb's rule. In other words, individual selection powers Hebbian learning on the ecosystem level.

In the interview, he mentions his associate setting up an ecological simulation isomorphic to the rules of sudoku and getting it to perform at what would be considered a very high skill level for a human. I believe this to be the relevant paper. I haven't read more than the abstract; here's the most relevant quote:

We demonstrate the capabilities of this process in the ecological model by showing how the action of individual natural selection can enable communities to i) form a distributed ecological memory of multiple past states; ii) improve their ability to resolve conflicting constraints among species leading to higher community biomass; and iii) learn to solve complex resource-allocation problems equivalent to difficult computational puzzles like Sudoku.

Based on the above, I think learning networks arise frequently and spontaneusly in contexts involving biological life. This includes multicellular organisms, ecosystems and human networks such as economies, societies and civilizations. As of now, I don't have an easy way to evaluate the power of these networks but the potential implications seem large.

2 comments

Comments sorted by top scores.