What bootstraps intelligence?

post by invertedpassion · 2024-09-10T07:11:21.819Z · LW · GW · 2 comments

Contents

2 comments

Cross post from: https://invertedpassion.com/what-bootstraps-intelligence/

A musing on how intelligence comes to be.

The bedrock of intelligence is abstractions – the thing we do when we throw away a lot of information and just emphasise on a subset of it (e.g. calling that thing an apple instead of describing all its atoms and their x, y, z positions).

But where does the drive to form abstractions comes from? What if it rose from our desire to communicate with others? Since communication bandwidth is always limited, we are driven to find most efficient way of getting an idea across which leads to abstractions. Imagine a world where energy and time is unlimited, we might be communicating all x,y,z positions of things instead of putting labels on them.

We form abstractions when we notice some aspects of situations that we have encountered so far that we expect to find again in future situations. So the label “apple” becomes an efficient placeholder for all apple-like objects that are sweet and can be eaten.

It’s interesting to note that languages navigate a tradeoff between efficiency and fidelity. We want to communicate what we mean but we cannot spend enormous amount of energy on it. But we can’t spend too less energy too since communication channels are noisy and the recipient may not understand what we mean.

But since infinitely many abstractions for the same information is possible, how do we select which one to use? For example, why did the Arabic numbering system win over other alternative abstractions of numbers? Well, our abstractions are grounded by usefulness. In math, base-10 number system beat base-9 number system because we have 10 fingers and hence easier to count in base-10. (Of course, historical accidents may lead to initially inefficient systems such as Gregorian calendar to get adapted).

Why do we need to communicate useful abstractions? Because we are driven to co-operate by virtue of our shared gene pool. We know sharing useful abstractions are going to help the copies of our genes spread.

In summary, intelligence may have bootstrapped via the drive to help copies of ourselves survive better by sharing useful tools/abstractions.

PS; I find it interesting that in almost all AGI architectures, there’s no notion of replication, genes, survival, efficiency, inter-agent communication, energy, etc. – which might ultimately prove to be a useful framework in which intelligence arises naturally.

2 comments

Comments sorted by top scores.

comment by Eccentricity · 2024-09-10T07:24:39.822Z · LW(p) · GW(p)

You need abstractions to think and plan at all with limited compute, not just to speak. I would guess that plenty animals which are incapable of speaking also mentally rely on abstractions. For instance, when foraging for apples, I suspect an animal probably has a mental category for apples, and treats them as the same kind of thing rather than completely unrelated configurations of atoms.

Replies from: invertedpassion
comment by invertedpassion · 2024-09-10T09:12:13.407Z · LW(p) · GW(p)

I agree. Limited resources drives the need to have abstractions. Communication probably simply provides another drive to abstract at even higher levels.

I would imagine for many animals evolution would have pre-programmed abstractions like "object" or "fruits" so they come pre-parsed.