Evolutions Are Stupid (But Work Anyway)

Eliezer,

Your posts on evolution are fantastic. I hope there will be many more of them.

Eliezer, it certainly seems that you go over your "writer's molasse". Congrats!

This is an excellent post. I have revised my opinion on evolution.

The same fate would accrue to any human planner who tried making random point mutations to their strategies and waiting 768 iterations of testing to adopt a 3% improvement.

The counterargument here is that it might be worth doing if each iteration of testing is cheap enough. With enough computing power, one might very well be able to do that much simulation cheaply and quickly. (One reason genetic algorithms work is that they're simple enough that we understand how they work, even if their outputs are unpredictable. We aren't capable of modeling human creativity yet, so throwing enough computing power at a much dumber algorithm that we know works will still give amazingly good results.)

Nice calculations!

But don't these calculations establish a lower bound on how complex or adaptive genetic evolution is? But not an upper bound?

It would seem that, using the same approach toward a nervous system would lead one to calculate the adaptiveness of a dendrite - or less. Uh, what is a part of nervous system operation that seems comfortably "understood" to the same extent as AGTC operations? Whatever part that is, would, in a fair comparison, be what could be compared to the mechanism these calculations describe. Yes?

Anyway, isn't it premature to assert, "Natural selection, though not simple, is simpler than a human brain", given the current understanding of either?

And, please, let's not go too far along the road of "Look how smart we are! Evolution didn't produce diddly, while, in only 4 hundred years we have produced millions of My Little Pony dolls." Evolution produced cow pies, which we are still struggling with, after all. :)

Speculation of what nervous systems and genetic evolution do in common sure seems like fertile ground, though. It would be interesting to know, for instance, what's both necessary and sufficient to describe both.

"According to biologists' best current knowledge, evolutions have invented a fully rotating wheel on a grand total of three occasions"

Eliezer, what do you mean by this? I think my brain is not working today or something cause this seems like it's either a joke (which I do not get) or a reference to something in biology (which I am not aware of).

Other than that bit of confusion, this was a fantastic post. I think the last few things you've written on evolution should be required reading in every biology class (especially high school ones). So many well intentioned people have a severe misunderstanding of evolution and what you've written I think can clear it up.

A couple thousand years ago, a guy appeared claiming to be God. Paradoxically, God said things like "All of you are Gods" and "God is inside of you." This upset the local religious leaders, who felt that God could be known from writings on scrolls. So they had the occupation troops arrest God, put him on show trial, and execute him. God has not returned since.

Fifty-some years ago, a possum named Pogo said "We have met God, and he is us." Oh wait, Pogo did not say that. But Walt Kelly would have approved.

Today, lolcat says "Evolooshunz is not God, we iz God."

The same fate would accrue to any human planner who tried making random point mutations to their strategies and waiting 768 iterations of testing to adopt a 3% improvement.

If your engineers are struggling to produce even 1% improvements in your design, and the benefits of even a marginal improvement are sufficiently large, it might well be worth trying such a strategy. The more complex and humanly-incomprehensible the system is, the more likely that such a strategy would yield bonuses that rational analysis couldn't reach, as well.

Rationality is unspeakably powerful, but it's not everything.

"evolutions have invented a fully rotating wheel on a grand total of three occasions"

Eliezer, what do you mean by this?

Here's one

we can't build a self-replicating system the size of a butterfly

I must have missed when we built any self-replicating systems at all. . .

Here's another (molecular) wheel.

Rational thought needs a knowledge base; given that, it can outperform evolution. When the knowledge base is lacking and improving it is difficult, then an evolutionary strategy may be the best course. Lots of examples of genetic algorithms accomplishing what rational design couldn't (with the current knowledge base) at TalkOrigins.

The Mantis Shrimp (http://en.wikipedia.org/wiki/Mantis_shrimp) forms a crude wheel to maneuver on land.

But I still can't think of any examples of wheels in nature that use axles and are large enough to be more than a free floating rotating object. Maybe this seems an arbitrary threshold, but I think usually when we marvel at the wheel, we're marvelling at axles, and their ability to support weight and radically reduce friction when moving big heavy things, all while holding the object basically level. While the cellular turbines that power us are pretty fascinating in their own right, it'd be interesting if anyone could think of biological wheels with axles that were a bit bigger. So far, I can't think of any outside of science fiction.*

*Pullman's "The Amber Spyglass" even gives a somewhat plausible evolutionary background for his axled and wheeled Mulefa. Any others?

If we're not going to give the snake credit for evolving and using its rattle, we can hardly give the engineer much credit for evolving and using her brain.

And no matter what our engineer does, she is still a plaything in the hands of the fates, and the still larger hands of evolution. She's still just an experiment, a trial run.

Even though she stands at the doorway of being able to reengineer her own genes, and perhaps make an engineer twice as smart and longlived, she remains a pawn of evolution. It's the genes that will live on for thousands of generations, if successful -- not her.

I enjoyed your thought-provoking references here to God. The world is of course the way it really is, and a sound religion claiming a Creator of the world should have recognized in the real world the thought-prints of that Creator.

I find transcendence (an experience of the infinite) in science, art, and nature. (I'm a Spinoza Monist.) Religion seems to concretize experiences of transcendence into dogma about God and the world. Science embraces the transcendence of ever-greater transcendence.

Hey. I just work here. I mean, I'm just doing what my genes tell me to do. Soon, I will stop. But they're going places.

Thinking about your various metaphors (some implied, some explicit), I noticed the echo here. My genes are really just ideas about me, whereas I'm a concretized realization of those ideas (a unique and particular instantiation) that can't change any more than a religion can. I'm unimportant. The ideas about me in my genes, are transcendent. I sometimes feel we've got it backwards when we think they are about us. We are about them. We are certainly in service to them. We think our minds are disembodied and ride around in our bodies. Perhaps more accurately, our genes are disembodied and ride around in us.

/ehj2

Great to see more thoughts on evolution from you Eliezer - good stuff.

The three known times evolutions invented a freely rotating wheel are: ATP synthase, the bacterial flagellum, and an obscure third example discovered recently which I forget.

But don't these calculations establish a lower bound on how complex or adaptive genetic evolution is? But not an upper bound?

Those are average cases, not lower bounds. (It would be very surprising to see it happen either ten times faster or ten times slower.) Tomorrow we will discuss upper bounds.

Everyone: There's a lot of hype surrounding genetic algorithms. DO NOT GET YOUR INFORMATION FROM BUSINESS BOOKS PRAISING THE VALUE OF CHAOS. Read AI textbooks instead. Genetic algorithms are okay (human-competitive) at simultaneously optimizing 37 different criteria using some kind of single shape that can be continuously deformed. They're okay at designing algorithms with clearly defined success criteria that run fast most of the time in 37 lines of code. They suck like a vacuum cleaner at designing anything larger than that - defeated by the same exponential explosion that consumes most AI algorithms. Most genetic algorithms are not biologically realistic - the ones that do straight beam search, straight hill-climbing, typically do as well or better than the ones that try to imitate sexual reproduction. Remember that it took billions of years of evolution before the Cambrian explosion. Our genetic algorithms haven't gotten to the level of multicellular organisms or sex yet.

woah. thanks for the links about the evolved wheels. that's pretty awesome stuff right there hah.

Computing power is also increasing exponentially.

What fraction of the population must have the gene for it to be considered "fixated"; absolutely each an every member?

Yes.

Remember that it took billions of years of evolution before the Cambrian explosion.

That would be a powerful argument, if biological evolution had a telos that included the production of complex multicellular organisms. Sadly, it doesn't. Astronomically speaking, rock-eating, single-celled creatures are probably far better equipped for survival in this universe than we are.

Evolution seems to have you outnumbered.

What fraction of the population must have the gene for it to be considered "fixated"; absolutely each an every member?

In the equations, yes, I believe that's what's being calculated.

If this seems extreme, consider a complex machine like an eye, which probably has at least 100 genes, maybe 1000 if you count the supporting visual areas of the brain, and imagine that each gene is independently at 99% frequency in the population.

But yes, you could overlap to some degree in the evolution of complex machines; there'd be significant pressure for B once A was 50% frequent. I don't know off the top of my head how to calculate time to 50% frequency.

Probability of fixation = 2s

there are assumptions that go into this calculation, of course. the most important ones are the mutation is dominant and that the population size is constant. if the populations size is decreasing, the fixation probability goes down, and vice versa. deviation from dominance as well decreases the fixation probability.

This should not be surprising; genes have to do all their own work of spreading. There's no Evolution Fairy who can watch the gene pool and say, "Hm, that gene seems to be spreading rapidly - I should distribute it to everyone." In a human market economy, someone who is legitimately getting 20% returns on investment - especially if there's an obvious, clear mechanism behind it - can rapidly acquire more capital from other investors; and others will start duplicate enterprises. Genes have to spread without stock markets or banks or imitators - as if Henry Ford had to make one car, sell it, buy the parts for 1.01 more cars (on average), sell those cars, and keep doing this until he was up to a million cars.

Fantastic paragraph in a really interesting piece.

Then other evolutions don't imitate it. If snake evolution develops an amazing new venom, it doesn't help fox evolution or lion evolution.

The only nitpick would be the possible spread of genes through horizontal gene transfer, but in mammals that seems like it would be trivial in most any sense of the word.

Its a good post, but didn't get to the effect of million/billions of experiments (organisms) going on simultaneously. So it might take a long time for a particular improvement to get fixed, if there is selection pressure something will change to meet that. There are lots of simultaneous pathways to the end (reproduction).

While I stand by my first comment, in the interests of appropriate uncertainty I couldn't resist submitting for thought this quote from one of Eliezer's favorite papers, The Psychological Foundations of Culture

"The fact that evolution is not a process that works by "intelligence" cuts both ways, however. Precisely because modifications are randomly generated, adaptive design solutions are not precluded by the finite intelligence of any engineer. Consequently, evolution can contrive subtle solutions that only a superhuman, omniscient engineer could have intentionally designed."

Yes, and Tooby and Cosmides ended up on the wrong side of the argument with Tversky and Kahneman about to what degree biases are contextually adaptive rather than reflective of computational limits.

I've noticed that none of my heroes, not even Douglas Hofstadter or Eric Drexler, seem to live up to my standard of perfection. Always sooner or later they fall short. It's annoying, you know, because it means I have to do it.

Yes, and Tooby and Cosmides ended up on the wrong side of the argument with Tversky and Kahneman about to what degree biases are contextually adaptive rather than reflective of computational limits.

That seems reasonable.

In your opinion, are they right about to what degree human intelligence is dominated by domain-specific modules, and that that's a consequence of combinatorial explosion and the frame problem? Since reading it yesterday some of my barely conscious assumptions about intelligence have evaporated and I've started seeing words like "intelligence" and "learning" to be acting as curiosity-stoppers in many contexts. Thanks.

In your opinion, are they right about to what degree human intelligence is dominated by domain-specific modules, and that that's a consequence of combinatorial explosion and the frame problem?

They're certainly righter than the Standard Social Sciences Model they criticize, but swung the pendulum slightly too far in the new direction. Human beings are capable of learning a tremendously wider range of nonancestral tasks than chimpanzees, and precisely due to the combinatorial explosion, this cannot be itself explained by postulating any amount of domain-specific modularity. The brain is modular, and some of these modules are certainly domain-specific, but the key modularity is the orthagonalization of intelligence into architectural components like memory and category formation, not domain-specific procedures. The heart is not a specialized organ for running down prey, it's a specialized organ for pumping blood.

In a sense, my paper "Levels of Organization in General Intelligence" can be seen as a reply to Tooby and Cosmides on this issue; though not, in retrospect, a complete one.

...we only really began accumulating knowledge, around... what, four hundred years ago?

Surely longer than that...what am I missing?

Wonderful essay, but when you write, "There's no Evolution Fairy who can watch the gene pool and say, "Hm, that gene seems to be spreading rapidly - I should distribute it to everyone", aren't you leaving out the classic evolution fairy, Cupid? Mate attractiveness is not usually random, and Cupid does seem to usually use some kind of fitness testing. I grant fully that a potential mate may not recognize the newly evolved trait as an advantage, but potential mates usually can perceive secondary indicators such as better health, higher group status, more active pursuit of mating, or a Mercedes.

Or am I missing something?

Wonderful essay, but when you write, "There's no Evolution Fairy who can watch the gene pool and say, "Hm, that gene seems to be spreading rapidly - I should distribute it to everyone", aren't you leaving out the classic evolution fairy, Cupid?

What Eliezer is saying here is that biological adaptations cannot get fixed in a population by "becoming common knowledge" and being universally adopted, the way innovations in the business and engineering world spread. Even an artificial breeding program has to work within these constraints: there's a limit to how much reproductive skew you can supply.

Depends on how you think about and define a 1% advantage. You are using the biological definition, which is that having the gene gives you 1% more offspring on average. If however my genes make me 1% faster than everyone else that is a 100% advantage in winning the race, which can lead to large advantage in reproductive success. In this way a gene that generates a minor performance advantage can spread rather quickly.

IMO, "evolution" is singular for good reason - the ever-deepening mutual symbiosis of the biosphere. Species evolution simply does not take place in isolation. Anyway, "evolutions" seems to me to serve little purpose - except for making biologists splutter indignantly.

I cover the Gene A / Gene B business in: http://alife.co.uk/essays/species_unity/

...and the evolution is stupid business in: http://alife.co.uk/essays/evolution_sees/

And yet evolution designed the brain?!?!!!

for a human to look to natural selection as inspiration on the art of design, is like a sophisticated modern bacterium trying to imitate the first awkward replicator's biochemistry ...

Indeed evolution is a weak, slow, dumb process, but the key point is that it has operated over a staggering time frame and thus is has in fact created an extraordinary number of design brilliancies, many of which exceed their technological counterparts. Quick examples are low power flight and the human brain. Although it's important to note that evolution operates using simple repetition of trial and error routines, moving away from failure and not towards success, I'd hardly discard the insights from that process in favor of non-evolutionarily derived activities.

NATIONAL GEOGRAPHIC is lying all about this EVOLUTION stuff i mean a few years ago they has a issue about the so call missiong link between dinosurs and birds which was later proven a fake and they showed HINCKLES fake embryos and showed what looked more like a shaved little oranatang and TIME tried to comapare humans and chimps but TIME has been guilty in the past of using lies and fruad as real news

Great post once again. There is one thing I wonder about : AFAIK there is our DNA a huge amount (my biology teacher at highschool was saying 90% I didn't double-check his figure) of code that is not "active", genes that are not used by the body to synthesize proteins. To my programmer mind they look like C source code that was disabled at compile time (say with a #ifndef SYMBOL #endif block, and SYMBOL not provided at compile time).

Would that somehow mitigate the fact that if gene B requires gene A, then gene B would be disappear unless gene A is spread ? Doesn't that allow some genes to be there dormant, to be activated (by a later mutation) and given a new try later on, either when some other gene is present, or when the environment change ? Or I misunderstood that part on "non-active DNA" ?

2s

TYPE ERROR. Consider fitness=.75.

Why has no one pointed this out? Am I missing something?

Generations to fixation = 2 ln(N) / s Probability of fixation = 2s

Are there domains limits for 's' on those equations?

It seems to me that if you have an s that is negative, you get a nonsensical answer for both equations. Though I suppose that equation one's answer can be interpreted to mean that it would take -[Generations to fixation] generations for a bad, but ubiquitous mutation to get winnowed down to one individual.

But with the second equation, a negative s leads to a less than zero chance of fixation and an s higher than 50% leads to a greater than 100% chance of fixation.

"we got guns, we got knives, we got pointy sticks; we got rockets,"

From now on I'm going to read everything EY writes in the voice of Private Hudson from Aliens.

A gene conveying a 3% fitness advantage, spreading through a population of 100,000, would require an average of 768 generations to reach universality in the gene pool.

Generations to fixation = 2 ln(N) / s = 2 ln(100000)/1.03 = 22.36 != 768

I'm confused.

Mutations conveying fitness advantage are tricky things in that there's always a trade-off between resources to build self and resources to reproduce (r/K strategies), and before you know what is the specific species' strategy, you can't decide if a (possible) 3% increase in offspring is going to change anything. (How do you measure it, anyway? Increased speed of replication? Increased probability of offspring survival to adulthood? It should be different for, say, always-free-living things and adults-forming-colonies things.)

Do you apply your model to asexually reproducing organisms, too? To parthenogenetic reproduction?

It is also unclear where you say 'gene' and mean 'a new gene', and not 'a different allele of the same gene' (which seems to be easier to do - insert a nucleotide here or cut it there, etc.)

Mutations can be somatic, and only part of the offspring will get them (if pieces of the 'mother' fall off and regrow).

And a gene (allele?) that goes on its merry way through 768 generations might get to be wide-spread through pure accident, if the organisms are sufficiently 'complex' and 'large' - it would take a lot of time, and populations don't usually stay the same size that long.

Also, I don't think why there is any reason to consider 'evolution' an optimizer rather than a simple diversifier. Everything that is not prohibited by thermodinamicc gets a shot.

Humans can do things that evolutions probably can't do period over the expected lifetime of the universe.

This does beg the question, How, then, did an evolutionary process produce something so much more efficient than itself?

(And if we are products of evolutionary processes, then all our actions are basically facets of evolution, so isn't that sentence self-contradictory?)

'I say "evolutions", plural, because fox evolution works at cross-purposes to rabbit evolution, and neither can talk to snake evolution to learn how to build venomous fangs.'

Interestingly, as we're getting better at analyzing genomes, we're discovering that this isn't strictly true.  Rabbit and fox cross-pollinating with snake would be a bit of a stretch maybe, but there are actually a number of what we once thought to be entirely separate lines of evolution which genetic testing has revealed to be true-breeding hybrids between a set of nearby species.

Also, it's looking like viruses can play a fairly substantial role in picking up genes from one species and ferrying them around to others.

Of course, all of that will pale in comparison to genetic engineering once we finish sorting that out.

"Science has a very exact idea of the capabilities of evolution."

Very exact? That's a pretty bold claim. And what do we mean by capabilities? Are we referring to biological evolution on Earth or the algorithm of evolution in a broader sense?

How fast mutations spread doesn't apply to the later. That is a tunable parameter in artificial evolution (which usually centers around not letting good mutations monopolize my population too quickly). The same can be said about what mutations occur (they don't have to be random in an artificial environment) or how "breeding" works. These and other parameters are biological accidents on Earth, not part of the core algorithm.

If you want to say "it's inefficient to mimic nature" then you should base that on the performance of humans who mimic nature not on nature itself, those are two different things. Evolutionary algorithms often work well in practice (including in situations where there is not an alternative that comes close), hence the more relevant evidence does not corroborate your hypothesis.