Comment by Girchuck on That Alien Message · 2012-11-24T23:21:49.237Z · LW · GW

But why should a programming team start building a Friendly General Intelligence unaided? They can build tools to help them. For example, Create an expert system with very limited or no self-modification, that will give as output FAI models Then make another expert system based on a better model. Use recursion, but make it slow and get skills with the tools.