Comment by wenboown on [Intro to brain-like-AGI safety] 6. Big picture of motivation, decision-making, and RL · 2023-10-18T15:25:23.327Z · LW · GW

It’s just a relatively simple, hardcoded input-output machine.

First, I am deeply fascinated by the effort you put into organizing the thoughts around this topic and writing these articles! Please accept my respect! 

I haven't read through all the articles yet so you might have mentioned the following somewhere already: I can imagine the "hardcoding" coming from our gene, thus it is "programmed" through natural selection process during evolution. So, maybe the statement "no explicit goals for the future" needs to refine a little bit? I think the Steering Subsystem may not have explicit goals for the near future, but it is there to ensure the survive of the species. Noted also that the natural selection prefers species survive over individual survive.