Comment by Heartland on Contest: $1,000 for good questions to ask to an Oracle AI · 2019-08-09T17:53:44.451Z · LW · GW

My purposefully open-ended question would simply be, “What is good?” My hope is that finding the nature of what good is as its super goal would keep the AI on course to the future we want as it would pass through its recursive self-improvements.