[LINK] Paper on reduced impact ideas

post by Stuart_Armstrong · 2017-05-23T16:29:55.000Z · LW · GW · 2 comments

A write up of the various ideas we've had around reduced impact AIs:

https://www.dropbox.com/s/cjt5t6ny5gwpcd8/Low_impact_S%2BB.pdf?raw=1

2 comments

Comments sorted by top scores.

comment by Vanessa Kosoy (vanessa-kosoy) · 2016-02-21T11:08:24.000Z · LW(p) · GW(p)

Regarding the asteroid scenario. It seems to me that if you have a formal mathematical model of the laser and the asteroid then you can build a safe math oracle to solve the problem while if you want the AI to figure out physics by itself then "correct x coordinate" can be dangerous by exploiting an unintended mechanism of influence on the world.

Replies from: cocoa
↑ comment by michaelcohen (cocoa) · 2017-01-12T20:55:42.000Z · LW(p) · GW(p)

It seems like the purpose of the asteroid scenario is not to come up with ways of deflecting an asteroid, but as an example system in which two uncoordinated AIs (pardon the pun) can minimize impact in an interesting way.