Three Levels of Motivation
post by DragonGod · 2018-09-28T10:48:27.572Z · LW · GW · 2 commentsThis is a link post for https://docs.google.com/document/d/1JLx9Hef3iVZb1YDEa7bz_eQbkblYwpK-jocb6KlEwT0/edit?usp=drivesdk
Epistemic Status: This is basic information, and while it is original to me, I make no claim that the the content thereof is new. Nevertheless, I think it is important enough to be worth posting.
2 comments
Comments sorted by top scores.
comment by Pattern · 2018-09-28T17:39:24.331Z · LW(p) · GW(p)
What if Tiffany doesn't play optimally, or plays in accordance with a different definition of 'optimal'? (Suppose its maker played every game of tick tac toe, and recorded their response to every situation, then hardcoded those values.)
Replies from: DragonGod↑ comment by DragonGod · 2018-09-28T18:39:37.365Z · LW(p) · GW(p)
If Tiffany's performance is good enough, then Tiffany is still best described as optimising for tic tac toe performance, because:
- Tic tac toe performance has high predictive power as an hypothesis for Tiffany's utility function.
- Tic tac toe performance has relatively low complexity when compared to other hypotheses with comparable predictive power.
This changes if Tiffany's performance is not sufficiently high (in which case there may be some other low complexity objective function that Tiffany is best described as optimising).