Posts

Comments

Comment by Drewdrop on Decision Theory with the Magic Parts Highlighted · 2023-05-18T11:00:32.845Z · LW · GW

I guess it is ironic but there is an important senses of magic that I read into the piece which are not disambiguated by that.

A black box can mean arbitrary code that you are not allowed to know. Let's call this more tame style "formulaic". A black box can also mean a part you do not know what it does. Let's call this style "mysterious".

Incompleteness and embeddedness style argumentation points to a direction that an agent can only partially have a formulaic understanding of itself. Things built from "tame things up" can be completely non-mysterious. But what we often do is find yourself with the capacity to make decisions and actions and then reflect what is that all about.

I think there was some famous fysicist that opines that the human brain is material but non-algoritmic and supposedly the lurking place of the weirdness would be in microtubules.

It is easy to see that math is very effective for the formulaic part. But do you need to and how would you tackle with any non-formulaic parts of the process? Any algorithm specification is only going to give you a formulaic handle. Thus where we can not speak we must be silent.

In recursive relevance realization lingo, you have a salience landscape, you do not calculate one. How come you initially come to feel some affordance as possible in the first place? Present yet ineffable elements are involved thus the appreciation of magic.

Comment by Drewdrop on Eisenhower's Atoms for Peace Speech · 2023-05-17T19:39:43.717Z · LW · GW

The world doesn't need heroes but professionals