Posts

Pre-ASI: The case for an enlightened mind, capital, and AI literacy in maximizing the good life 2025-02-21T00:03:47.922Z

Comments

Comment by Noahh (noah-jackson) on Pre-ASI: The case for an enlightened mind, capital, and AI literacy in maximizing the good life · 2025-02-21T15:18:24.947Z · LW · GW

I see where you’re coming from, but my point about boundaries applies specifically within the domain of conscious experience. There’s no clear boundary between ‘you’ and ‘me’ in that space because consciousness doesn’t seem to have non-arbitrary borders. But paperclips aren’t conscious, so they don’t even exist within that domain of experience to begin with.

So while self/other distinctions might be constructed, that doesn’t mean we should erase distinctions that actually matter—like the difference between something that has subjective experience and something that doesn’t. That’s why I wouldn’t extend the same boundary-dissolving logic to a paperclip (or a rock, or a chair) in the same way I would to other conscious beings.

Comment by Noahh (noah-jackson) on Reversed Stupidity Is Not Intelligence · 2025-02-01T16:09:28.880Z · LW · GW

Even though cults would indeed arise even without genuine extraterrestrial encounters, I think that the actual presence of aliens would increase the probability and # of flying saucer cults. Actual alien encounters would likely inspire some # of these sorts of beliefs, making the formation of cults even more probable than in a world without aliens. Essentially, while the baseline probability of cult formation might be high due to "human silliness", the added “signal” from genuine alien events could tip the scales further in favor of cult emergence.

Thus the conditional probability P(cults|aliens) would be greater than P(cults|!aliens).

Comment by Noahh (noah-jackson) on What is Bayesianism? · 2025-01-20T15:51:22.487Z · LW · GW

If these both theories made the same predictions, you'd have to depend on your prior knowledge - your prior, for short - to judge which one was more likely.

Not sure what the commenting standard is for grammar mistakes but... change this to "both these".