Posts
Comments
I made a Manifold market for how many pre-orders there will be!
I'm generally confused by the notion that Buddhism entails suppressing one's emotions. Stoicism maybe, but Buddhism?
Buddhism is about what to do if one has no option but to feel one's emotions.
How is that mutually exclusive with (1)?
Am I correct in assuming you don't think one should give the money in the counterfactual mugging?
I don't know what the first part of your comment is trying to say. I agree that counterfactual mugging isn't a thing that happens. That's why it's called a thought experiment.
I'm not quite sure what the last paragraph is trying to say either. It sounds somewhat similar to an counter-argument I came up with (which I think is pretty decisive), but I can't be certain what you actually meant. In any case, there is the obvious counter-counter-argument that in the counterfactual mugging, the agent in the heads branch and the tails branch are not quite identical either, one has seen the coin land on heads and the other has seen the coin land on tails.
I came up with an argument for alignment by default.
In the counterfactual mugging scenario, a rational agent gives the money, even though they never see themselves benefitting from it. Before the coin flip, the agent would want to self-modify to give the money to maximize the expected value, therefore the only reflectively stable option is to give the money.
Now imagine instead of a coin flip, it's being born as one of two people: Alice, who wants to not be murdered for 100 utils, and Bob, who wants to murder Alice for 1 utils. As with the counterfactual mugging, before you're born, you'd rationally want to self-modify to not murder Alice to maximize the expected value.
What you end up with is basically morality (or at least it is the only rational choice regardless of your morality), so we should expect sufficiently intelligent agents to act morally.
Sounds like synesthesia
I fear that, while it might be a good idea to discourage LSD, it would make things even worse to discourage transitioning.
Highly Advanced Epistemology 101?
probably doesn't change much, but janus' claude generated comment was the first mention of claude acting like a base model on LW
It ought to be a top-level post on the EA forum as well.
Well that's because it's meant to be quantifying over linear equations. and are not meant to be replaced but and are.
i is often used as an index in math, similar to how it is used as an index in for loops.
What would an event optimized for this sort of thing look like?
Why not generate it after it's posted publically?
Aaaa! I'm used to Arial or whatever Windows' default display font is. The larger stroke weight is rather uncomfortable to me.
Yarvin was not part of the CCRU. I think Land and Yarvin only became associates post-CCRU.
Maybe make a post on the EA forum?
It seems like if the SCP hypothesis is true, block characters should cause it to act strangely.
Does it not have any sort of metadata telling you where it comes from?
My only guess is that some of it is probably metal lyrics.
Is this an LLM generation or part of the training data?
I don't see how 3 follows.
That's because we don't have the intelligence to exterminate ants (without causing more problems.)
On another note, if an artificial superintelligence needed a human for something, it would probably be able to find someone it could convince on the spot, no pre-built religion needed.
We have nothing to offer. Anything we can do, an artificial superintelligence can do better, with space and energy and atoms we irritatingly take up.
Why would we want to worship AI?
I think the thing that actually makes people more rational is thinking of them as principles you can apply to your own life rather than abstract notions, which is hard to communicate in a Wikipedia page about Dutch books.
Emmett Shear might also count, but he might merely be rationalist-adjacent.
IMO trying the problem yourself before researching it makes you appreciate what other people have already done even more. It's pretty easy to fall victim to hindsight bias if you haven't experienced the difficulty of actually getting anywhere.
they figure out planting and then rationally collaborate with each other?
I feel like they would end up converging on the same problems that plague human sociality.
I think asociality might prevent the development of altruistic ethics.
Also it's hard to see how an asocial species would develop civilization.
This reminds me of Moravec's paradox.
You should read Greg Egan's excellent novel Permutation City.
I think working on safety roles at capabilities orgs is mostly mutually exclusive with a pause, so I don't think this is that remarkable.
Sorta? Usually the idea is that the presence or absence of hardware determines the anthropic probability of being that conscious process, otherwise you would expect to be some random arbitrary Boltzmann brain-like conscious.
Also this is an immediate corollary of the mathematical universe hypothesis, which says our universe is a mathematical structure.
I feel like you're not giving enough credit to Greg Egan since he came up with all the philosophy himself.
Let's hope not!
I remember going to a city and seeing someone on the subway loudly threatening nonexistent people. I wasn't scared, I just felt bad that in all likelihood, the world had failed this person through no fault of their own.
I like this format and framing of "90% of what matters" and someone should try doing it with other subjects.
Decision theory/trade reasons
I think this still means MIRI is correct when it comes to the expected value though
The thing that got me was Pause AI trying to coalition with people against AI art. I don't really have anything against the idea of a pause but Pause AI seems a bit simulacrum level 2 for me.
A subpoena for what?
I don't think I'm really looking for something like that, since it doesn't touch on the perception of music as much as it does the reasons why we have it.
Isn't TLP's email on his website?
Sure, I just prefer a native bookmarking function.
I wish I could bookmark comments/shortform posts.
You can actually use this to do the sleeping beauty experiment IRL and thereby test SIA vs SSA. Unfortunately you can only get results if you're the one being put under.
This sort of begs the question of why we don't observe other companies assassinating whistleblowers.
I think there should be a way to find the highest rated shortform posts.
I like to phrase it as "the path to simplicity involves a lot of detours." Yes, Newtonian mechanics doesn't account for the orbit of Mercury but it turned out there was an even simpler, more parsimonious theory, general relativity, waiting for us.
Vanessa Kosoy has a list specifically for her alignment agenda but is probably applicable to agent foundations in general: https://www.alignmentforum.org/posts/fsGEyCYhqs7AWwdCe/learning-theoretic-agenda-reading-list