Posts
Comments
If wireheading were a serious policy proposal being actively pursued with non-negligible chances of success, I would be shooting to kill wireheaders, not arguing with them.
I am arguing precisely because Jeff and other people musing about wireheading are not actual criminals—but might inspire a future criminal AI if their argument is accepted.
Arguing about a thought experiment means taking it seriously, which I do. And if the conclusion is criminal, this is an important point that needs to be stated. When George Bernard Shaw calmly claims the political necessity of large scale extermination of people unfit for his socialist paradise, and doing it scientifically, he is not being a criminal—but it is extremely relevant to note that his ideas, if implemented, would be criminal, and that accepting them as true might indeed inspire criminals to act, and inspire good people to let criminals act.
If I am not to take wireheading seriously, there is nothing to argue. Just a good laugh to have.
And I am not angry at all about wireheading. But apparently, the first post of this series made a lot of commenters angry indeed who took it personally.
The STV supposes that pleasantness is valuable independently from the agent's embedding in reality—thus is a Pixie Dust Theory of Happiness, that I indeed argue against in my essay (see section "A Pixie Dust Theory of Happiness").
While the examples and repetition used in the paragraph cited are supposed to elicit a strong emotion, the underlying point holds: If you're trying to find the most emotional happiness intensive moment to reproduce, a violent joyful emotion from an insane criminal mastermind is more likely to be it than a peaceful zen moment by a mellow sage. The extreme negative cost to the victims, however great, is in this hypothesis only accounted once; it is thus dwarfed by the infinitely-replicated benefit to the criminal.
Emotions are a guide. You ought to feel them, and if they're wrong, you ought to explain them away, not ignore them. But, especially in an already long essay, it's easier and more convincing to show than to explain. If mass murder in the name of wireheading feels deeply wrong, that's a very strongly valid argument that indeed it is. Maybe I should update the essay to add this very explanation right afterwards.
Admittedly, my essay may not optimized to the audience of LessWrong, but that's my first couple essays, optimized for my preexisting audience. I wanted to share it here because of the topic, which is extremely relevant to LessWrong.
Finally I'll reply to meta with meta: if you are "totally out of [your] depth... and am not interested in learning it", that's perfectly fine, but then you should disqualify yourself from having an opinion on an "objective utility function of the universe" that you start by claiming you believe in, when you later admit that understanding one issue depends on understanding the other. Or maybe you somehow have an independent proof using a completely different line of argument that makes you confident enough not to look at my argument—in which case you should express more sympathy towards those who'd dismiss Jeff's argument as insane without examining his in detail.
After my massive negative score from the post above was reduced by time, I could eventually post the sequel on this site: https://www.lesswrong.com/posts/w4MenDETroAm3f9Wj/a-refutation-of-global-happiness-maximization
You don't get it. Murder is NOT an abstract variable in the previous comment. It's a constant.
No, no, no. The point is: for any fixed set of questions, higher IQ will be positively correlated with believing in better answers. Yet people with higher IQ will develop beliefs about new, bigger and grander questions; and all in all, on their biggest and grandest questions, they fail just as much as lower-IQ people on theirs. Just with more impact. Including more criminal impact when these theories, as they are wont to do, imply the shepherding (and often barbecuing) the mass of their intellectual inferiors.
Once again, "ideology" is but an insult for theories you don't like. All in all your post is but gloating at being more subtle than other people. Speak of an "analytical" state of mind.
But granted - you ARE more subtle than most. And yet, you still maintain blissful ignorance of some basic laws of human action.
PS: the last paragraph of your previous comment suggests that if you're into computer science, you might be interested Gerald J. Sussman's talk about "degeneracy".
Even in engineering and business schools, socialism is stronger than it ought to be and plays a strong role of censorship, "affirmative" action, selection of who's allowed to rise, etc. But it has less impact there, because (1) confrontation to reality and reason weakens it, (2) engineering is about control over nature, not over men, therefore politics isn't directly relevant, (3) power-mongers want to maximize their impact as such, therefore flock to other schools.
I assume no such causation. I do assume a correlation, which is brought about by evolution: cooperation beats conflict.
I don't understand your "simpler rejection" as stated.
Accusing me of presenting my principle as "Perfect" - what a great combination of 1- straw man argument -- putting a nirvana fallacy in my mouth 2- special pleading -- the double standard of requiring my principles to be "perfect" but not yours.
Your belief that force can ever have large-scale positive consequences denotes a singular blindness to the Law of Eristic Escalation, and/or the Law of Bitur-Camember http://fare.livejournal.com/32611.html It's OK to be ignorant - but lame to laugh at those who aren't because they aren't.
Yes, the Universal Law applies to any kind of sentient being. See for instance my essay "Identity, Immunity, Law and Aggression on the Rapacious Hardscrapple Frontier" http://fare.tunes.org/liberty/hardscrapple.html
And no, I never argued that "if it appeals to intelligent people, it's wrong". Your implied argument is a straw man. If you read carefully, I give a very specific criterion on how one may lift the burden of the proof against tradition.
Who of the proponents of a theory and its opponents are bullet-swallowers? Each thinks it's the other. Using that as an argument is begging the question.
If I put some em in a context that makes him happy and that somehow "counts", what if I take the one em whose happiness is maximal (by size / cost / whatever measure), then duplicate the very same em, in the very same context, ad infinitum, and have 1 gazillion copies of him, e.g. being repeatedly jerked off by $starlet ? Does each new copy count as much as the original? Why? Why not? What if the program was run on a tandem computer for redundancy, with two processors in lock step doing the same computation? Is it redundant in that case, or does it count double? What if I build a virtual machine in which this entire simulation happens in one instruction? Since the simulation has no I/O, what if my optimized implementation does away with it?
You're still deep into the fairy dust theory of utility. More nano-paperclips, please!
You should DEFINITELY read Greg Egan's "Permutation City", where he explores all kinds of such concept even to the point of absurdity -- but you are the one who gets to decide where it starts to be absurd and why; he just does the exploring in a delicious SF novel.
Happily, the criminal rapture of the overintelligent nerd has little chance of being implemented in our current world, unlike the criminal rapture of the ignorant and stupid masses (see socialism, islamism, etc.). That's why your proposed mass crimes won't happen - though god forbids you convince early AIs of that model of happiness to maximize.
What more, massive crime in the name of such a theory is massively criminal. That your theories lead you to consider such massive crime should tip you that your theories are wrong, not that you should deplore your inability to conduct large-scale crime. You remind me of those communist activist cells who casually discuss their dream of slaughtering millions of innocents in concentration camps for the greatness of their social theories. http://www.infowars.com/obama-mentor-wanted-americans-put-in-re-education-camps/
This reminds me of similar pixie dust theories of freedom: see my essay at http://fare.tunes.org/liberty/fmftcl.html
In the end, happiness, freedom, etc., are functional sub-phenomena of life, i.e. self-sustaining behavior. Trying to isolate these phenomena from the rest of living behavior, what more to "maximize" them, is absurd on its face - even more so than trying to isolate magnetic monopoles and maximize their intensity.
Either way, this sounds like the pixie dust theory of happiness: happiness as some magic chemical (one with very short shelf life, though), that you have to synthesize as much as possible of before it decays. I bet you one gazillion dollar the stereo-structure of that chemical is paper-clip shaped.