post by [deleted] · · ? · GW · 0 comments

This is a link post for

0 comments

Comments sorted by top scores.

comment by Jonathan Zezov (jonathan-zezov) · 2022-03-06T20:59:49.473Z · LW(p) · GW(p)

A man sits in a jail cell, condemned to die. In the morning he will face a firing squad; this is his last night on earth. What should he do?

Should he try to forget his impending execution, pretending to himself that a pardon must certainly be on the way, that he surely must soon be reprieved? Should he rattle on the bars of his cell all night, helplessly begging and pleading for mercy? Should he tirelessly chip at the concrete walls with the battered remnants of a spoon, despite the impossibility a successful escape?

None of those sound all that great, do they? Each is pathetic, in its own way. Perhaps the third most of all: going through the motions of an escape attempt with no actual hope of success is not "actually trying". It's just as much of a refusal to face reality as the first is, or more so.

Perhaps he should compose himself, try to get a good night's sleep, then in the morning wake up and walk calmly to his execution with his head held high. I must admit, I don't particularly like that option either, but it is better than the first three. There is something brave and noble in it that there isn't in the others, though the man ends up just as dead.

Replies from: ViktoriaMalyasova
comment by ViktoriaMalyasova · 2022-03-07T20:29:40.299Z · LW(p) · GW(p)

When I lived in Russia, I would occasionally go to a protest rally and get detained. One day I was sitting in a police station, waiting for my 3 hours to pass, and no one was paying attention to me. So I decided to try, what is going to happen if I get up and walk out? I walked out and no one stopped me. I tried that 4 times and it worked 3 times. No one bothers to guard detained protesters because no one bothers to try and escape.

I don't know why everyone suddenly decided that alignment problem is "impossible", Eliezer just said that it's hard and he wants more help, preferably soon. It was a call for action, not a call to give up.

Replies from: Dagon
comment by Dagon · 2022-03-07T22:11:55.814Z · LW(p) · GW(p)

It's possible that in convincing everyone it wasn't trivial, he overshot and convinced many that it was impossible.  Or maybe it actually is impossible.  Certainly that's how it feels to me.  Additionally, it's unclear HOW most of us can help or know if we're helping - there's no analog to "try walking out" that I can see.

Replies from: ViktoriaMalyasova
comment by ViktoriaMalyasova · 2022-03-07T22:43:52.766Z · LW(p) · GW(p)

By thinking about it yourself or donating to some org. I agree that it's hard to know if you're helping, and I don't advocate donating if an org looks 99% likely to be scammy or useless.

comment by romeostevensit · 2022-03-06T21:49:55.750Z · LW(p) · GW(p)

I prefer not to judge people's coping strategies as pathetic because it feels unpleasant to do so and I think I can rescue anything good about that with a strategy that doesn't feel bad or cause others to feel bad.

Replies from: tomcatfish
comment by Alex Vermillion (tomcatfish) · 2022-03-07T03:53:30.454Z · LW(p) · GW(p)

Can you offer your alternate framing here? I'm not particularly motivated by what you've written so far, though I do agree outright with the article, which I should probably note.

Replies from: romeostevensit
comment by romeostevensit · 2022-03-07T04:56:26.673Z · LW(p) · GW(p)

It isn't a single universal strategy. It is spending the time necessary to investigate. In this case it would be investigating what portraying others as pathetic is getting me, likely a motivation to 'not be pathetic' and therby take actions that I think are good. The issue is then that I don't endorse such negative motivation. So what's the positive thing that 'not being pathetic' gets me? If those things I am working towards are good, is there something blocking me feeling motivated by their goodness directly? Note this sort of investigation involves primarily feeling tones a la Gendlin's Focusing, so it probably doesn't sound very compelling written out.

comment by Richard_Kennaway · 2022-03-07T11:19:27.761Z · LW(p) · GW(p)

“To the man in the condemned cell, awaiting the day of his execution, only one thing is serious—how to escape. Nothing else is serious.”

Gurdjieff, as recounted by Ouspensky.

comment by shminux · 2022-03-06T21:27:10.153Z · LW(p) · GW(p)

If the mouse were to reason to itself, I am doomed. What use is struggling, I shall present my neck to the cat, so it can end me with minimal fuss. I would call that a pathetic mouse. And if the mouse ran and struggled, and scratched and bit, and hung onto every scrap of life it could get, I would call it a brave little mouse.  

You call it an aesthetic choice, but it comes across as a moral one nonetheless, since "pathetic" and "brave" are judgment of character, not description of degree of beauty. You also use the words like "worthy". You are definitely entitled to your view of ethics, just like your hedge fund friend is entitled to theirs. Not sure why you feel the urge to disguise your ethics as aesthetics. 

That said, both yours and your friend's ethics make sense and are perfectly compatible, given that you are convinced there is a chance of survival and he is convinced that there is not. If you want to crux it with the him, then the first step is to go through the possible worlds that lead him to conclude that there is no path to survival he can affect (and effect) and lead you to conclude that there is. Or maybe it is an ethical difference, his hedonistic approach and your "go out fighting" one.

comment by Dagon · 2022-03-06T19:47:43.114Z · LW(p) · GW(p)

I'd certainly prefer that smart people work to save me (and humanity, though I'm less sure that I care about future biological human-like entities all that much more than future electronic intelligent entities).  And I very much appreciate your appeal to esthetics rather than trying to call it logically or ethically required.

But I can definitely sympathize with the choice to get $millions for the next few years, usable for a finite-but-not-irrelevant time, over dedicating one's life to a very small chance of delaying or avoiding disastrous unaligned AI.  I don't much like the mouse who rolls over and intentionally dies, but I'm not sure I root for the mouse who sacrifices and hurts itself and then still gets eaten either.  I do have some respect for the mouse that runs on it's wheel and enjoys some cheese until the cat eats it.

comment by Flaglandbase · 2022-03-07T08:37:36.188Z · LW(p) · GW(p)

I've read about so many horrible scenarios here on LW alone that it seems to me the highest universal law should be that euthanasia should always be allowed. So I'm definitely not going to criticize the mouse whatever it does.

comment by Yitz (yitz) · 2022-03-08T01:33:27.045Z · LW(p) · GW(p)

Let’s say doom is inevitable (this is true for all living humans, for we are mortal). Is it not nonetheless the case that working to make other’s lives better is a good thing? If your friend doesn’t think working on alignment will help, that’s fine, but they can still do a lot to make the world a better place in other ways. It just means maximizing your short-term rather than long-term impact.

comment by Aleksi Liimatainen (aleksi-liimatainen) · 2022-03-07T09:42:36.847Z · LW(p) · GW(p)

AI doom seems to fit the category "races to the bottom with unintended consequences" (and it isn't the only existential risk in that category). As such, its desperate urgency is downstream from the metacrisis (or the meaning crisis as John Vervaeke called it). Resolving or mitigating the metacrisis would give much-needed breathing room for studying AI alignment and exacerbating the metacrisis would seem to increase AI risk further.

I personally happened to fall into studying the metacrisis rather than AI, and it is my estimate that the metacrisis is more solvable and has aspects to it that seem relevant to understanding cognitive agency and intelligence in general. The linkage is such that I believe both problems merit attention and may benefit from cross pollination.

ETA: As this seems to potentially have more general relevance, I crossposted it to the open thread here [LW(p) · GW(p)]. Feel free to reply to whichever seems more on-topic for the direction you're taking.

Replies from: None
comment by [deleted] · 2022-03-08T18:37:58.219Z · LW(p) · GW(p)Replies from: aleksi-liimatainen
comment by Aleksi Liimatainen (aleksi-liimatainen) · 2022-03-09T14:17:36.537Z · LW(p) · GW(p)

What I mean by the metacrisis is the idea that a large fraction of the variety of missteps, unintended consequences and crises unfolding around the world are downstream from a single nexus of underlying causes. Resolving these problems one-by-one won't help us much overall if the underlying causes are not addressed; more will come, some of them as unintended consequences of prior solutions. It's a crisis of crises in one sense, in another sense the apparent crises are just symptoms of one larger hard-to-see, slowly-unfolding crisis.

Replies from: None
comment by [deleted] · 2022-03-09T15:11:24.370Z · LW(p) · GW(p)