Surviving Petrov Day
post by Mati_Roy (MathieuRoy) · 2020-09-26T16:40:03.169Z · LW · GW · 8 commentsContents
Stopping the threat Living through the winter Recovering from a backup Managing information flow Improving the incentives None 9 comments
Sorry, but I can't let this metaphorical world be destroyed.
In Honoring Petrov Day on LessWrong, in 2020 [LW · GW], Ben Pace [LW · GW] explains that during Petrov's Day (ie. today), 270 people will have received an email giving them a launch code they could use to bring down LessWrong for a day. Here's how the website looked like:
At 7:37 EST, Neel Nanda posted that the site was already down.
Chris Leong writes:
Sorry, I got tricked:
petrov_day_admin_account September 26, 2020 11:26 AM Hello Chris_Leong,
You are part of a smaller group of 30 users who has been selected for the second part of this experiment. In order for the website not to go down, at least 5 of these selected users must enter their codes within 30 minutes of receiving this message, and at least 20 of these users must enter their codes within 6 hours of receiving the message. To keep the site up, please enter your codes as soon as possible. You will be asked to complete a short survey afterwards.
We failed at preventing the launch, but it's not over.
Stopping the threat
There's an image preventing access to the main page. To remove it, create a bookmark with any name, and put as the bookmarked URL:
javascript:var element = document.getElementsByClassName("PetrovDayLossScreen-root")[0]; element.parentNode.removeChild(element);
Then go on https://lesswrong.com and click the bookmark to remove the image.
Metaphor for anti-ballistic missiles.
Living through the winter
Here are alternative places where LessWrongers gather:
- Effective Altruism Forum
- AI Alignment Forum
- Effective Altruism Group Directory
- LessWrong
- TheMotte
- RadicalxChange Forum
I would say SlateStarCodex, but it already got its real world Petrov Day caused by the New York Times. People from SlateStarCodex now hangout at https://www.reddit.com/r/slatestarcodex/.
Metaphor for ALLFED researching food security.
Recovering from a backup
Use https://www.greaterwrong.com/, a mirror of LessWrong. If this also gets down, use the Wayback Machine to retrieve URLs from the GreaterWrong. If it also gets down, use WebCitation. If it also gets down, email me at contact@matiroy.com for a local backup (if this post gets taken down, I'll post it on https://matiroy.com). If I get offline, ask other rationalists [LW · GW] that have made a local backup.
Here's how Gwern archives websites: https://www.gwern.net/Archiving-URLs. I used to use http://www.webcitation.org/comb to massively archive a list of scraped article URLs, but I'm not sure if it still works.
You can also just go to the All Posts [? · GW] tab.
Metaphor for: a backup on Mars (h/t Vanessa Kosoy [LW(p) · GW(p)]) and a moon-based backup
And making your own back-up is a metaphor for prepping.
Managing information flow
It seems hard to avoid admins seeing this post today, but we can still try. The LessWrong team is: Ben Pace, Jim Babcock, Oliver Habryka, Raymond Arnold, Ruby Bloom. When sharing on Facebook, choose the sharing option "Friends except...". (EtA: Raymond said it wasn't them that sent the email, so nevermind that part.)
But overall, better to overshare this post than undershare it.
Most people failing to go on LessWrong will be redirected to the Petrov Day post, so upvote my comment [LW(p) · GW(p)] there so it gets at the top for people to see.
Metaphor for: Information Hazards.
Improving the incentives
Increase the social penalty for pressing the button.
Metaphor for: Moral economics.
For the in-person events, I don't re-invite button-pressers to future Petrov ceremonies. That's something I had decided after it happened. Similarly, I will also decide after the fact here.
--
I'll set a reminder to prepare more for next year ^_^
8 comments
Comments sorted by top scores.
comment by sen · 2020-09-27T03:48:18.156Z · LW(p) · GW(p)
Do you think it makes more sense for you to punish the perpetrator after you're dead or after they're dead?
Replication is a decent strategy until secrets get involved, and this world runs on a lot of secrets that people will not back up. Even when it comes to publicly accessible things, there's a very thick and very ambiguous line between private data and public data. See, for example, the EU's right to be forgotten. This is a minor issue post-nuke, but it means gathering support for a backup effort will be difficult.
Access control is a decent strategy once you manage to set it up and figure out how to appropriately distribute trust. Trusting "your friends" is not a good strategy for exactly the reason evident today: even if they're benign, they can be compromised.
Punishing attackers just flat out doesn't work. That random person in China doesn't care if the US government says hacking is bad. Hackers don't care if selling credit card data is bad. Not even academic researchers care that reverse-engineering is illegal. You're not going to convince the world that your punishments are good, and everyone unconvinced will let it slide. All you'll do is alienate the people most capable of identifying flaws in your strategy. There are a lot of very intelligent people out there that care more about their freedom to explore and act than about net utility. They will build out the plans and infrastructure necessary for the real baddies to do their work. Please do not alienate them by telling them that their moral sensibilities are bad.
Some lessons from a decade in software security.
I like your backup strategies for LessWrong. The connection to nukes is tenuous. I think your Petrov Day strategy does more harm than good.
Replies from: MathieuRoy↑ comment by Mati_Roy (MathieuRoy) · 2020-09-27T15:03:58.649Z · LW(p) · GW(p)
You seem angry that I wrote social penalty, and then seemingly punished me with -6 Internet points.
Replies from: sen↑ comment by sen · 2020-09-27T21:00:45.946Z · LW(p) · GW(p)
I did -2. It wasn't punishment, and definitely not for saying social penalty. I think social penalties are perfectly fine approaches for some problems, particularly ones where fuzzy coordination yields value greater than the complexity it entails.
I do feel frustration, but definitely not anger. The frustration is over the tenuous connection, which in my mind leads to a false sense of understanding.
I feel relatively new to LW so I'm still trying to figure out when I give a -1 and when I give a -2. I felt that the tenuous connection in combination with the net-negative advice warranted a -2.
EDIT: I undid my -2 in light of this comment thread.
Replies from: MathieuRoy↑ comment by Mati_Roy (MathieuRoy) · 2020-09-27T22:16:24.331Z · LW(p) · GW(p)
Ok, thanks for clarifying.
FWIW, the connection was meant to be a playful one, not a serious one :)
I re-read your original comment. I'm understanding you're saying that I shouldn't alienate the person that did the social engineering because they didn't see this game the same way than I did (correct?) If you mentioned another way in which my post might have caused harm, I don't think I understood it. That said, you don't have to clarify; it's up to you; I'm fine either way :)
Replies from: sen↑ comment by sen · 2020-09-28T01:01:55.146Z · LW(p) · GW(p)
Your understanding is correct. Your Petrov Day strategy is the only thing I believe causes harm in your post.
I'll see if I can figure out what exactly was frustrating about the post, but I can't make promises on my ability to introspect to that level or on my ability to remember the origins of my feelings last night.
These are the things I can say with high certainty:
- I read this post more like a list of serious suggestions interspersed with playful bits. Minus the opener and the Information Flow section, the contents here are all legit.
- If you put way more puns into the section contents, it would feel less frustrating.
This is a best-guess as to why the post feels frustrating:
- It feels like you draw a sharp delineation between playful bits and serious suggestions. The opener is all playful. The section headers are all serious. Minus the Information Flow section, the section contents are all serious. The "Metaphor For" lines are all playful.
- The sharp delineation makes it feel like the playful bits were tossed in to defend the serious suggestions against critical thinking.
This is a weak best-guess, which I could probably improve on if I spent an hour or so thinking about it:
- I'd guess that puns would help because they would blur the line between serious suggestions and playful bits. This would force the reader to think more about what you're saying for validity. With that, it wouldn't feel like the post is trying to defend itself against critical thinking.
↑ comment by Mati_Roy (MathieuRoy) · 2020-09-28T02:07:03.643Z · LW(p) · GW(p)
thanks for the clarifications!
comment by digital_carver · 2020-09-30T09:55:57.018Z · LW(p) · GW(p)
I think 'Improving the Incentives' misses the point of Petrov day. The point of Stanislav Petrov is that he made his decision despite all his personal incentives being aligned the opposite way. It was a very hard thing to do, and creating incentives to not press the button cheapens the decision and takes away the difficulty of the decision - especially when in this circumstance the incentive to press the button is already a weak one (basically just "for the lulz" as far as I can tell), much weaker than the potential dangers to his career and his country that he had to deal with.
I see this Petrov day event as a chance to think about the difficulty of getting multiple people to do the "right thing" despite having little incentive to do so, about creating an environment that nurtures and nourishes such independent decision-making, and about the fragile balance of trust. Creating explicit incentives breaks away from this difficult problem and turns it into a different, often easier one.
Replies from: MathieuRoy↑ comment by Mati_Roy (MathieuRoy) · 2020-10-01T17:19:19.880Z · LW(p) · GW(p)
That's a reasonable point.
On the other hand, if we develop a culture of retroactively punishing and rewarding people (ex.: Robin Hanson sent money to Stanislav Petrov), then maybe it will indeed create such incentives across the board (ie. in the real world as well).