Anti-social Punishment

post by Martin Sustrik (sustrik) · 2018-09-27T07:08:56.362Z · LW · GW · 66 comments

Contents

  Introduction
  Public goods game
  Public goods game with punishment
  Participant pools
  Results: Public goods game without punishment
  Results: Public goods game with punishment
  Anti-social punishment
  Why on Earth?
None
66 comments

This is a cross post from 250bpm.com.

Introduction

There's a trope among Slovak intellectual elite depicting an average Slovak as living in a village, sitting a local pub, drinking Borovička, criticizing everyone and everything but not willing to lift a finger to improve things. Moreover, it is assumed that if you actually tried to make things better, said individual would throw dirt at you and place obstacles in your way.

I always assumed that this caricature was silly. It was partly because I have a soft spot for Slovak rural life but mainly because such behavior makes absolutely no sense from game-theoretical point of view. If a do-gooder is stupid enough to try to altruistically improve your life, why go into trouble of actively opposing them? Why not just sit safely hidden in the pub, drink some more Borovička and wait until they are done?

Well, it turns out that the things are far more complex then I thought.

Public goods game

Benedikt Herrmann, Christian Thöni and Simon Gächter did a study of how people from different societies deal with cooperation and punishment. You can find the paper here and supporting material here.

The study is based on the "public goods" game. The game works as follows:

There are four players. Each player gets 20 tokens to start with. Every participant either keeps them or passes some of them into a common pool. After all the players are done with their moves, each of them, irrespective of how much they contributed, gets tokens equal to 40% of all the tokens in the common pool. The participants cannot communicate with each other and are unaware of each other's identities. The game is repeated, with the same players, 10 times in a row.

The earnings, obviously, depend not only on subject's move but also on the willingness of the other players to cooperate and put tokens into the common pool. But free riders get an advantage. They keep their original tokens but also get their share from the pool.

To get a feeling of the payoffs, let's have a look at the single-round earnings in the extreme case where each participant either puts all their tokens into the pool ("cooperator") or keeps all the tokens for themselves ("free-rider"):

Public goods game with punishment

There's a variant of the "public goods game" where players are able to punish each other after each round of the game. The mechanism is simple. When the round ends the participants are informed about how much each of them has put into the common pool. Then they decide whether to spend some of their tokens to administer punishment. For each token spent on punishment you can subtract 3 tokens from the earnings of an opponent. The players know that they've been punished but they are not informed about who exactly has punished them.

Participant pools

The researchers were interested in comparing the results of the game among different societies:

Our research strategy was to conduct the experiments with comparable social groups from complex developed societies with the widest possible range of cultural and economic backgrounds to maximize chances of observing cross-societal differences in punishment and cooperation. The societies represented in our participant pools diverge strongly according to several widely used criteria developed by social scientists in order to characterize societies. This variation, covering a large range of the worldwide available values of the respective criteria, provides us with a novel test for seeing whether societal differences between complex societies have any impact on experimentally observable disparities in cooperation and punishment behavior. ... To minimize sociodemographic variability, we conducted all experiments with university undergraduates who were similar in age, shared an (upper) middle class background, and usually did not know each other.

Specifically, the experiment was conducted at the following places:

Results: Public goods game without punishment

The results from this experiment are exactly as you would expect. The cooperators found out that there was no way to prevent free-riding and the amount of resources they've put into the common pool steadily decreased. This result replicated across different participant pools. Particular pool may have started with a high or low cooperative behavior, but as the time went on the cooperation always decreased.

Results: Public goods game with punishment

Ability to punish free-riders increased the cooperative behavior in most participant pools. Free-riders learned that free-riding doesn't pay off and started contributing to the common pool.

However, introduction of punishment had no effect in some of the pools. The contributions stayed more or less the same throughout the experiment in Minsk, Samara, Dnipropetrovsk, Muscat, Instanbul, Riyadh and Athens.

Now that's an interesting result. What's going on there? Are members of some societies resistant to punishment or what?

The reality turns up to be even more interesting than one would expect.

Anti-social punishment

Herrmann, Thöni and Gächter found out that participants in some societies were engaging in what they've called "anti-social punishment". They were punishing cooperators!

In fact, they were punishing cooperators so much that the cooperation-enhancing effect of pro-social punishment was entirely canceled.

To make it even more confusing, the anti-social punishment, unlike the pro-social punishment which had roughly similar level in all the participant pools, differed widely among the pools. While it was almost non-existent in the West, it was common in Eastern Europe, in Middle East and in Greece.

The authors then try to find out which aspects of the society are correlated with the high anti-social punishment rate:

With respect to antisocial punishment, we found that both norms of civic cooperation and rule of law are significantly negatively correlated with punishment (at P < 0.05). In other words, antisocial punishment is harsher in participant pools from societies with weak norms of civic cooperation and a weak rule of law. Additional analyses show that antisocial punishment also varies highly significantly with a variety of indicators developed by social scientists in order to characterize societies. Thus, the extent of antisocial punishment is most likely affected by the wider societal background.

Why on Earth?

I wouldn't have much to add to the fascinating results above, I am not a sociologist after all, but I happen to come from a country that is probably affected by this problem. Slovakia hasn't participated in the study, however, it's a former Ostblock country and as such it is very likely to have results similar to Ukraine, Russia or Belarus. Moreover, local folk wisdom, as already mentioned, has it that the phenomenon does really exist. Therefore, having all the relevant context and all the intricacies of the local culture in my head, I should be able to come up with an psychologically plausible explanation of why it would make sense to punish cooperators. It was hard to empathize with someone I disagree with on a very fundamental level, to put myself in their shoes, but I think I've succeeded and what follows is what I came up with.

Herrmann, Thöni and Gächter speculate that the anti-social punishment may be a form of revenge. You've punished me for free-riding so now I'll punish you just that you know how it feels! And given that I don't know who the punisher was, I'll punish all the cooperators who were likely to administer the original punishment in the first place.

While that, I believe, is a part of the equation, the psychology of anti-social punishment may be somehow more nuanced. Let me give you an extremely simplified toy example, just to get grip of what may be going on.

When I came to Caracas, the first thing I've done was to buy a cup of coffee from a street vendor. The coffee was very good but when I drank it I was left with an empty plastic cup. I've carried the cup with me for several hours looking for a trash bin. I haven't found one. Finally, I threw the cup at one of the piles of trash that were heaped against the walls everywhere. If, at that point, someone chastised me for littering I would be extremely angry and I would yell at that person. In other words, I would administer counter-punishment.

Psychologically, I would be angry because, apparently, everyone else was littering but it was just me who was picked for the punished. It would be unjust. Also, there were no trash bins so I couldn't had behave even if I wanted to. That doubles the injustice. Moreover, I was carrying the cup for hours, you do-gooder moron!

If I was a local there may have been an additional reason to overreact: I would probably be subliminally angry for having to live among the trash all along. This would be a great opportunity to let some of that steam off!

To get back to Eastern Europe, we've used to live under communist regime where all the common causes were appropriated by the state. Any gains from a contribution to a common cause would silently disappear somewhere in the dark corners of the bureaucracy.

Quite the opposite: People felt justified to take stuff from the commons. We even had a saying: "If you don't steal [from the common property] you are stealing from your family."

At the same time, stealing from the state was, legally, a crime apart and it was ranked in severity somewhere in the vicinity of murder. You could get ten years in jail if they've caught you.

Unsurprisingly, in such an environment, reporting to authorities (i.e. "pro-social punishment") was regarded as highly unjust — remember the coffee cup example! — and anti-social and there was a strict taboo against it. Ratting often resulted in social ostracism (i.e. "anti-social punishment"). We can still witness that state of affairs in the highly offensive words used to refer to the informers: "udavač", "donášač", "práskač", "špicel", "fízel" (roughly: "nark", "rat", "snoop", "stool pigeon").

I also remember how, when I moved to Switzerland, a lot of my friends said things like: "I've heard that Swiss will rat on you at any occasion."

Swiss people would not understand. What's so bad about punishing free-riders after all?

66 comments

Comments sorted by top scores.

comment by Said Achmiz (SaidAchmiz) · 2018-09-27T19:40:59.717Z · LW(p) · GW(p)

Excellent post!

Some scattered thoughts:

Tall poppy syndrome may be related.

In my experience, the attitude of antisocial punishers toward do-gooders is something like: “Who does he think he is? Thinks he’s so much better than the rest of us? Showing off how good he is?” (This may not be all of it, but it’s a strong component.)

This may be explained in part by two things:

  1. Altruism is costly signaling for wealth. Contributing to the commons, or even not stealing (or doing other antisocial things), signals that you can afford to do so.

  2. Also, there may be a common sentiment that altruism is only ever intended as signaling (of virtue, of wealth, of whatever), and is thus a status-enhancing move. In my experience, people from such societies will often not comprehend (or be very skeptical of, even when they do comprehend) the idea of acting altruistically for purely… altruistic reasons.

Replies from: tenthkrige, Viliam, fazalmajid, Sniffnoy, Douglas_Knight, sustrik
comment by tenthkrige · 2018-10-01T14:31:49.530Z · LW(p) · GW(p)

I'm surprised nobody proposed : "This person is promoting a social norm more stringent than my current behavior, I'll whack him.". What's wrong with it ? Sure in this case the social norm is actually beneficial to the whacker, but we're adaptation-executers, not fitness-maximizers [LW · GW].

Replies from: SilentCal, ksv
comment by SilentCal · 2018-10-18T20:32:45.070Z · LW(p) · GW(p)

FWIW I first read this post before this comment was written, then happened to think about it again today and had this idea, and came here to post it.

I do think it's a dangerous fallacy to assume mutually-altruistic equilibria are optimal--'I take care of me, you take care of you' is sometimes more efficient than 'you take care of me, I take care of you'.

Maybe someone needs to study whether Western countries ever exhibit "antisocial cooperation," that is, an equilibrium of enforced public contributions in an "inefficient public goods game" where each of four players gets 20% of the central pool. Might be more likely if you structure it as tokens starting out in the center and players have the option to take them? (Call it the 'enclosure game', perhaps)

Replies from: Raemon, jmh, sustrik
comment by Raemon · 2018-10-18T20:52:11.734Z · LW(p) · GW(p)

Ooh, I like this (while being aware that there's a decent chance I'd be the sort of person who'd unreflectively do it)

comment by jmh · 2019-12-09T13:27:10.055Z · LW(p) · GW(p)

I'll lump two thoughts in here -- one relates to SilentCat the other elsewhere but...

Like others I think this is a great insight and should be looked at by the authors, or other interested social scientists. I think it relates to a question I ask myself from time to time, though generally don't get too far in answering. Where do we draw the line between public and private spheres of action?

I don't think that is a fixed/static division over time and seems to have important implication for public policy. I'm tempted to say it might with the above proposed efficiency division. I'm not sure though.

The over-all results and some of the other comments also made me wonder if history -- particularly as most of these locations seem to have been former USSR members. I'm just wondering if perhaps the culture legacy would support the behavior if innocent people were just as likely to be punished for what might be actions of other attempting to make everyone's lives better (but often I suspect viewed as a threat to the authorities and government powers).

comment by Martin Sustrik (sustrik) · 2018-10-19T00:40:22.051Z · LW(p) · GW(p)

Nice idea. Maybe all the tokens should start in the pool and the players should have an option to withdraw them. I guess that would make people feel more explicitly "anti-social" if they did so.

comment by simple_name (ksv) · 2018-10-10T19:40:33.008Z · LW(p) · GW(p)

I'm from Eastern Europe and have this tendency. I've been quite curious about why for example any kind of activism evokes negative emotions and I think at least in my case the answer seems to be what you're proposing here. The prevalent attitude in society is to free-ride as much as you can and I'm also doing that. To answer the question from the beginning of the post, if we just let other people make cooperation the new norm, then I'll be expected to cooperate too. I want to keep not caring about society, so I guess the actions of cooperators cash out emotionally as a threat to the status quo that I want to preserve.

Replies from: tenthkrige
comment by tenthkrige · 2018-10-11T15:13:23.993Z · LW(p) · GW(p)

Tell me if this gets too personal, but do defectors evoke positive emotions? (Because they lower societal expectations?) Or negative emotions? (i.e. you have a sweet spot of cooperation and dislike deviations from it?)

Replies from: ksv
comment by simple_name (ksv) · 2018-10-11T20:52:53.049Z · LW(p) · GW(p)

If they have similar attitudes to mine, then the feelings are slightly positive, possibly because of receiving validation for my own behaviour. On the other hand, if the defectors are doing worse things, the feelings are fully negative, I don't think there is any effect as you suggest.

To put things more concretely, I try not to do anything harmful but also don't do anything that helps society (charity, activism, environmental stuff, etc.) unless I get some concrete benefit. When someone does defect in the way of being actively harmful or breaking laws, then my emotions are negative as I said, but interestingly not as strong as in the case of activists. Perhaps because such behaviour feels normal and expected from other people, or just because it doesn't feel as much like a threat to me personally.

So I would say that your second suggestion is correct in my case, I do have a sweet spot of cooperation (basically what I do and feel is justified) and dislike deviations from that, with heavier weight on the "more cooperation" direction.

Replies from: tenthkrige
comment by tenthkrige · 2018-10-12T09:55:29.077Z · LW(p) · GW(p)

Well that's a mindset I don't encounter often irl. Do you estimate you're a central example in your country / culture ?

comment by Viliam · 2018-09-29T21:21:33.766Z · LW(p) · GW(p)
Altruism is costly signaling for wealth.

Or productivity. If you imagine a culture where you cannot accumulate wealth -- for example, because all you produce is food (by hunting and gathering, no agriculture i.e. no land ownership), you don't have the concept of money, the food will soon rot if not eaten, and you can only eat so much food -- the people who can altruistically donate food to others would be the productive ones. And they would be noticed, because they would make good allies and sexual partners.

So even among people who obviously belong to the same social class, too much altruism feels like bragging about one's capabilities. And how much is "too much"? Depends on (sub)cultural assumptions; if the local norm is close to zero, any altruism will be seen as a status move that deserves a counter-attack. Even in socialism, altruistic behavior signals something like "in a non-socialist society, I would be more successful than you".

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-09-29T23:15:47.305Z · LW(p) · GW(p)

That’s… an interesting hypothesis, but it does not seem all that relevant to discussions of currently existing cultures in the developed world. None of the societies described in the OP are bands of hunter-gatherers, after all. And we should be wary of constructing just-so stories, as it is easy to be led astray…

Even in socialism, altruistic behavior signals something like “in a non-socialist society, I would be more successful than you”.

… and this is an example. The interpretation you describe here is not, in my experience, an accurate portrayal of how people in socialist societies perceive things.

comment by Fazal Majid (fazalmajid) · 2018-10-11T17:30:58.616Z · LW(p) · GW(p)

There is something like that in the West as well, the "Laws of Jante" prevalent in Scandinavia and the Netherlands:

  1. You're not to think you are anything special.
  2. You're not to think you are as good as we are.
  3. You're not to think you are smarter than we are.
  4. You're not to imagine yourself better than we are.
  5. You're not to think you know more than we do.
  6. You're not to think you are more important than we are.
  7. You're not to think you are good at anything.
  8. You're not to laugh at us.
  9. You're not to think anyone cares about you.
  10. You're not to think you can teach us anything.
comment by Sniffnoy · 2018-10-01T03:39:40.507Z · LW(p) · GW(p)

Also, there may be a common sentiment that altruism is only ever intended as signaling (of virtue, of wealth, of whatever), and is thus a status-enhancing move. In my experience, people from such societies will often not comprehend (or be very skeptical of, even when they do comprehend) the idea of acting altruistically for purely… altruistic reasons.

This is a total armchair reply, but -- I'm wondering if that ascription of ulterior intent is actually necessary. Like, rather than "this act of altruism is actually just intended as a status move and so should be punished", perhaps just, "this act of altruism will increase their status and so should be punished".

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-10-01T03:51:00.033Z · LW(p) · GW(p)

If we’re talking about the mindset of the punishers, then I can attest to it being the former and not the latter; there is usually no secret about this being people’s motivation—they state it aloud, and quite indignantly.

If we’re talking about the game-theoretical motivations behind that mindset, then of course you’re right.

However, note that in a regime where sincere altruism is not generally acknowledged as a likely possibility, the two interpretations do not meaningfully differ. The reason for this is that, both in the minds of the “altruists” and of the punishers, there is no reason to be altruistic except in order to gain status for oneself. (Thus “this act of altruism will increase their status” logically implies “this act of altruism is intended to increase their status”.)

Replies from: Sailor Vulcan
comment by Sailor Vulcan · 2018-10-22T13:53:03.361Z · LW(p) · GW(p)

In some societies it might not be considered socially acceptable to want to punish someone merely because what they are doing will raise their social status. That sort of thing is dishonest because social status is reputational and meant to be earned. If someone tries to punish you for doing something to earn status, they probably did not come by their social status by honest means.

In societies where people think like that, I imagine no one would want to say "this act of altruism will increase their status and so should be punished", because that is a low status motive and expressing it out loud will lower their own status. So instead they have to spin things to make their own motive appear higher status. They would need to frame things to make the altruist look as if they're the ones being dishonest and freeriding to get more social status than they've earned.

Hence "this act of altruism is only intended as a status move", meaning "this person is not genuinely altruistic, you should not trust them more or think any better of them as a result of this altruism because that's exactly what they want. They're manipulating you into giving them more social status with purely selfish motives, and therefore they will not hesitate to stop being altruistic if it becomes advantageous for them later."

A person making this claim might believe that they believe it, and believe that it is their real motive for punishing an altruist, whether or not it is. Because for one to admit that they're trying to damage another's reputation merely for the crime of doing something which improves their reputation would be to admit guilt of unvirtuous conduct oneself.

comment by Douglas_Knight · 2018-10-03T16:35:50.940Z · LW(p) · GW(p)

Why do you bring up tall poppy syndrome? In the formal context of the game, Melbourne had the most pro-social punishment, and the second-least anti-social punishment. Tall poppy syndrome seems to be people who think that they're doing pro-social punishment, but are excessively suspicious of successful people.

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-10-03T16:47:27.713Z · LW(p) · GW(p)

Tall poppy syndrome seems to be people who think that they’re doing pro-social punishment, but are excessively suspicious of successful people.

I don’t think that’s the only cause.

Replies from: Douglas_Knight
comment by Douglas_Knight · 2018-10-04T04:29:39.503Z · LW(p) · GW(p)

How about you comment on the tension between your beliefs and the evidence at hand?

Replies from: sustrik, SaidAchmiz
comment by Martin Sustrik (sustrik) · 2018-10-04T05:12:57.766Z · LW(p) · GW(p)

I think the main point in that regard is that the study doesn't distinguish between punishing cooperators because they are cooperators and punishing cooperators as a proxy for punishing punishers.

I, as well as some commenters on this thread, feel that the former phenomenon may exist, but yeah, it's based on feelings and folk wisdom. It may also well be that if given identity of punishers the players would punish punishers and leave non-punishing cooperators alone.

Replies from: Douglas_Knight
comment by Douglas_Knight · 2018-10-04T13:40:21.171Z · LW(p) · GW(p)

What does this have to do with Tall Poppy Syndrome? Since the people who engage in Tall Poppy Syndrome don't punish any cooperators in this game, the distinction doesn't matter. If you expected them to do so in this game, it directly falsifies your expectations and there is something very different to learn from it.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-04T14:44:11.210Z · LW(p) · GW(p)

Sorry, I've replied to a wrong thread.

comment by Said Achmiz (SaidAchmiz) · 2018-10-04T05:36:59.515Z · LW(p) · GW(p)

What tension is that, exactly? Be specific, please.

Replies from: Douglas_Knight
comment by Douglas_Knight · 2018-10-04T13:50:06.755Z · LW(p) · GW(p)

You seem to believe that people who engage in Tall Poppy Syndrome would engage in anti-social punishment in this game. But they don't. They engage in the least anti-social punishment and, by a large margin, the most pro-social punishment.

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-10-04T14:56:40.240Z · LW(p) · GW(p)

You seem to believe that people who engage in Tall Poppy Syndrome would engage in anti-social punishment in this game.

You’re reading a lot of things into my comments that isn’t there. I didn’t say this, I didn’t even imply this, and so I don’t have anything further to say on this subthread.

comment by Martin Sustrik (sustrik) · 2018-09-27T20:15:45.001Z · LW(p) · GW(p)

Would that reasoning apply to all societies around the world, including those in the West? If it does, it's unlikely to explain the differences between the societies.

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-09-27T21:13:21.275Z · LW(p) · GW(p)

I do not think it would.

A very rough approximation is that the attitude I am describing is less likely to occur, or to be weaker if it does occur, in cultures where Protestantism is the dominant religion (such as Northern/Western Europe, and the United States). There, altruism is more likely to be seen as obligatory. Elsewhere, altruism is more likely to be seen as aberrant. (Edit: Rather, sincere altruism is more likely to be seen as aberrant, whereas false altruism will merely be seen as wealth signaling.)

Again, this is a very rough approximation and a rather imprecise description. But I think the pattern I am describing is real.

We may test this proposition by measuring relative differences in levels of charitable contributions between rich and poor people, across cultures, and see whether that relative difference is lower in Protestant-dominant cultures than in others (which is what my hypothesis predicts).

Replies from: sara-34
comment by sara-34 · 2018-11-05T15:20:04.978Z · LW(p) · GW(p)

What is it about Protestantism that makes it different from all other religions in altruism, in your opinion?

I ask as someone who grew up in a very Protestant-dominant culture.

comment by Martin Sustrik (sustrik) · 2019-12-12T06:09:48.290Z · LW(p) · GW(p)

Author here.

In the hindsight, I still feel that the phenomenon is interesting and potentially important topic to look into. I am not aware of any attempt to replicate or dive deeper though.

As for my attempt to explain the psychology underlying the phenomenon I am not entirely happy with it. It's based only on introspection and lacks sound game-theoretic backing.

By the way, there's one interesting explanation I've read somewhere in the meantime (unfortunately, I don't remember the source):

Cooperation may incur different costs on different participants. If you are well-off, putting $100 into a common pool is not a terribly important matter. If others fail to cooperate all you can lose is $100. If you just barely getting along, putting $100 into a common pool may threaten you in a serious way. Therefore, rich will be more likely to cooperate than poor. Now, if the thing is framed in moral terms (those cooperating are "good", those not cooperating are "bad") the whole thing may feel like a scam providing the rich a way to buy moral superiority. As a poor person you may thus resort to anti-social punishment as a way to punish the scam.

Replies from: papetoast
comment by papetoast · 2023-02-11T10:37:10.784Z · LW(p) · GW(p)

Cooperation may incur different costs on different participants.

Related: The Schelling Choice is "Rabbit", not "Stag" [LW · GW]

It does not apply to this game where punishing cooperators are strictly worse off for everyone, but it does talk about how for poor people the best choice may be to do the low risk, low reward action.

comment by Bucky · 2018-09-28T11:28:28.033Z · LW(p) · GW(p)

It's notable that, for countries where anti-social punishment is significant, the mean contribution across rounds doesn't depend much on the level of anti-social punishment but more on the contributions in the first round; for the 7 countries with the most total anti-social punishment, their lines are all fairly flat.

Mean contribution and antisocial punishment (eyeballed from fig 2B in the report) aren't correlated within the group of 7 (R2=0.08).

Mean contribution and initial contribution (eyeballed from fig 2A) are correlated within the group at R2=0.99!

So in countries with low rule of law you are stuck in whatever position you start in. Pity poor Istanbul which wasn't really that bad at anti-social punishment but started at a low level and so were stuck there.

Imagine the experimenters had lied to each participant about what happened in round 1 to make it seem like everyone else was contributing more. Would the players stay at the high (made-up) rate of contributions for the rest of the 9 rounds?

comment by Scott Alexander (Yvain) · 2018-10-01T05:30:03.518Z · LW(p) · GW(p)

I'm a little confused. The explanation you give would explain why people might punish pro-social punishers, but it doesn't really give insight into why they would punish cooperators. Is the argument that cooperators are likely to also be pro-social punishers? Or am I misunderstanding the structure of the game?

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-03T05:26:08.051Z · LW(p) · GW(p)

You are living in Soviet Union. Your father was sent to gulag, your mother was fired from her job in academia and sent to plow the tselina. You are being harrassed by the secret police. Then you meet a stachanovite who fulfilled the government plan to 200%. That guy is clearly a cooperator, producing more stuff you could benefit from, but you suddenly feel an irresistible urge to punch him in the nose.

I don't fully understand the mechanism on the theoretical level myself, but it seems to have something to do with the assumptions about authority. If you assume that authority is naturally malevolent you are going to try to oppose it. "This is not my game. This is a game set up by the authorities. By those scientist guys. What can I possibly do to disrupt it?" Punishing cooperators seems to be an obvious way to do that.

Possibly related phenomena:

  • Lizardmen syndrome.
  • Boaty McBoatface syndrome.
  • Some kids being disruptive in school, just for disruption's sake.
Replies from: Benquo, tenthkrige, zby
comment by Benquo · 2018-10-04T16:51:43.161Z · LW(p) · GW(p)

When cooperatebot is an asset being farmed by an adversary, it's advantageous to destroy it. Favoring prosociality in games with unknown agendas contains a cooperatebot component.

comment by tenthkrige · 2018-10-03T22:18:41.365Z · LW(p) · GW(p)

I'm not sure the authority has to be malevolent, it could be incompetent (or something).

So: [authority / authority-wielders are my enemies / outgroup] & [collaborators side with rules / rulemakers / authority] => collaborators are my outgroup => I punish them

This seems to predict that people who distrust authority more will punish cooperators more.

The bottom half of the punishment graph does seem to be places where I would distrust authority more.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-03T23:19:21.630Z · LW(p) · GW(p)

The original study has something to say about ingroups/outgroups. It's not exactly the same thing as the one we are discussing here but still:

Punishment may be also related to in-group–out-group distinctions (37) because people might retaliate if punished by an out-group member (38). Societies also differ in the extent to which their social structures are governed by in-group–out-group distinctions. For instance, according to some cross-cultural psychologists (15, 39) in “collectivist” societies many interactions are confined to close-knit social networks, whereas in “individualistic” societies interactions are more permeable across social groups. Because in our experiment all participants were strangers to one another, people in collectivist societies might be more inclined than people in individualistic societies to perceive other participants as out-group members. Therefore, antisocial punishment might be stronger in collectivist than in individualistic societies. Our evidence is consistent with this possibility because in regressions similar to those of Table 2 antisocial punishment is highly significantly correlated with a widely used societal level measure of individualism-collectivism (15) (table S10).

comment by zby · 2018-10-11T17:44:11.698Z · LW(p) · GW(p)

++

A slightly broader theory: being too cooperative makes live easy for the non cooperators (the state in the Soviet Union case, but it also works in cases when people fall for some stupid maniulations). There must be many equilibria and some cultures stay at some middle level, they don't aim at the most productive ones out of fear not to be pushed into the least productive.

comment by Raemon · 2018-10-02T23:24:57.980Z · LW(p) · GW(p)

Curated. I like that this post was:

  • engagingly written
  • discussed an interesting and I think important topic (understanding when and how coordination/cooperation can happen or fail to happen, and why)
  • had real data to dig into, while...
  • being fairly upfront about the epistemic limits of that data and the author's current understanding.

I'd be interested in followup discussion. In particular, if ever in the future someone runs a version of this experiment that included Slovakia, it'd be neat to verify if the predictions made here are borne out.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-03T04:22:19.620Z · LW(p) · GW(p)

If there are any readers from Middle East or Greece I would also appreciate their thoughts on the phenomenon. It may be that the mechanism differs between regions.

comment by ESRogs · 2018-10-23T01:15:39.046Z · LW(p) · GW(p)
However, introduction of punishment had no effect in some of the pools.

This doesn't seem quite right. While some of the pools didn't see their contribution rates increase when punishment was added, at least the contribution rates didn't decrease! As they did without punishment.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-23T05:18:11.700Z · LW(p) · GW(p)

Fair point!

comment by michaelkeenan · 2018-10-11T21:00:15.643Z · LW(p) · GW(p)

Robin Hanson wrote about similar experiments in 2010.

It seems that extreme generosity can be regarded as establishing an undesirable behavior standard. His post suggests a workaround, if your productivity/generosity greatly exceeds others: under-report your output and give credit to others.

comment by drethelin · 2018-10-11T20:07:00.070Z · LW(p) · GW(p)

I think an under-appreciated aspect is suspicion of Officially Altruistic behavior. A ton of things people do even in countries that weren't run by communists that appear to be altruistic are actually self-enriching, and in addition a ton of things people do to help the less fortunate actually end up hurting them. I would yell at a lot of people if they started ostentatiously saying they were sacrificing for my benefit when I had never asked them to, and you could easily frame that as "anti-social punishment" if you BELIEVE that they're actually helping, but from a suspicious perspective they're both probably not actually helping me and they're also helping themselves.

comment by PunchTheBag · 2018-10-04T01:37:07.821Z · LW(p) · GW(p)

Nice!

I'm from Samara (that Russian city from the experiment), and I sometimes face with unappreciation of contribution. Usually altruistic people are treated like idiots (why they are taking from thier own and thier close circle to feed some commonwealth?), and sometimes with negative reaction. I tried to explain it by myself and friends with the question "why then to be a contributor?" and my view what's going on was clumsy. Thanks for that, this article is a good explanation of my native thoughts.

comment by cousin_it · 2018-09-28T06:30:09.663Z · LW(p) · GW(p)

This is what a few generations of "don't talk to the police" will do.

comment by Martin Sustrik (sustrik) · 2018-09-27T20:13:31.686Z · LW(p) · GW(p)

I've just noticed that Dnipropetrovsk, Muscat, Minsk and Riyadh did better than Western countries in the public goods game without punishment. It may be a statistical fluke, but may it be that those societies are optimized for getting cooperative behaviour in the absence of enforcement mechanisms?

Replies from: ryan_b
comment by ryan_b · 2018-09-27T21:38:28.637Z · LW(p) · GW(p)

I have two opposing suspicions about this.

The first is that I expect the Western countries are much more familiar with the concept of psychological tests and games. I therefore suspect that they are more likely to be thinking that this is a game, and it has a score, and obviously you should try to win.

The second is based on my experiences in Baghdad; when we walked around the city we noticed mounds of trash everywhere, and so we expected the homes to be in bad shape inside. This was a mistake; the inside of a Baghdadi home was always immaculate. The conclusion I drew was that they just weren't drawing their sense of obligation from geography; there was no sense of neighborhood, only of family and tribe. I therefore expect that at least the people from Muscat and Riyadh don't react much to any kind of signals from strangers, because they didn't have any expectations in the first place. This is often what people are measuring when they say 'norms of civic cooperation and rule of law'.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-09-28T06:34:05.636Z · LW(p) · GW(p)

Interesting point about the attitude to games. However, I guess the boundary between a game and reality may be fuzzy. People trading on stock exchange may treat it as a game. People planning a war may treat it as a game.

You may be right about the norms of social norms though. If you look how the authors measured civic cooperation it looks more like "trust in the state" metric. From the paper: "social norms are norms of civic cooperation as they are expressed in people’s attitudes to tax evasion, abuse of the welfare state, or dodging fares on public transport".

comment by romeostevensit · 2019-12-11T21:23:44.749Z · LW(p) · GW(p)

I think awareness of this effect is tremendously important. Your immune system needs to fight cancer (mindless unregulated replication) in order for you to function and pursue any goal with a lower time preference than the mindless replicators. But what's even worse than cancer is a disease that coopts the immune system, leading to a lowered ability to fight off infections in general. People who care about the future are concerned about no-value aligned replication outcompeting human values. But they should also be concerned about agentic processes that specifically undermine the ability to do low time preference work aka antisocial punishers and the things that lead them to exist and flourish.

comment by lionhearted (Sebastian Marshall) (lionhearted) · 2018-09-30T23:21:48.225Z · LW(p) · GW(p)

I'm from Boston originally. Very interesting to note that Boston didn't score the highest in the non-punishment variant — it was high, but lower than Copenhagen — but scored the at the top with punishment added.

That squares with my experience of my Bostonians — reasonably friendly and pro-social but not as much so as say Scandinavia, but very much willing to get righteous if someone is defecting, probably moreso than Scandinavia.

But then, reasonably quick to forgive if someone did bad but gets with the program.

Or maybe I'm flattering my native city. But the results aren't surprise compared to my intuition. (I wish I'd made a prediction about how Boston would come out before reading the results, but alas, missed opportunity there.)

Replies from: ChristianKl
comment by ChristianKl · 2018-10-03T18:50:01.331Z · LW(p) · GW(p)

The graphs don't have confidence intervals but I think it's likely that there's no statistical significant difference between Boston and Copenhagen in that data.

comment by jacobjacob · 2019-12-02T17:27:22.194Z · LW(p) · GW(p)

Nominating to bump this up to 2 reviews.

The insight I took from this was to beware of a scary kind of norms: not just norms those inadvertently cause equilibria, but norms which serve to maintain the equilibrium itself.

For example, requiring a publication track record in academia is intended to ensure people produce sufficiently good research output, and as a side-effect causes p-hacking and similar. However, it seems to me (though it was a while since I read it) that anti-social punishment (and relatedly, punishment of non-punishers) mostly serves to enforce the validity of the current set of norms (as opposed to some other terminal goal).

This suggests that not all norms are equally important for the stickiness of equilibria (which is an important property to keep in mind when reasoning about coordination and equilibrium-shifting), and points to some gears for predicting (and creating!) stickiness.

comment by Viliam · 2018-09-29T21:46:33.108Z · LW(p) · GW(p)

In communism, the State and the Party were the official sources of everything good. Private altruism meant competing with them -- an activity futile at best (because the good thing you were doing would have been equally provided by the system if you didn't interfere), and subversive at worst (because by doing it you were kinda suggesting that it actually wouldn't). If an activity is good, then "obviously" it is better for it to be provided by the powerful State guided by the wise Party, than by an unreliable petty individual.

But this alone doesn't explain the punishment by other individuals. (Why waste my resources on punishing someone for wasting their own resources?) The explanation is that if you were doing a subversive activity (an activity that could be potentially interpreted as subversive -- and yes, that is a very large range of activities), sooner or later the State would find you and punish you; and afterwards it would start looking for your accomplices. By denouncing the altruists you were signaling your loyalty to the State. The stone you threw at the person trying to improve the world might become your get-out-of-jail card when the secret police started collecting potential enemies of the regime. -- Now the regime is gone, but the habits remained.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-09-30T05:50:43.344Z · LW(p) · GW(p)

So we have two different explanations here:

You are saying that the participants considered the experiment to be a private pro-social activity and as such, one opposed to the state. By punishing cooperators they were signalling their loyalty to the state.

I am saying that participants considered the experiment to be a state-run enterprise and the pro-social punishment to mean complicity with the (unfair) state. By punishing cooperators they were trying to disable state's coercive mechanisms.

Those are almost exactly opposite explanations. I wonder if me can think of an experiment that would distinguish between the two?

I guess it would require to somehow trick the subjects into believing that they can form a coalition against the researchers. A kind of anti-Milgram experiment.

Replies from: Viliam
comment by Viliam · 2018-10-02T00:00:35.585Z · LW(p) · GW(p)

I wasn't thinking about the experiment specifically, when I wrote that.

Rather, the concept of "punishing do-gooders" reminded me of a few people I knew on the... Mečiar side of political spectrum... and how they viewed any pro-social activity, whether spontaneous or a part of some non-governmental organization. Shortly, people who help others (not their relatives) are either idiots or (more likely) a part of some sinister conspiracy against our state (most likely organized by the evil Americans, just like everything bad that happens on this planet). And this is my hypothesis on how that mental monstrosity has evolved; that thinking this way was the safe thing to do during communism.

I wonder if me can think of an experiment that would distinguish between the two?

No idea. Instead of this, I would probably try to make a qualitative research, i.e. instead of setting up an artificial experiment I would let them talk about famous real-life "do-gooders", ask sympathetically what exactly they hate about them most, and try to find the common topics in different people's answers.

Oh, I guess I am making the same mistake again, by automatically assuming that the punished people in the experiment were perceived as actual "do-gooders" instead of repressive powers of impersonal state. Uhm, I guess I am not going to provide a better answer. Just saying that -- whether it is relevant to the experiment or not -- hatred against actual "do-gooders" is a thing that definitely exists in Slovak culture, and I suspect that it is actually a norm in many cultures, with Western culture being the "WEIRD" exception.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-03T04:46:58.193Z · LW(p) · GW(p)

I've seen you are planning a meetup in Bratislava. Maybe it would be worth discussing the topic. Maybe people would come up with possible motivations we haven't even thought of.

Replies from: Viliam
comment by Viliam · 2018-10-03T22:26:45.112Z · LW(p) · GW(p)

Looking forward to meeting you the next week!

There will probably be many new people at the meetup, and starting with a political topic would give a completely wrong impression of the Less Wrong culture. So, please let's keep this for the later part of the meetup. But I am also interested in other people's explanations.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-04T05:14:10.935Z · LW(p) · GW(p)

I am based in Zurich, won't be able to come next week :/ But you are right, this topic could get toxic if discussed among strangers.

comment by leggi · 2019-12-29T14:55:14.820Z · LW(p) · GW(p)

I enjoyed this post. It brings a more world-wide view to LW (sorely missed in some things I've read here) and makes the important point that we don't all think the same. Experiences can be very different and so are our reactions and reasonings, coming with there own logic. We should not ignore the human element of how the world works.

I would suggest a bit of an edit to move the description of the game with punishment to after the non-punishment results just for ease of reading and absorption.

-- -

I also enjoyed reading the supporting material here which provided more insights into the process and participant selection. A study that stimulated a lot of thinking in me!(Would the results have been different if the groups had been grannies/hippies/etc.?)

The supporting materials contains some interesting diagrams. ( S3 and S4 )

My main comment would be that 10 rounds isn't enough to draw conclusions from. With 4 players each 'experimenting' and reacting to the previous rounds it would take a lot more for things to settle and maybe reach some sort of equilibrium.

For example the what I'm calling the "F-U-2" response (see S4) led to a drop in cooperation in many locations, but would that have worn off with more rounds and people realising co-operation was in their favour after all?

[A comment for the authors of the study - seeing the individual group results would have been interesting - the distribution of free-riders per group etc.]


comment by Ben Pace (Benito) · 2019-12-01T22:32:35.462Z · LW(p) · GW(p)

An important concept, with the effect very clearly demonstrated by the study, and very helpful clarifying discussion.

I'm nominating this for the 2018 review in large part because I'd like to see an independent review of the study to check for standard reasons it would fail to replicate. I note that the author of the OP says the study authors were surprised by the result, which I think reduces my expectation of many standard forms of motivated cognition to find the particular result.

comment by Pavel Shelygin · 2018-10-04T05:37:36.052Z · LW(p) · GW(p)

In some counties people dont take equal parts from the common pool. Moreover, in some countries, like Russia, most of people take negative part - they take nothing from the pool, but, nevertheless, get punished.

So there isn't any reason to put anything into the common pool.

comment by tenthkrige · 2018-10-01T14:05:14.718Z · LW(p) · GW(p)

Just a nitpick, from one non-native English speaker (to another ?), I have been told that the word "retard" is extremely offensive (in american English at least). I'd say up to you to decide if that was your intended effect.

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-10-02T06:48:53.998Z · LW(p) · GW(p)

Not a native speaker. I wanted it to be offensive but not to the extent where you would have to kill the offender and whole his family to restore the honor. Changed to "moron".

comment by janshi · 2023-06-29T07:46:44.941Z · LW(p) · GW(p)

Psychologically, I would be angry because, apparently, everyone else was littering but it was just me who was picked for the punished. It would be unjust. Also, there were no trash bins so I couldn't had behave even if I wanted to. That doubles the injustice. Moreover, I was carrying the cup for hours, you do-gooder moron!

Historically people had to develop a thick skin if they wanted to be pro-social because of exactly this. I think from there you get the "turn the other cheek" phrase (personified in Jesus being crucified) or the idea of an invisible being watching you doing good or bad deeds and rewarding/punishing you in the afterlife. 

The Ostblock, of course, got rid of these ideas. Not sure what's going on with the Muslim countries though (something something colonialism?)

comment by jmh · 2018-09-28T12:02:38.957Z · LW(p) · GW(p)

(Confession -- I'm tired and my eyes hurt so to say I've done more than skim a few passages would be a gross overstatement)

Very tangential questions here. In these types of games does anyone use the concept of network effects in terms of understanding any of the behaviors and results?

Replies from: sustrik
comment by Martin Sustrik (sustrik) · 2018-09-28T12:28:48.893Z · LW(p) · GW(p)

If you mean in game theory, there's the " common knowledge" concept.

If you mean in sociology, there was a ton of research done on the "social capital" some of which you would probably consider to be about the network effects.