The Perversity of High Standardspost by SocratesDissatisfied · 2020-12-27T14:37:54.556Z · LW · GW · 3 comments
A rational agent will follow a standard where the benefit he receives (or disbenefit he avoids) from following that standard, is less than the cost of following that standard.
In this way, raising standards can perversely disincentivise the behaviour those standards intend to promote; by raising the cost of complying with a standard above the benefit gained by doing so.
Given the simplicity of the above concept, one might think that perversely high standards would be rare and easily avoided. However, my perception is that they are surprisingly impactful. One especially important example involves popular standards of political honesty in western democracies.
A common refrain in the popular culture of these societies is that politicians are “all corrupt”, “all liars”, or “all the same” (in the sense of “similarly awful” rather than “similarly wonderful”). One way to conceptualise this assessment is that the assessors set exceptionally high standards for political propriety. For instance, they may believe that accepting any campaign contribution not derived from small donors constitutes corruption; that telling a single mistruth merits being labelled a liar; or that having a voting record of less than perfect ideological purity constitutes moral evil or cynicism.
But to the extent that politicians believe that – for instance – the public treat a single misstatement as equal to repeated and deliberate deception, their incentive to stay “honest” decreases markedly. The implicit standard for “honesty” here is exceptionally difficult and costly to meet, and therefore unlikely to warrant the effort required. Not only does this standard fail to incentivise the exceptional “honesty” it supposedly promotes, it also undermines politicians incentive to avoid far more severe deception. They and their opponents are going to be seen as liars in any case, so why not “go all in” and employ all advantages of deception, instead of pursuing an unrewarded honesty.
Following this theory, it is precisely those leaders with the least regard for truth who seem to have most capitalised on the decline in public trust for politicians; with Trump in particular being able to shrug off accusations of corruption amongst a voter base who write off his opponents, and the US political system, as irredeemably crooked. Something similar, though less severe, could also be said about the reception to Boris Johnson’s rhetoric around the EU referendum.
Taking lowering standards first, it should be noted that standards are set high for a reason: to incentivise exceptionally good behaviour (such as politicians not using “technically true” but potentially misleading statements). By lowering standards, we may incentivise good behaviour more, but we incentivise exceptionally good behaviour less.
Moving to raising rewards, two problems are pertinent. First, for very onerous standards, standard-setting agents may be unable to raise rewards high enough to compensate the costs required to meet them. Second, some agents may be simply unable to meet very onerous standards. Despite this, we would still want to encourage these agents to comply as far as possible.
A key means to address these issues involves variegating standards; that is, having multiple standards with different rewards attached to each, with higher standards meriting greater rewards. This encourages partial compliance by those unable to meet the highest standards, whilst still spurring exceptional compliance by those who easily vaunt lower standards.
In justified zeal to encourage good behaviour, it can be tempting and intuitive to set the highest possible standards for good performance. But doing so may well have a perverse impact – undermining the very behaviour we aim to incentivise. Realistic standards, with variegation to encourage both minimal and exceptional performance, are far more likely to achieve our ends.
 Even though they may not recognise themselves as doing so.
 Difficult in the sense that even a good faith attempt to meet it might well fail due to an honest mistake; costly in the sense that being unable to ever distort a single fact would likely vastly undermine the persuasive efficacy of their political messaging.
 Raising rewards encompassing both raising the benefit awarded for compliance, and lowering the disbenefit exacted for noncompliance.
 An interesting example of successful incentivisation by high rewards in the “Political Honesty” domain derives from the Sanders’ campaign’s rejection of large donations. The loss of corporate donations engendered by this (the cost of compliance with the high standard for “non-corrupt” behaviour on the left) was compensated by a flood of small donations from voters attracted by Sanders incorruptible image (the reward for compliance with the same).
 As a voter my “maximal reward” to a politician who meets my highest standards is likely to be my vote, several hours of campaigning time and a small donation. Sadly, even when this is aggregated with the maximal reward of thousands of like-minded individuals, this may still prove less than the cost to that politician of complying with those standards.
 Informational issues are likely to be the central constraint on the degree of variegation a (set of) standards ought support. Specifically, it is useful to have clear standards and rewards, so that those assessed by them can more easily comply with them, and those enforcing them can more easily administer them. But increasing the variegation of a (set of) standards increases their complexity, thereby undermining compliance and enforceability. Ultimately the best trade-off here will be context specific – the more important the behaviour being incentivised, the more of the assessor’s limited mental bandwidth will be best spent on variegating standards.
Comments sorted by top scores.