Correcting errors and karma

post by rebellionkid · 2012-04-29T17:03:06.424Z · LW · GW · Legacy · 21 comments

Contents

21 comments

An easy way to win cheep karma on LW:

  1. Publicly make a mistake.
  2. Wait for people to call you on it.
  3. Publicly retract your errors and promise to improve.
Post 1) gets you negative karma, post 3) gets you positive karma. Anecdotally the net result is generally very positive.
This doesn't seem quite sane. Yes, it is good for us to reward people for changing their minds based on evidence. But it's still better not to have made the error the first time round. At the very least you should get less net karma for changing your mind towards the correct answer than you would for stating the correct thing the first time.
Questions:
Is there an advantage to this signalling-approval-for-updates that outweighs the value of karma as indicator-of-general-correctness-of-posts?
If so then can some other signal of general correctness be devised?
If not then what karma etiquette should we impose to ensure this effect doesn't happen?

21 comments

Comments sorted by top scores.

comment by Vladimir_Nesov · 2012-04-29T17:31:20.564Z · LW(p) · GW(p)

Is this actually a problem? If we find that Aurors seem to be abusing the procedure, then we'll modify the procedure to prevent its abuse.

Replies from: JGWeissman
comment by JGWeissman · 2012-04-29T18:00:53.725Z · LW(p) · GW(p)

This seems to be a reasonable heuristic for cases like this where the potential problem is as silly as someone would get undeserved LW karma. But I would be careful of generalizing it to cases where the potential problem is serious.

Also, in the HPMOR scene you are alluding to, Bones was saying that it was up to her to decide if the procedure was being abused, not up to the aurors whose job it was to implement it, and that the downsides of it being abused were insignificant compared to the downsides of not following it when it is needed.

Replies from: Vladimir_Nesov
comment by Vladimir_Nesov · 2012-04-29T18:10:09.265Z · LW(p) · GW(p)

Bones was saying that it was up to her to decide if the procedure was being abused, not up to the aurors whose job it was to implement it

The specific error the Auror was making (if we are to take a consequentialist look and ignore the settled rules) was to act on a hypothetical problem that turns out not to be real, so Bones's superior expertise would be used, in particular, to determine whether the hypothetical problem is real.

comment by JoshuaZ · 2012-04-29T17:08:48.612Z · LW(p) · GW(p)

I don't think many people actually care that much about karma. To care that much about karma yet still be willing to deliberately make mistakes that will be corrected seems like an unlikely combination. The positive good that comes from encouraging people to retract errors is likely a better thing than the tiny chance that some people will deliberately make such mistakes to gain more karma.

Replies from: drethelin
comment by drethelin · 2012-04-29T19:38:50.394Z · LW(p) · GW(p)

Regardless of whether people care enough to do this to get karma, I definitely don't care if others do it. It doesn't impact me if someone has sneakily gained 5, 10, or 100 points of karma.

Replies from: JoshuaZ
comment by JoshuaZ · 2012-04-29T19:41:21.390Z · LW(p) · GW(p)

Well, the real concern wouldn't be so much that they've sneakily gained karma but that it would damage the signal/noise ratio.

Replies from: None
comment by [deleted] · 2012-05-02T02:30:45.410Z · LW(p) · GW(p)

What is there to lose damaging an already damaged system?

comment by John_Maxwell (John_Maxwell_IV) · 2012-04-29T18:00:51.839Z · LW(p) · GW(p)

I tend to think that admitting one's mistakes will cost status/social capital/perceived reliability in any case, so giving the person karma hopefully cancels out that disincentive.

comment by TimS · 2012-04-29T17:19:49.142Z · LW(p) · GW(p)

This seems like a disguised disagreement about whether karma's function is to signal good posts (to observers) or reward posters.

Under the first perspective, the dynamic you identify is dysfunctional. But I think most people here view thumbs up as "I want more of this type of post," which is closer to the second perspective. Under the analysis of the second perspective, one should net a reward if one does something difficult.

One consensus of this community is that it is harder to admit one was wrong than to avoid the error in the first place. If you disagree, then admissions of error after errors should not net karma.

comment by JGWeissman · 2012-04-29T17:31:35.509Z · LW(p) · GW(p)

I suspect that for this to work repeatedly, you would either have space things out, in terms of both time and intervening genuine contributions, or you would have to make increasingly interesting mistakes.

If someone were constantly making and then retracting the same kinds of mistakes, I would notice that the retractions don't actually represent learning not to make that sort of mistake, and would not be happy with it.

comment by Normal_Anomaly · 2012-04-29T17:13:11.962Z · LW(p) · GW(p)

IME, retracting a mistake gets you less karma than you lost, or possibly a gain of 1. Even in the latter case, I wouldn't make deliberate mistakes to gain karma, because seeing a comment at -1 hurts significantly more than gaining 1 point feels good. (Yes I realize this is loss aversion bias. But since far more upvotes are given than downvotes, a downvote has more information than an upvote.)

Replies from: None
comment by [deleted] · 2012-05-02T02:47:55.984Z · LW(p) · GW(p)

I believe loss aversion bias helps keep us alive and well. A serious question: Are you open to agree with correct logic that may not be your own?

I've been explaining my beliefs in all of my posts and the negative karma simply tells me that my explanations are not encouraged(Nor my ideas. We should instead be encouraging those who think to keep thinking. This will ultimately end in the betterment of mankind.) I am now instead encouraged to simply make blatant unexplained statements.

One final point: My karma gauge currently tells me that I have -218 karma. It also tells me that my total karma is 0. I thought my total karma was -218? This is an obvious flaw. The system has given me incorrect information.

Replies from: Normal_Anomaly
comment by Normal_Anomaly · 2012-05-02T12:57:03.842Z · LW(p) · GW(p)

I am open to agreeing with any correct logic that I can understand and have evidence that it's correct.

I haven't downvoted any of your content, but I suspect the negative karma is because your ideas are difficult to understand and (perhaps because of this) seem poorly thought out. If you were to write up a detailed explanation of the ideas you bring to the community and your general philosophy in concrete, simple language, and post it in discussion, you might get a better reception. You may want to lurk for a while or read some sequence posts, as that will give you a better intuitive grasp of LW conventions, etiquette, and how to communicate clearly. If you have difficulties with jargon or English is not your native language, PM me and I'll help you.

The other very important thing about getting a better reception: some of what you've said has come off as rude. LW has a strong culture of not complaining about one's karma or the treatment one is getting. If people are criticizing you, either refute their criticisms or change the way you write--taking it to the meta-level of complaining about their criticism is tangential and leads to fighting.

Regarding the karma meter: the total karma meter bottoms out at 0, but you'll have to get 218 upvotes before it starts going up. The karma meter below that is the change in your total karma over the past 30 days (or all the time you've had your account, if you've been on less than 30 days). So what you should take from this is that you are in the negatives, and have lost 218 in the past month. I don't like that it doesn't display negative totals either, because it's annoying and inelegant, but I don't have the skills to fix it and few people have negative totals for long enough that it's a priority.

comment by Shmi (shminux) · 2012-04-30T01:59:58.770Z · LW(p) · GW(p)

I downvote almost all posts which are solely about karma, including this one.

Replies from: drethelin, erratio
comment by drethelin · 2012-04-30T05:44:28.419Z · LW(p) · GW(p)

To follow the policy I'd have to downvote this post but I upvoted it because I really like this policy.

Replies from: shminux
comment by Shmi (shminux) · 2012-04-30T15:44:23.254Z · LW(p) · GW(p)

I meant posts, not comments :)

comment by erratio · 2012-04-30T15:52:22.135Z · LW(p) · GW(p)

What about requests for explanation of drive-by downvotes? I usually place them in a different mental category to general complaints/comments about the karma system

Replies from: shminux, Normal_Anomaly
comment by Shmi (shminux) · 2012-04-30T16:23:39.718Z · LW(p) · GW(p)

Personally, I'm OK with people humbly asking for reasons, as long as there is no implications that the downvotes are somehow "wrong".

comment by Normal_Anomaly · 2012-05-01T16:40:30.562Z · LW(p) · GW(p)

I downvote most talk about karma (complaints, "I bet you'll downvote me", etc) as well, because I want people to do so less. But I support requests for explanations of downvotes, because I want people to explain their downvotes.

EDIT: Okay, I'll get aboard the irony train: Why was I downvoted?

comment by thomblake · 2012-04-30T15:44:35.020Z · LW(p) · GW(p)

Downvotes shouldn't be given for being factually incorrect. That would stifle disagreement. High-quality comments can be wrong, and low-quality comments can be correct.

I would like to see more people updating their beliefs based on new evidence. Thus, I upvote such comments for now.

Replies from: Monkeymind
comment by Monkeymind · 2012-05-01T16:52:41.369Z · LW(p) · GW(p)

I gave you a thumbs up for this!