Can chess be a game of luck?

post by Rune · 2009-07-06T03:08:32.930Z · LW · GW · Legacy · 44 comments

Gil Kalai, a well known mathematician, has this to say on the topic of chess and luck:

http://gilkalai.wordpress.com/2009/07/05/chess-can-be-a-game-of-luck/

I didn't follow his argument at all, but it seems like something other LW posters may understand, so I decided to post it here. Do comment on his arguments if you agree or disagree with him.

44 comments

Comments sorted by top scores.

comment by Richard_Kennaway · 2009-07-06T10:53:36.046Z · LW(p) · GW(p)

Consensus so far (to which I add my voice) is that none of us can even detect an argument there, let alone agree or disagree with it. Solved!

Replies from: None
comment by [deleted] · 2009-07-06T14:34:51.935Z · LW(p) · GW(p)

I think I do detect an argument.

Most people would say that the difference between a game of luck and a game of skill is the degree to which luck and skill contribute to the outcome, proportionally. If more than half of it is luck, it's a game of luck.

Gil Kalai seems to be saying that it's really a matter of risk exposure. If the chance of losing multiplied by the dollars lost is high even for skilled players, it's gambling.

ETA: I guess I was seeing faces in the clouds.

Considering the number of things he didn't mention that he's since endorsed as exactly what he meant, I've joined your consensus.

Replies from: Gkalai
comment by Gkalai · 2009-07-08T16:20:11.035Z · LW(p) · GW(p)

well, brian, what you wrote is not exactly what I was saying

the problem with your statement Most people would say that the difference between a game of luck and a game of skill is the degree to which luck and skill contribute to the outcome: is that I am not aware of any definite way to quantify the degree to which luck and skill contribute to the outcomes

People often assume that the most skillful the player need to be the higher the contribution of skill to the outcome is but this does not seem to be true

comment by timtyler · 2009-07-06T06:19:48.879Z · LW(p) · GW(p)

"We can suppose that the higher the stakes are, the higher the ingredient of luck of the combined game."

That's called "assuming what you are trying to prove"!

comment by Mycroft65536 · 2009-07-06T04:56:49.122Z · LW(p) · GW(p)

I think the argument is that if the stakes are high enough people's betting patterns create a zero expectation on the bit itself. This seems wrong on the face of it. It assumes that the bettors on the chess match are perfectly evaluating their skills at making perfect bets with expectation of zero, that there is no skill in determining the bet. Thus with an expectation of zero, the winner of the bet is determined by luck.

This becomes more absurd in the poker game. The difference in skill of betting for action is a large part of the game. Most poker books try to teach it. Most people can't do it.

Replies from: Gkalai, cousin_it
comment by Gkalai · 2009-07-06T15:57:00.078Z · LW(p) · GW(p)

"Most people can't do it"

This is precisely my point and probably the basis for the judge's rationale in the old case. The situation of those" most people" who cannot do it but still take parts in betting on poker is similar to those playing the roulete. if this accounts for a large percent of participants than it is justified to regard the activity as primarily - gambling (or game of luck) I think there are additional ingredients that will push the situation towards a game of luck when the stakes are high.

Replies from: GuySrinivasan
comment by GuySrinivasan · 2009-07-06T16:31:03.344Z · LW(p) · GW(p)

I think I see... for positive-expectation games (e.g. scientific research) it is possible that the majority of people involved play with justified reason to believe they will make money/good/utility/whatever without implying that the minority without that justified reason to believe will lose tons of money. For zero or negative sum games this is not true. The majority of people cannot have justified reason to believe their individual game is positive expectation (it's not justified 'cause information that the game is zero/negative sum, and information about how good at the game other people are, is widely available), and are therefore relying on "luck" to select them to win rather than others. Or if the majority know they will win, that implies the minority are losing a lot.

comment by cousin_it · 2009-07-06T10:14:18.728Z · LW(p) · GW(p)

I couldn't discern why the magnitude of the stakes matters at all. By the article's reasoning, each player has some probability of winning => chess is a "game of luck".

comment by JGWeissman · 2009-07-06T03:40:12.470Z · LW(p) · GW(p)

It seems that Kalai's argument is that high stakes can transform a game of luck through its effects on the "incentives and motives of players", though he never explains what those effects are, or describes what he thinks the "incentives and motives of players" are in any situation. In short, I don't think he presented an actual argument to be followed.

Replies from: GilKalai
comment by GilKalai · 2009-07-06T13:04:04.884Z · LW(p) · GW(p)

Precisely, my argument is that high stake bettings can transform a game of skill inti a game of luck I tried to decribe some mechanisms why it can occur in a further comment on my blog.

Replies from: cousin_it, Richard_Kennaway, cousin_it
comment by cousin_it · 2009-07-06T13:34:42.240Z · LW(p) · GW(p)

Folks, I got Gil's argument at last. Woohoo!

A chess tournament produces bits of information: who won which game. If most of those bits can be causally linked to skill differentials between players, rather than chance, Gil calls it a game of skill. Otherwise, luck. If stakes are high and zero-sum, players start trying to find weaker opponents. This means each game will be between players of roughly equal ability, so skill differentials cease to contribute bits to the bottom line.

Gil, is that right? If so, I apologize for misunderstanding at first. This sounds interesting.

Replies from: Gkalai, Vladimir_Nesov
comment by Gkalai · 2009-07-06T14:20:32.490Z · LW(p) · GW(p)

Precisely, this is what I meant. Sorry for not being clearer.

Replies from: orthonormal, SilasBarta
comment by orthonormal · 2009-07-06T17:30:21.422Z · LW(p) · GW(p)

It's not a matter of being clearer; you didn't say anything like the paragraph cousin_it wrote above. You have to show some intermediate steps here, because it looked to me that you were claiming that the same two opponents would have different probabilities of outcomes depending on the stakes of the game, without any explanation of why this should be so.

If you're indeed talking about the selection bias for players as stakes change (and more or less an "efficient market" hypothesis near the top), you needed to say something in that direction.

Replies from: Gkalai
comment by Gkalai · 2009-07-06T17:41:36.992Z · LW(p) · GW(p)

Yes, indeed i am talking about selection bias for players as stakes change. When the stakes are higher if players are rational then the selection bias will lead to them to have similar skills, and this means the game turning more into a game of luck, unless.. some players without adequete skills are playing just by gambling effect, and this also pushes the game into a game of luck ---of a different nature

Replies from: orthonormal
comment by orthonormal · 2009-07-06T18:15:21.659Z · LW(p) · GW(p)

Well, as someone else has noted here, this still doesn't correspond to our usual meanings of skill and luck. I mean, I'm equally likely to beat or lose to you in a game of Candyland, and Federer and Nadal are (very roughly) equally likely to win at tennis, but the two situations aren't equivalent, since you could replace me with your 4-year-old niece at Candyland and have the same probabilities, but not so much with the tennis example. This is why most of us call Candyland a game of luck and tennis a game of skill (with a small amount of luck involved); the degree of skill is determined by how much the probabilities of outcomes depend on certain measurable and robust characteristics of the players.

I don't know, but I suspect that you have some strong ethical boundaries regarding the "skill/luck" line, so that you've identified it with a "good/bad" line; tennis is "good" because few people lose their livelihood trying to succeed at it, so it must be "skill", while poker is "bad" because a large number of people lose their savings playing it, so it must be "luck". But you need to be aware that there's a rather uncontroversial way that most of us use the terms "skill" and "luck", and that your usage violates it.

Replies from: Gkalai
comment by Gkalai · 2009-07-06T20:03:07.819Z · LW(p) · GW(p)

Dear Orthonormal, You are partially correct. it may be true that the way I use game of skill/luck it is not the ususal one, but it is a reasonable way, more solid, in my opinion, from the point of view of game theory/economics, and more importantly, it is relevant to the usage in the relevant laws which was meant to define what gambling is, and to common wisdon regarding gambling

The conventional way does not give you a way to measure the ingredients of skill and luck, and it treats the bare game without taking into account the entire scenario, the game, the betting, the winners, the enterance fees, etc

When you try to determine what is a gambling activity and what is not, looking just at the bare game is insufficient the common wisdom regarding these 50 years old poker clubs in J-m is that what was going on there was a gambling activity Aumann proposed a loophole in the legal definition of gambling based on luck and skill ingredients However, if you examine the situation carefully you realize that the usual meaning about what is game of luck/skill is insufficient, and is not compatible with the usual meaning of what is a gambling activity. A more careful analysis based on the entire scenario is more appropriate

In any case, the difference is not between tennis and poker, and it is not based on ethical boundaries (I do not have strong opinions about whether gambling should be legal). The difference is between high stakes negative- expected-rewards games and high stakes games where players expect positive rewards

Replies from: orthonormal
comment by orthonormal · 2009-07-06T20:16:22.856Z · LW(p) · GW(p)

In any case, the difference is not between tennis and poker, and it is not based on ethical boundaries (I do not have strong opinions about whether gambling should be legal). The difference is between high stakes negative- expected-rewards games and high stakes games where players expect positive rewards

That's absolutely fine. Just don't call it skill versus luck. Come up with new words to express the concepts you think are important; these names are taken.

The conventional way does not give you a way to measure the ingredients of skill and luck

Yes it does; one piece of evidence that tennis involves less luck than golf is that in match-play tournaments of about the same size, you're much more likely for a golfer outside the top 10 to win than for a tennis player outside the top 10 to win.

Or that baseball involves more luck than basketball, because a streak of (say) 27 wins in 30 games is much more common for a top team in basketball than baseball.

(Yes, there are differences in how level various playing fields are, but these phenomena seem to be robust across competition in high school, college and professional levels (AFAICT), so it seems like strong evidence to me. If it were important to me, I could start finding more and more objective metrics of skill versus luck in various games.)

Replies from: Gkalai
comment by Gkalai · 2009-07-06T21:03:12.771Z · LW(p) · GW(p)

Very good. The conventional ways you propose to measure luck and skill ingredients are precisely the same as what I would use.So my notions are consistent with the usual ones. When you say that baseball involves more luck that basketball your notion depend on the entire scenario and reward systems and not just on the rules of the games precisely as I suggest the new ingredient in my analysis is that these measures may not be robust if we change the reward system.

Replies from: orthonormal, SilasBarta
comment by orthonormal · 2009-07-06T21:34:14.897Z · LW(p) · GW(p)

Perhaps a better way to explain myself is by looking at what I'd consider a sign of how much skill is involved in a game: roughly speaking, how many different strata of players are there for a widely played game, where each stratum can beat the stratum below (let's say) 90% of the time? There's only one stratum for Candyland, and at most three (humanly speaking) for tic-tac-toe, but numerous strata for a game like tennis.

So we can think of luck-vs-skill also in the sense that tennis is more stratified than golf, because a few PGA players have a 10% or better chance of beating Tiger on a given weekend, and many PGA players have a 10% or better chance of beating one of those players, and a top amateur or college golfer has a 10% chance of beating one of those players, and so on down; while there seem to be more layers than that in tennis.

Now, high-stakes games can cause a selection bias wherein all lower strata will withdraw from a competition, but this doesn't change the components of skill and luck for that game; if you forced the withdrawing players to play for those high stakes, you'd see similar results as you'd see for low stakes (neglecting psychological effects of the fear of a bigger loss, but your analysis doesn't seem to incorporate these). The usual concepts of skill and luck are defined by what would happen if X played against Y; your analysis is about something else, which determines whether X plays in the first place. So please call it something else.

comment by SilasBarta · 2009-07-06T21:11:08.898Z · LW(p) · GW(p)

So my notions are consistent with the usual ones. When you say that baseball involves more luck that basketball your notion depend on the entire scenario and reward systems and not just on the rules of the games.

No. Orthonormal said nothing of the sort. He just listed ways to check whether a game is skill or luck based, and didn't claim that the critical factor is the reward system.

I suggest you spend less effort trying to look like you were right all along and just admit, "Okay, I used the terms differently from how they're normally used." Is it really that hard? It's the least you could do given such a misleading title.

comment by SilasBarta · 2009-07-06T14:44:47.405Z · LW(p) · GW(p)

I think you mean, "Sorry for not being clearer despite using over 15 times as many words."

comment by Vladimir_Nesov · 2009-07-06T14:38:43.869Z · LW(p) · GW(p)

There is no reason for bets to be of zero expected money. Just bet around zero expected utility of money. The whole argument might be a characterization of this bizarre betting rule, but not of the games themselves.

comment by Richard_Kennaway · 2009-07-06T13:32:41.474Z · LW(p) · GW(p)

But what do you mean by "luck"? I am wondering if there is a translation problem here, and a Hebrew word that does not quite map onto the English one. In English it simply means random factors outside the control of the participants. (It is often accompanied by a superstition that it isn't random but a fickle force that can be attracted or repelled by suitable behaviours.) In that case roulette is entirely luck, poker is partly luck and partly skill (but less luck and more skill the better you are at it and the longer you play), and chess has very little luck. All regardless of the stakes.

The case of the poker club in Jerusalem was presumably conducted in Hebrew. Did the judge simply decide that the activity in question was a social evil that had to be found illegal whatever the letter of the law, or did the law allow itself to be read as supporting the ruling?

Replies from: Gkalai
comment by Gkalai · 2009-07-06T16:25:24.125Z · LW(p) · GW(p)

Well, in hebrew the meaning is the same. Regarding the poker club in Jerusalem indeed Aumann felt that the judge did not follow the letter of the law but rather his own perception of right and wrong. I offered an explanation why the judge ruling is consistent with the law

I think the difference between our opinions is that you regard the part of poker that is luck and the part that is skill as intinsic property of poker, and perhaps also of how long is the game. In my opinion, just as longer games make the skill element higher there are other ingredients (such as high stakes; winner takes all, and more) that push the skill element down

comment by cousin_it · 2009-07-06T13:28:15.694Z · LW(p) · GW(p)

Gil, how exactly do you define game of luck vs game of skill? For example, you write:

For example, if players are playing even-bets chess games then a major effort of the players will be to choose opponents with lower or equal skill level. This will push the betting to be primarily between players of equal skills with roughly the same probability to win.

So does your definition imply that if players are evenly matched, the game is about luck? Doesn't look very intuitive to me.

comment by Gkalai · 2021-02-21T05:47:51.555Z · LW(p) · GW(p)

Perhaps a better way to put the argument in the post is as follows: High-stake chess is either a game of luck (which is in tension with no-gambling laws) or a fraud (which is also in conflict with the law). The same holds (even more so) for high-stake poker.

Another example: If people bet on the outcome of a fair coin this is a 'game of chance' (and this in conflict with the no-gambling laws). If people bet (evenly) on the outcome of a biased coin this is fraud (and also in conflict with law). High stake chess and high-stake poker are either a  'game of chance' or fraud.

comment by Gordon Seidoh Worley (gworley) · 2009-07-06T15:22:37.260Z · LW(p) · GW(p)

I'm glad you brought this to discuss here. I read that article earlier this morning before I saw this post and was similarly confused.

comment by Vladimir_Nesov · 2009-07-06T15:10:18.690Z · LW(p) · GW(p)

People are risk averse, so a zero-sum bet (in money) would have negative utility for the weaker player, unless the player causes the probability of winning to increase given a fixed bet (this is "application of skill", that is performance with exceptionally good concentration/preparation/etc. that makes the a priori estimation of player's skill inaccurate in the particular game). The amount on which this probability must be increased in order to make the expected utility of the bet positive, depends on the absolute values of bets. The bigger the bets, the more the weaker player must increase the probability of winning in order to cross over into positive expected utility.

A game can then be called "a game of skill" if effort can sufficiently increase player's probability of winning, and "a game of luck" if an impossible increase in this probability is necessary. Normal lotteries can't be turned to positive expected utility, so they are always games of luck. Poker can't be turned to positive expected utility by weak players, so for them it's game of luck, while for stronger players it's game of skill. Chess for smaller bets is game of skill, and for bigger bets game of luck for the weaker player.

comment by jimrandomh · 2009-07-06T06:29:12.943Z · LW(p) · GW(p)

The picture at the top of the article is of a chess board that has been set up incorrectly (the white queen and king are swapped). The rest of the article is just concentrated confusion; he switches unexpectedly from talking about chess to talking about betting on games in general, then rambles about luck for a bit without ever nailing down a definition of it.

comment by [deleted] · 2009-07-10T02:12:13.373Z · LW(p) · GW(p)

I've always though that the difference was the frequency that skilled players win.

comment by CronoDAS · 2009-07-06T20:42:49.114Z · LW(p) · GW(p)

Incidentally, Richard Garfield, designer of Magic, once wrote on the topic of luck in games. He said that there is, in fact, luck in chess, because we cannot predict the outcome with certainty. He went on to explain that if he sat down to play chess against Kasparov or some other world-class chess champion, he'd expect to lose, but there's still a possibility (however small) that he could happen to stumble upon a superior line of play, perhaps without even realizing it, and end up winning.

Replies from: RolfAndreassen, SilasBarta, orthonormal
comment by RolfAndreassen · 2009-07-07T19:20:58.684Z · LW(p) · GW(p)

Perhaps it would be useful to make a distinction between the game of chess, which is mostly skill, and the game of betting on chess, which is mostly luck with fairly well-known probabilities. It looks to me as though the original article is conflating the two very badly, and that this is the cause of much confusion.

comment by SilasBarta · 2009-07-06T20:50:44.598Z · LW(p) · GW(p)

Richard Garfield, designer of Magic, once wrote on the topic of luck in games. He said that there is, in fact, luck in chess, because we cannot predict the outcome with certainty. ... there's still a possibility (however small) that he could happen to stumble upon a superior line of play, perhaps without even realizing it, and end up winning.

Incidentally, when I saw the title of this top-level post, I thought the argument was going to be something like what you've described here: when you make a move, you're steering the game in a direction that has an element of randomness because you can't really review all possibilities. And so you end up surprised at how good or bad it was for you.

Alas, it turns out that Gkalai was simply using a non-standard meaning for his words. Bait-and-switch.

comment by orthonormal · 2009-07-06T20:51:25.060Z · LW(p) · GW(p)

Correct, of course; but we can make some pretty strong quantitative distinctions. I'm more likely to win the lottery than to beat Kasparov (assuming he's healthy and playing at his usual level, etc). But I bet I could beat any human being or computer program at Candyland half the time.

Similarly, if you put me heads-up against a poker pro, I might stand as much as a 10% chance of knocking them out (by getting lucky on the river on an all-in); but that level of luck averages out to a great degree over a long tournament, so that again my chances of making the final table at the WSOP are order-of-lottery bad.

Replies from: CronoDAS, MBlume
comment by CronoDAS · 2009-07-06T21:51:25.824Z · LW(p) · GW(p)

Correct, of course; but we can make some pretty strong quantitative distinctions. I'm more likely to win the lottery than to beat Kasparov (assuming he's healthy and playing at his usual level, etc). But I bet I could beat any human being or computer program at Candyland half the time.

Indeed. (Assuming nobody's cheating, of course.) Garfield's statement does not necessarily reflect my own opinions on things.

comment by MBlume · 2009-07-06T21:34:23.286Z · LW(p) · GW(p)

Similarly, if you put me heads-up against a poker pro, I might stand as much as a 10% chance of knocking them out (by getting lucky on the river on an all-in)

In this case, you can probably improve your chances by making the game more about luck -- just go all-in every hand.

Replies from: CronoDAS, orthonormal
comment by CronoDAS · 2009-07-06T21:57:24.380Z · LW(p) · GW(p)

I've heard that, if you go all-in on every hand in a heads-up poker match, the optimal counter-strategy still leaves you with a 1/3 chance of winning. (I don't know if this is correct or not.)

Replies from: orthonormal, steven0461
comment by orthonormal · 2009-07-06T22:18:48.548Z · LW(p) · GW(p)

Sounds about right to me. Going all-in every hand (pre-flop, and blind, of course, so I can't be read) would definitely improve my odds if I were in a heads-up game against a pro. But at a table with more than (say) 3 others, unless they can read me as perfectly as Omega, I should probably start looking at my cards and following a simple memorized poker algorithm.

comment by steven0461 · 2009-07-06T22:23:33.264Z · LW(p) · GW(p)

It depends -- in the limit where blinds are zero, you only call with aces and win 80% of the time. For more realistic values you may well be right.

(I had a truly marvelous bit about luck in chess in an unposted draft. Now I'll probably throw that bit away.)

comment by orthonormal · 2009-07-06T22:20:34.242Z · LW(p) · GW(p)

Reminds me of making the system dumber when faced with a superior adversary.

Replies from: MBlume
comment by MBlume · 2009-07-06T22:28:04.740Z · LW(p) · GW(p)

If you're winning, simplify. If you're losing, complicate. Works in philosopher's football too -- if you expect to be the one to bolt first, you want a kink in the path.

comment by timtyler · 2009-07-06T06:21:24.320Z · LW(p) · GW(p)

Fails to define what it means to be a "Game of Luck" - AFAICS. In practice, human chess is a game of skill with a small element of luck.

comment by anonym · 2009-07-06T04:19:46.131Z · LW(p) · GW(p)

The judge did not base his argument on an abstract mathematical modeling of the entire setting but rather on the consequences. If such clubs indeed cause people to lose everything leaving their families destitute we must conclude that the overall setting makes this activity mainly a gambling activity and that this game is mainly a game of luck (in the same way playing the roulette is).

By this "argument", financial investing is mainly a gambling activity and mainly a game of luck, since it's just as obviously the case that such markets "indeed cause people to lose everything leaving their families destitute."

Replies from: Gkalai
comment by Gkalai · 2009-07-06T14:30:32.085Z · LW(p) · GW(p)

This is an interesting comment. I think people are aware that financial investment involves some elements of luck, but carries the benefit that it advances the economy a major difference with our case is that financial investment is not (at least not obiously) a negative expectation activity