Comment by Grégoire Delétang (gregoire-deletang) on Skepticism About DeepMind's "Grandmaster-Level" Chess Without Search · 2024-02-12T20:28:50.354Z · LW · GW

Thanks for the feedback. On the GM-level skepticism: I don't see any recommendation on things we could do to make the claim stronger, and I'm really thirsty for some. What would convince you (and possibly, others) that our neural network is mastering the game of chess?

We are currently (and have already) played against actual GMs and beaten some. But it's not that simple to publish (look at the time it took for 100 times bigger projects like AlphaGo or AlphaStar - this one is a two full-time people project,  Anian and I), for legal reasons, because GM/IMs don't really like to be beaten publicly, for statistical reasons (you need a looot of games to be meaningful) etc.  Also note that many 1500 ELO people that played against the bot on Lichess are actually fake (smurf) accounts of much stronger players.