Comment by Ary.Bin-Us (nybarius) on [ASoT] Natural abstractions and AlphaZero · 2022-12-11T01:11:25.618Z · LW · GW

Thank you, very interesting paper (and it is good to see that Kramnik has kept up an active interest in chess computing, hehe).

The paper you cite seems to converge nicely with evidence that large transformer model embeddings for language comprehension map on to human semantic understand (e.g.,:

https://www.nature.com/articles/s41598-022-20460-9

https://www.nature.com/articles/s42003-022-03036-1 ) 

Related, it appears we are even approaching a refined normative theory & practical benchmarking of hyperparameter transfer, which may be very roughly akin to conceptual understanding (https://www.microsoft.com/en-us/research/uploads/prod/2021/11/TP5.pdf 

https://www.microsoft.com/en-us/research/blog/%C2%B5transfer-a-technique-for-hyperparameter-tuning-of-enormous-neural-networks/

Truly, a wonderful time to be alive; I feel as if all the detective novels I'd ever read had reached dénouement at once.