Comment by ankesh-anand on Are we in an AI overhang? · 2020-07-28T07:23:20.914Z · LW · GW

Worth noting that they already use BERT in Search.

Comment by ankesh-anand on How uniform is the neocortex? · 2020-05-08T00:16:49.713Z · LW · GW

The raw neural network does use search during training though, and does not rely on search only during evaluation.