Mode collapse in RL may be fueled by the update equation 2023-06-19T21:51:04.129Z

Race Along Rashomon Ridge 2022-07-07T03:20:59.701Z

Comment by MichaelEinhorn (michaeleinhorn) on Broad Basins and Data Compression · 2022-08-09T03:38:18.077Z · LW · GW

Would be interesting to try to distinguish between 3 types of dimensions. Number of dimensions that leave the set, number of dimensions in the set due to trivial params, and number of dimensions in the set due to equally good but functionally different models.

Especially if it turns out it is attracted to maximum trivial params, but not maximum dimensionality overall.