Comment by Grégoire DHIMOÏLA (gregoire-dhimoila) on How well do truth probes generalise? · 2024-03-01T14:39:39.945Z · LW · GW

Why did you opt for recovered accuracy as your metric? If I understand correctly, a random probe would achieve 100% recovered accuracy. Are you certain your metric doesn't bias towards ineffective probes?