Making a conservative case for alignment 2024-11-15T18:55:40.864Z

There Should Be More Alignment-Driven Startups 2024-05-31T02:05:06.799Z

AE Studio @ SXSW: We need more AI consciousness research (and further resources) 2024-03-26T20:59:09.129Z

Comment by phgubbins on AI companies aren't really using external evaluators · 2024-06-03T07:32:00.033Z · LW · GW

I had an opportunity to ask an individual from one of the mentioned labs about plans to use external evaluators and they said something along the lines of:

“External evaluators are very slow - we are just far better at eliciting capabilities from our models.”

They earlier said something much to the same effect when I asked if they’d been surprised by anything people had used deployed LLMs for so far, ‘in the wild’. Essentially, no, not really, maybe even a bit underwhelmed.