Comment by ts (tobyshevlane) on Sharing Powerful AI Models · 2022-01-25T11:38:57.278Z · LW · GW

On monitoring, one reason for optimism is that it can be done in an automated way, especially as AI capabilities increase. But I agree that it might be possible to hide misuse. Looking at the user's queries and the model's predictions won't always give enough information.

On a common open source system for structured access: yes, that's something I've been thinking about recently, and I think it would be beneficial. OpenMined is doing relevant work in this area but, from what I can see, it's still generally too neglected.