Request to AGI organizations: Share your views on pausing AI progress

At the time of this post, the FLI letter has been signed by 1 OpenAI research scientist, 7 DeepMind research scientists/engineers, and 0 Anthropic employees. 

"1 OpenAI research scientist" felt weird to me on priors. 0 makes sense, if the company gave some guidance (e.g. legal) to not sign, or if the unanimous opinion was that it's a bad idea to sign. 7 makes sense too -- it's about what I'd expect from DeepMind and shows that there's a small contingent of people really worried about risk. Exactly 1 is really weird -- there are definitely multiple risk conscious people at OpenAI, but exactly one of them decided to sign?

I see a "Yonas Kassa" listed as an OpenAI research scientist, but it's very unclear who this person is. I don't see any LinkedIn or Google Scholar profile of this name associated with OpenAI. Previously, I know many of the signatures were inaccurate, so I wonder if this one is, too?

Anyway, my guess is that actually zero OpenAI researchers, and that both OpenAI and Anthropic employees have decided (as a collective? because of a top down directive? for legal reasons? I have no idea) to not sign.

Demis Hassabis answered the question "Do you think DeepMind has a responsibility to hit pause at any point?" in 2022:

https://www.lesswrong.com/posts/vEJAFpatEq4Fa2smp/hooray-for-stepping-out-of-the-limelight?commentId=x8DZswktu3WtfyzFR [LW(p) · GW(p)]

I actually don't know that I think this is helpful to push for now.

I do wish a "good version" of this would happen soon, but I think the version you'd be likely to get is one where they write weird reputational concerns where they don't want to be seen by their investors as not racing ahead to make progress as fast as possible (since their investors don't understand the degree of danger involved)

(There's also the bit where, well, the fact that they're labs pursuing AI in the first place means that (in my opinion) leadership would probably just have pausing-takes I think don't make sense)

And then, once having written a public statement on it, they'd be more likely to stick to that public statement, even if nonsensical. 

I do generally wish more orgs would speak more freely (even when I disagree with them), and I separately wish something about their strategic thinking process was different (though I'm not sure exactly what their thought process is at the moment so not sure how I wish it were different). But both of those things seem like causal-nodes further up a chain than "whether they engage publicly on this particular issue."

I signed the letter because I think that such things are a useful way of moving the Overton window. In this case, I want the government and the public to start thinking about whether and how to regulate AI development. I might not have signed the letter if I thought that it would actually result in a pause, since I don't think that that's probably the wisest strategic move at this point. I explain why here: https://www.lesswrong.com/posts/GxzEnkSFL5DnQEAsZ/paulfchristiano-s-shortform?commentId=hEQL7rzDedGWhFQye [LW(p) · GW(p)] 

I think it makes sense that the orgs haven't commented, as it would possibly run afoul of antitrust laws.

See for example when some fashion clothing companies talked about trying to slow down fashion cycles to produce less waste / carbon emissions, which led to antitrust regulators raiding their headquarters.

On March 22, FLI published an open letter calling for a six-month moratorium on frontier AI progress.

I think it's a mistake to claim that given that the call is for a moratorium on "frontier AI progress" overall.  but about a subset of progress. 

The call is for "Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4. This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium."

It explictely says "AI research and development should be refocused on making today's powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal" and not that all AI research and development should stop. 

I strongly agree with this request.

If companies don't want to be the first to issue such a statement then I suggest they coordinate and share draft statements with each other privately before publishing simultaneously.

I think silence is a clearly sensible strategy for obvious reasons.