Comment by Kustogor (savelii-kustogorov) on There's No Fire Alarm for Artificial General Intelligence · 2022-08-29T07:55:15.237Z · LW · GW

The fire alarm was created to answer a frequent and observable threat. The existential threat, by definition, is not the one.

While AGI is theoretically possible, there is no certainty in that (when did the last time AGI emerged?). There is no fire alarm in the space industry against alien invasion. Because until you spot the first spaceship, you can not be sure that aliens reliably exist.

Therefore I don't think there can be a fire alarm for AGI in the sense that there would be a system sending a common signal to the industry. The better comparison should be with tools preventing something that never ever happened. 
These kinds of systems were designed for the first nuclear reactor. But other than that, I guess mostly religions create tools for this kind of threats.