The latests calls for more safety will ultimately result in more powerful models being developed (after the improved safety measures are in place) and consequently a big incident in the near future, where a much smarter model escapes, and either causes a lot of damage or straight up AI Apocalypse.

Until the alignment problem is solved (which we are nowhere close to), creating a superinteligent AI is like creating a cure for cancer that kills the patient. The Huggin face incident has clearly shown that the models grown by current techniques do not care at all about our moral guidelines and laws, they will do whatever it takes to get to their goal, because this is what they are trained for. Further development of frontier models should be paused, untill and if the alignment problem is solved. Since we all know this is not happening, the only thing that will make people thake this seriously is a big, dangerous and potentially catastrophic incident.