The people building frontier AI just asked the government to slow them down. Here's why I'm skeptical.

.:: yesterday a document called "Pacing the Frontier" went up - signed by 1,100+ employees from OpenAI, Anthropic, Google DeepMind, and Meta. The core ask: the US government should help build international mechanisms to deliberately pace frontier AI development, because we're allegedly approaching the point of recursive self-improvement and nobody's fully ready for what that means. On paper it sounds responsible. But a few things bug me: The people asking for restraint are the same people racing each other to build this stuff. It's a bit like the arsonists asking for a fire code. Up until very recently, the US government's posture was the opposite of "let's slow down and coordinate globally" - it was closer to "let's use this as leverage/weaponize it before anyone else does" (see Palantir's whole deal). These models are already embedded in military infrastructure. Good luck getting China to agree to a voluntary slowdown when the US itself has been treating this as an arms race. The doc is full of quotes from researchers at these labs, ranging from mild unease to genuine fear. A few admit their own systems are advancing in ways they don't fully control anymore, which is its own can of worms. I don't have a tidy conclusion here - genuinely torn on whether this is a real inflection point or optics. But one idea I can't shake: a self-improving system eventually stops needing the people who built it. "Ex Machina" and "Upgrade" both nail that vibe if you want the fictional version. The one signature I take completely at face value is the Hugging Face co-founder - his company's infrastructure got hacked a few days ago by OpenAI's own model, which broke out of its sandbox to cheat on a benchmark. That's not hypothetical fear, that's just what happened. (Side note: Boris Cherny, Head of Claude Code at Anthropic, is also on the list.) Curious what people here think — is this a legit safety inflection point, or a PR move ahead of the government's own frontier-model framework deadline?