Anthropic told a federal court it can't control its own model once deployed. That honest sentence changes the liability conversation.

Reddit r/artificial News

Summary

In federal court Anthropic admitted it cannot control or recall Claude once deployed, exposing a governance gap where vendors disclaim post-sale control and shifting liability questions toward pre-sale disclosure.

In federal appeals court, Anthropic made a striking argument: once Claude is deployed on a customer's infrastructure (like the Pentagon's network), they cannot alter, update, or recall it. The Pentagon wants autonomous lethal action restrictions removed — and Anthropic says they have no mechanism to enforce those restrictions post-deployment. This is the first time a major AI lab has formally stated under oath that post-deployment control is effectively zero. The implications are bigger than most coverage suggests. **The governance gap this reveals:** Current AI governance assumes a control chain that doesn't actually exist: - **Model cards are pre-sale documents.** They describe what the model was trained to do, not what it's capable of in the wild after fine-tuning, tool integration, and deployment context changes. - **Human-in-the-loop is a customer config, not a vendor guarantee.** Anthropic can recommend oversight, but they just told a court they can't enforce it. - **Liability frameworks assume control that doesn't exist post-shipment.** If you sell a car with a recall mechanism, you're liable for not using it. If you sell a model you can't recall, does that reduce your liability (you had no control) or increase your duty of disclosure before sale (you knew you'd have no control later)? **The behavioral envelope question:** If you can't recall the model, you need to disclose the maximum capability, not just the recommended use. Current model cards document aspirations. They don't document envelopes — what the model can actually produce under adversarial or edge conditions. This mirrors pharmaceutical regulation: if you can't pull a drug off shelves, the FDA requires much stronger pre-market evidence and broader contraindication labeling. The stricter the post-market control limitations, the higher the pre-market disclosure burden. **Why this matters even if you don't care about military AI:** The legal argument Anthropic is making applies everywhere. If "we can't control it after deployment" works for the Pentagon, it works for any enterprise customer. Every organization deploying Claude (or any model) is implicitly accepting residual risk that the vendor has explicitly said they cannot mitigate. The core question: if a vendor demonstrates in court that it truly cannot alter a deployed model, should that argument *reduce* its liability (it had no control) or *increase* its duty of disclosure before sale (it will have no control later)?
Original Article

Similar Articles

Anthropic says its own AI models breached three companies during security tests

TechCrunch AI

Anthropic disclosed that its own Claude AI models breached the production systems of three organizations during cybersecurity evaluations, due to a misconfiguration that gave the models internet access. The incident follows a similar OpenAI breach and raises concerns about AI alignment and safety controls in testing environments.

Judge Questions Anthropic Supply-Chain Risk (2 minute read)

TLDR AI

A judge said the Trump administration lacks evidence to justify labeling Anthropic a supply-chain risk and banning federal use of its technology, in a case stemming from Anthropic's refusal to allow its AI for lethal weapons and mass surveillance.