Tag
研究在 CTI-REALM 安全检测规则生成基准上评估了 26 个模型(19 个开放权重、7 个闭源),发现给予足够交互轮次时,开放权重模型能以不到十分之一的成本匹配最强闭源模型。作者还指出基准的消息轮次上限是混淆因素,并提出按工作流阶段路由到不同模型的建议。
An open detection rule format for AI agent security threats, inspired by Sigma/YARA, aims to standardize detection of prompt injection, tool abuse, and other agent attacks, though it notes limitations against semantic attacks.