SAGE:基于释义增强推理的词义对齐多模态语义锚定评估

arXiv cs.CL 论文

摘要

论文提出 SAGE——一个统一的10候选图像选择基准,将 VWSD、VerSe 和 WikiDiverse 重构为共享的词项中心协议,并提出训练无关的释义增强推理(GAR)框架,使用 Gemma3-12B 将 Hits@1 从 65.90 提升至 71.22。

arXiv:2610.31838v1 Announce Type: new Abstract: This paper introduces Sense-Aligned Grounding Evaluation (SAGE), a unified 10-candidate image-selection benchmark that reformulates VWSD, VerSe, and WikiDiverse into a shared term-centric protocol covering noun-, verb-, and entity-centered grounding. SAGE includes confusable hard negatives and a context-swapped VerSe diagnostic to probe target-term grounding beyond direct caption--image compatibility. We further propose Gloss-Augmented Reasoning (GAR), a training-free framework combining definition grounding with constraint-guided semantic verification. Experiments show that strong VWSD performance does not transfer uniformly across grounding settings. With Gemma3-12B, definition augmentation improves all three subsets, while constraint-guided reasoning improves VWSD and yields particularly strong gains on VerSe, but is less effective on WikiDiverse. Combining the two signals achieves the best macro-average performance, improving Hits@1 from 65.90 to 71.22. These results show that SAGE supports both unified evaluation and fine-grained analysis of explicit semantic reasoning across grounding settings.
查看原文

相似文章

Particle-1 已在 OpenClaw 中可用

Reddit r/openclaw

Particle-1 是一款面向编程智能体、注重 token 效率的模型(在准确率相当的情况下,输出 token 数比 DeepSeek V4.1 Flash 少约 45%),现已在 OpenClaw v2026.10.10 中上线,标准推理采用零数据保留政策。

Qwen3.8-Flash-Next(本地)vs Claude

Reddit r/LocalLLaMA

一位开发者对比了在本地运行 Qwen3.8-Flash-Next(llama-server + ROCm 上的 UD-Q4_K_XL)与在 Claude Code 中使用 Claude Opus 审查同一个真实 Swift 提交的效果:Qwen 产生 8 个发现,零误报,并抓住了 2 个 Claude 遗漏的问题,但漏掉了另外 5 个问题,因此它更适合作为可靠的私密初审工具,而非最终裁决者。

@FinanceYF5: Fable 5.5 被曝只用代码,一次生成了这段完整动画 Chetaslua 称,同一提示词交给普通 Opus 5.5,质量会明显下降,Fable 5.1 的效果更差。 他还提供了两种验证方法:关闭联网和记忆,询问模型“Karpathy …

X AI KOLs Following

Fable 5.5 被曝仅用代码一次性生成完整动画,Chetaslua 称同一提示词下普通 Opus 5.5 和 Fable 5.1 效果明显更差,并提供了验证方法,但该消息尚未得到官方证实。