Articles from arXiv
该论文提出 PERPL 框架,通过 LLM 模拟读者的相对偏好来学习个性化事实核查解释改写,在保持事实忠实性的同时优于更大的通用 LLM。
Capital One's AI Foundations team introduces UCVE, a domain-agnostic framework that models compliance requirement spaces as a Contextual Requirement Graph (CRG) and performs retrieval via spectral reranking over a reinforcement-learning-weighted Laplacian. Evaluated across three compliance domains, UCVE achieves a 4.3% matched-K recall lift over flat cosine retrieval, outperforming strong retrieval and graph-based baselines.
The paper presents Multi-Label Agreement (MLA), a flexible framework for evaluating inter-annotator reliability in multi-label annotation tasks using pairwise Hamming agreement with multiple normalization options, along with a Python implementation.
该论文提出一种两阶段方法用于ArGuard 2026共享任务中的阿拉伯语有害内容检测:先用GLiNER提取有害相关实体,再将实体与原始文本输入微调后的MARBERT进行分类,在开发集上取得0.886的macro-F1分数。
研究了大语言模型在豪萨语等低资源语言中的安全对齐问题,提出HausaSafeLM安全偏好数据集,并发现仅靠拒绝率指标无法可靠衡量低资源语言中的模型安全性。
该论文构建了涵盖五种幻觉类型的二元基准(来自六个数据集的9,852个样本),比较了五种决策模型与生成式裁判gpt-6-sol在幻觉检测上的表现,发现决策模型在部分类型上以1-3%的成本匹敌或超越生成式裁判,但在逻辑与指令不一致类型上仍有差距且概率存在过度自信问题。
This paper applies mechanistic interpretability tools—including linear CKA, logit lens, attention decomposition, sparse autoencoders, and activation patching—to compare GPT-2 with DistilGPT-2, revealing a compression-collapse dichotomy where the IOI circuit fully collapses while the Greater-Than circuit survives via layer remapping.
该论文提出一个结合人工整理词汇表与少量人类范文的框架,利用启用推理的LLM为极低资源乃至未见语言生成流畅文本,为合成数据自举提供了一条实用路径。
提出一种层级低秩重参数化方法,将PEFT方法的可训练参数重组为近似方阵并递归进行低秩分解,可在压缩约一个数量级参数的同时保持甚至提升LoRA/DoRA在常识推理与数学推理任务上的性能。
本文对51个近期多语言基准(涵盖242个数据集、219种语言)进行了数据驱动的审计,从覆盖度、代表性和严谨性三方面揭示了多语言评估的结构性缺陷,如英语中心化翻译、语言覆盖稀薄和基准污染问题,并提出了构建原生、文化相关且抗污染的评估框架的建议。
该论文提出了一种名为 Skim(Self-keyed In-Parameter Memorization)的闭式方法,使冻结的语言模型无需外部存储即可将对话内容记忆到模型参数中,并在后续用户提问时从参数中召回答案,在五个语言模型上验证了其可行性。
JevRec encodes items as variable-length semantic IDs inspired by natural-language frequency patterns, using separate heads for length and content prediction to improve LLM-based generative recommendation over baselines like TIGER.
DocXEval introduces the first comprehensive explainability framework for multimodal document understanding, evaluating 13 XAI methods across 3 tasks, 8 datasets, 4 models, and 17 metrics, finding Occlusion as the most faithful and interpretable method overall.
TrawMem reframes LLM agent memory systems as task-oriented role-adaptive workspaces, organizing interaction histories into threads and selecting complementary memories by their task roles, achieving consistent macro-F1 gains of 2.23–3.14 points over representative memory systems on LoCoMo and MemGallery benchmarks.
该论文研究在RAG知识冲突分类任务中,使用typed decision models替代大语言模型的可行性,结果表明决策模型在4-39倍低成本和更低延迟下可匹配或超越Gemini 2.5 Flash的准确率。
Researchers present the first open Speech Language Model for Basque, based on the LLaMA-Omni architecture with a Latxa backbone, using translated and TTS-synthesized data to overcome low-resource scarcity for end-to-end spoken interaction.
A technical report compares taxonomy-label search with a two-stage embedding retrieval plus LLM filtering approach on a corpus of 7,354 randomized trials, finding the new method recovers 92% of systematic-review evidence versus 45% for label search, at a cost that scales with search depth.
该研究探讨 LLM 如何结合用户的言语承诺(words)与历史决策记录(deeds)来预测用户在人机对话中的合作/背叛决策,发现 LLM 高度依赖声明的意图但几乎不受对手智能体人格特征影响,导致对被违背的承诺预测准确率大幅下降。
该论文提出 Recursive Knowledge Improvement (RKI),将知识改进建模为序列化、状态感知的干预过程,通过区分知识状态别名问题来指导干预选择,在 HotpotEval 和 SafeInternalEval 上平均提升 18.41 分。
The paper proposes Personality Latents (PL), a method that learns per-person latents from their own writing via generative latent optimization and injects them as soft prefixes into frozen language models, achieving 0.782 AUC on MBTI personality prediction and cross-model transfer between Qwen2.5-3B and Llama-3.1-8B.