arXiv

The paper introduces Agentic Soft-Token Compression (ASTC), a training-free method that uses an LLM's native recurrent dynamics (GDN-attention) to compress long-horizon agent context into soft tokens, matching or exceeding uncompressed accuracy with up to 50.68% fewer Attention Pairs.

本文提出 PsyInterviewee，通过分离受保护的真相通道与动态交互通道，在心理健康面试模拟中同时保持临床事实的信息不变性与互动的关系适应性，并在自动化评估中优于四个代表性基线。

The paper proposes AICG, an AI-aware cognitive-supervised two-branch framework for automated mathematical short-answer grading that combines RoBERTa-based scoring with Q-matrix skill prediction and a Gen-AI detector to weight unreliable responses, reducing MAE by 50.3% and improving QWK from 0.798 to 0.927 over RoBERTa regression.

TraceSpec is a framework linking LLM agent trajectory evaluation with adaptive draft training for speculative decoding, introducing a TraceSpec-Traj corpus and improving replay throughput by 12.5% to 22.6% over its DSpark base across multiple model sizes.

The paper proposes S2TDR, a structured multimodal framework that converts sticker turns in dialogues into contextually appropriate text via visual cue extraction, affective-intent inference, and context-aware reconstruction, improving downstream sentiment analysis, intent recognition, and summarization over direct sticker integration.

HyperRepair is a framework that recovers the general capabilities of fine-tuned language models while retaining domain specialization at inference cost only, using a hypernetwork that generates a Repairing Side Net from activation fingerprints. It is evaluated across two model families, 12 LoRA adaptation datasets, and 15 general benchmarks, achieving 93.4% of base models' general score while keeping 99.5% of fine-tuned domain performance.

This arXiv paper finds that language models exhibit a 'Women-Are-Wonderful' bias in blame attribution, showing both leniency toward women being judged and substantially harsher judgments when conduct affects a woman, based on 11,270 counterfactual conflicts from r/AmItheAsshole across four models.

EDU-Jev introduces a family of single-pass 'System One' decision models (0.8B/2B/4B) that return probability distributions over fixed options for educational assessment tasks, achieving 67.6% average accuracy across twelve benchmarks and outperforming leading commercial decision APIs by 9.4 points.

该论文研究了RAG系统中的从众偏差：当检索到的多数文档是互相一致的投毒文档时，Gemma-3-12b检测中毒声明的能力从25%显著下降至10%，表明语言模型会随附多数证据而忽视事实核查。

The paper introduces Bilal-Bench, a 240-question expert-verified Bengali benchmark for open-ended Islamic-source fabrication, evaluating seven open-weight models (1B–120B) and finding that six of seven confidently fabricate on 79.3–95.3% of source-production questions with no monotonic improvement from scale.

This paper shows that zeroing out 729 task-redundant attention heads in GPT-2-XL at inference time reduces verbatim memorisation by 91.5% while slightly improving WikiText-103 perplexity, offering a training-free way to mitigate privacy leakage from LLMs.

This paper shows that using incomplete relevance judgments as a shortcut for scoring abstention in conversational RAG benchmarks systematically distorts evaluation: stronger retrievers yield more 'false miss' contexts that still contain answers, badly deflating answerability AUROC. The authors release code, runs, and labels and recommend scoring refusals against content-based labels instead of gold-document presence.

Meta Superintelligence Labs researchers formalize 'adaptive personalization under epistemic uncertainty' and introduce a multilingual benchmark revealing a recognition–generation gap in LLMs, where models default to exploit-first behavior despite appropriate strategy identification; targeted training on internal strategy representations narrows the generalization gap.

CoFiBreak 提出一种粗到细的多样性奖励机制用于 GRPO 训练的多轮越狱攻击，在保持高效攻击的同时显著提升攻击策略多样性，并可迁移到未见过的前沿模型。

Qistas is a pre-registered, portable protocol for evaluating LLM fairness across a society's social, confessional, and regional constituencies, instantiated first for Iraq. The paper releases the authoring apparatus and reports a semantic review of a 58-item seed bank — no models have been evaluated yet, with hypotheses and analysis plans committed via pre-registration.

The paper compares continuous diffusion language models (LangFlow) and speculative drafters (DSpark) as standalone generators under matched training budgets, finding LangFlow superior on perplexity and MAUVE at longer sequence lengths while DSpark-RNN leads at length 16, highlighting iterative full-sequence refinement as a key advantage.

Microsoft Mage Team presents Mage-VL-Cowork, a full training recipe (data synthesis from evolved harnesses, multi-stage SFT, and online hybrid RL) for learning hybrid computer use, with the 4B model achieving strong results on OSWorld-Verified relative to its size.

The paper proposes Li2SAO, a lightweight asynchronous RL method for LLM post-training that uses group-relative actor-critic bootstrapping to warm up the critic before switching to single-rollout GAE, catching up with or surpassing GRPO early in training and raising later performance ceilings.

Duke researchers present StormGen, a generative ML model that completes short observed rainfall records into full, physically plausible storm lifecycles, reproducing rare extremes like Hurricane Harvey and outperforming stochastic storm transposition for stress-testing flood defenses.

The paper introduces quantile propagation planning (QPP), which propagates a fixed set of disturbance quantiles through dynamics to evaluate both mean and tail risk under a limited model-evaluation budget, showing reduced tail cost and constraint violations over mean-rollout planning on overload and inventory tasks.