Articles from arXiv
该论文提出一个通过行为推导的语义维度将多模态大语言模型（MLLM）与人类相似性判断的认知结构对齐的框架，并借助 fMRI 数据的搜索light RSA 验证了表征层面的人机对齐提升。
该论文提出 TIZSKT 框架，将文本作为索引而非可迁移的预测表征，实现零样本跨域知识追踪，在三个公开数据集的留一域实验中取得最优 AUC 与准确率。
The paper presents SimXAI, a lightweight LLM-centric conversational layer that replaces the multi-module GUS pipelines used by ConvXAI agents with a single tool-calling LLM, along with an evaluation suite; a user study swapping only the conversational layer of TalkToModel shows users complete tasks more accurately in fewer turns.
This paper proposes constructing sentence embeddings via path signatures of Word2Vec trajectories, using iterated integrals from rough path theory to explicitly capture lexical structure and word order. Experiments show depth-2 signatures align strongly with character-level edit distances (unlike average pooling) while retaining word-order information in a compact PCA subspace.
The paper shows that Matryoshka Representation Learning embedding prefixes align with coarse-to-fine gold taxonomy granularity, and introduces PEEL, a minimal probe that decodes taxonomic DAGs from frozen embeddings with high fidelity across domains.
The paper proposes Stepwise-Querying, a method that elicits step-specific explanations from black-box teachers without accessing their internal chain-of-thought traces, assembling them into training data for supervised fine-tuning of smaller student models. It achieves the top score in 14 of 16 comparisons across two teachers, two students, and four math/code benchmarks, and introduces the SEIG diagnostic for measuring stepwise explanation information gain.
论文提出 GraphNIAH，一个基于真实引文关系自动构建的长上下文多跳推理基准，用于评估 GPT-5.6、Gemini-3、Qwen3.5 等八个大模型，发现随着推理路径加深，模型准确率显著下降甚至接近随机猜测。
This paper shows that the repetition penalty decoding parameter enables inference-time control of the precision–recall trade-off in LLM-based grammatical error correction, without any changes to model architecture, training, or prompts.
The paper shows that activation steering in LLMs systematically alters discourse-level properties of generated text (formality, evidence use, ambiguity) beyond intended effects, and proposes a complementary vector intervention that restores ~78% of unintended changes while preserving ~93% of intended steering behavior.
The paper presents Saidzoda-Tajik-LFM-2.6B, a Tajik adaptation of Liquid AI's LFM2.5-2.6B-Base for tool calling on modest hardware, using LoRA continued pretraining followed by supervised fine-tuning. Tajik tool-call accuracy jumps from 20.69% to 64.14%, but the authors show CPT wipes out native tool-call formats and harms English MMLU (60.8 to 52.5).
BYOD presents a LoRA-only recipe for efficiently converting autoregressive language models into diffusion language models, achieving conversion of Gemma 2 9B, Llama 3.1 8B, Qwen2.5 7B, and Ministral 8B in about 3-4 hours on a single Colab GPU while keeping all base parameters frozen.
An arXiv case study examining how professional translators can achieve digital sovereignty by migrating their workflows from Windows to Linux.
A paper proposing a unified training objective combining focal loss and supervised contrastive learning for automatic CEFR level assessment, achieving state-of-the-art results across sentence- and document-level monolingual and multilingual benchmarks.
The paper evaluates multiple LLM-based strategies for knowledge entity relation extraction from academic abstracts and full texts, finding that a LoRA-adapted T5 model achieves the best macro F1 scores while hybrid SLM/LLM strategies further improve performance.
A research paper formulating long-context diffusion costs as dual budgets—attention graph edges and activated experts—presenting the DualBudget sparse-expert configuration with graph/compute bounds and evaluations showing gains through 16K context and a 20% cost reduction over DiffuSeq.
The paper introduces KEEPER, a comparative study of four auxiliary objectives for building control-sufficient textual memory in long-horizon LLM agents, finding that reward-related prediction yields the best task performance and introducing self-consistency bias as a measure of error persistence in recursive memory updates.
This paper introduces bidirectional KV-cache patching as a method to trace how fine-tuned behaviors are instantiated in language models, showing that behaviors like responding in German or emergent misalignment can be transferred between a LoRA fine-tuned model and its base model via KV cache reuse, with effects concentrating on pivotal tokens such as system-prompt and chat-template positions.
The paper introduces BlindToChange, a benchmark measuring whether AI search agents proactively discover recent real-world changes that affect their responses, finding accuracy gaps of up to 27.5 points when changes aren't explicitly mentioned in the request.
The paper compares five LLM-based review paradigms across three input representations and three LLMs on 232 ICLR 2025 submissions, finding that direct rating matches comparative ranking after recalibration with far fewer API calls, abstract-only input beats full-paper summaries, and human scores still predict citations better than any LLM paradigm except Group Rating.
该论文提出 Grounded Generative Speech Recognition (GSR) 新范式，将语音识别重新定义为生成语义有据的文本而非单一转录，并发布 GSR-Bench 基准与多维评估框架，揭示了转录保真度与生成重构能力之间的权衡及常见失败模式。