Tag
SupraLabs announces Supra2.5-65M, a new state-of-the-art small model family with base and instruction-tuned 65M-parameter versions trained locally in 4 days on 100B tokens, available on Hugging Face with GGUF quantizations for llama.cpp, Ollama, and Unsloth.
该论文精确计算了语言模型在被要求随机选数时对每个整数的完整概率分布,发现指令调谐使分布更不均匀:安装了避免轮数的启发式并强化了避免端点值的倾向,但未产生跨模型共享的偏好整数。
MMedAgent-Plus is a multimodal medical tool-use agent that pairs a vision-language planner with 18 specialist models across 12 medical tasks and 8 modalities, orchestrating multi-step clinical workflows. It achieves 90.6% correct specialist invocation and 0.98 final-answer accuracy, far exceeding the strongest baseline (0.28).
Orange Research presents 0.6B–14B open-weight Qwen models adapted to Wolof, a language spoken by 23 million people, using instruction tuning, preference alignment, and model merging. The models are competitive with much larger commercial systems on Wolof tasks and are being piloted in customer-care deployments, with data and weights publicly released.
该论文提出一种训练无关的权重编辑方法,通过少量对比提示对直接修改模型权重,降低指令微调模型对有害指令(如说谎、性别歧视)的服从率,并在五个模型上验证了其优于激活引导等方法的鲁棒性。
A New York University, Google Research, and Cornell paper studies whether language models can support their own self-preservation during continual learning by generating replay data and selecting which prior tasks to replay, showing that task-bank-informed self-replay reduces forgetting on held-out tasks in Qwen models.
该论文研究语言模型的自我保存能力,通过构建任务库(Task Banks)引导冻结模型生成回放数据,在Qwen系列模型上实验表明生成式回放能减少持续学习中的遗忘,且模型在部分场景下可自主选择回放目标以保护自身能力。
MITE reformulates biomedical NER as a structure-to-structure generation task by representing instructions and entity outputs in multiple programming-language formats (Python, C++, Java), using entity-level voting at inference to improve robustness. Experiments on six BioNER datasets show it outperforms BERT- and LLM-based baselines with strong cross-dataset generalization.
YOON1v released Apex-2, a from-scratch decoder-only Mixture-of-Experts LLM with 3.87B total / 1.45B active parameters, pretrained on 86.5B tokens and SFT-tuned, with full code, architecture writeup, and benchmark results (HumanEval 43.9) released on Hugging Face and GitHub.
This paper proposes MT-OPSD, a non-policy self-distillation framework to address degradation in multi-turn image editing and introduces LME-Bench for evaluating long-horizon robustness.
This paper provides a mechanistic comparison of knowledge-conflict circuits in LLMs under instruction tuning, finding that tuning gates rather than rewires these circuits across multiple model families, with implications for interpretability.
The study reveals that chat templates control whether language models adopt a disclaimer voice (e.g., 'I'm just an AI') or an experiential voice (e.g., 'I feel'), and identifies an activation direction that can steer this behavior, impacting AI safety research.
ImIR adapts a pretrained image-editing model for six image restoration tasks using image-derived instructions, enabling efficient and task-agnostic restoration.
OpenBMB releases UltraData-SFT-Agent-2609, a dataset of 500,000 samples for agent instruction-tuning, used in the post-training of the MiniCPM5-2B model.
The paper presents a data selection method for terminology-aware translation that trains only on hard examples where the model's output contradicts the glossary, achieving improved term accuracy, and describes the BSC system submission to the WMT26 Terminology Shared Task.
This paper compares rule-based and example-based in-context learning in LLMs, finding that rules generally lead to more reliable learning across diverse tasks, with implications for model and task properties.
EmoStance is a method for empathetic response generation that uses emoji weak supervision to model response-side affective orientation, improving contextual specificity and perceived responsiveness in dialogues.
This paper demonstrates that output formats confound data quality metrics and model capability assessments in instruction tuning, causing significant accuracy shifts and rendering current practices ineffective without interface-aware adjustments.
The paper proposes a cumulative turn-based risk assessment framework using fine-tuned small language models to incrementally detect financial scams in multi-turn conversations targeting older adults.
This paper investigates instruction-tuning general-purpose LLMs for robust harmful content mitigation, specifically hate speech detection, using a unified corpus of 36 datasets, achieving state-of-the-art performance and enhanced cross-domain and cross-lingual generalization.