instruction-tuning

Tag

Cards List
#instruction-tuning

[NEW RELEASE] - Supra2.5-65M Base and Instruct - our next generation state-of-the art small model family - first model!

Reddit r/LocalLLaMA ↗ · 5d ago

SupraLabs announces Supra2.5-65M, a new state-of-the-art small model family with base and instruction-tuned 65M-parameter versions trained locally in 4 days on 100B tokens, available on Hugging Face with GGUF quantizations for llama.cpp, Ollama, and Unsloth.

0 favorites 0 likes
#instruction-tuning

3, 7, 14, 17, 42: Instruction Tuning Installs and Sharpens Number-Choice Heuristics in Language Models

arXiv cs.CL ↗ · 2026-10-28 Cached

该论文精确计算了语言模型在被要求随机选数时对每个整数的完整概率分布,发现指令调谐使分布更不均匀:安装了避免轮数的启发式并强化了避免端点值的倾向,但未产生跨模型共享的偏好整数。

0 favorites 0 likes
#instruction-tuning

MMedAgent-Plus: Scaling Multimodal Medical Agents across Modalities, Tasks and Workflows

arXiv cs.CL ↗ · 2026-10-21 Cached

MMedAgent-Plus is a multimodal medical tool-use agent that pairs a vision-language planner with 18 specialist models across 12 medical tasks and 8 modalities, orchestrating multi-step clinical workflows. It achieves 90.6% correct specialist invocation and 0.98 final-answer accuracy, far exceeding the strongest baseline (0.28).

0 favorites 0 likes
#instruction-tuning

Wolof-Adapted Industry-Ready Open-Weight Language Models

arXiv cs.CL ↗ · 2026-10-16 Cached

Orange Research presents 0.6B–14B open-weight Qwen models adapted to Wolof, a language spoken by 23 million people, using instruction tuning, preference alignment, and model merging. The models are competitive with much larger commercial systems on Wolof tasks and are being piloted in customer-care deployments, with data and weights publicly released.

0 favorites 0 likes
#instruction-tuning

Resisting Harmful Instructions through Training-Free Weight Editing

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

该论文提出一种训练无关的权重编辑方法,通过少量对比提示对直接修改模型权重,降低指令微调模型对有害指令(如说谎、性别歧视)的服从率,并在五个模型上验证了其优于激活引导等方法的鲁棒性。

0 favorites 0 likes
#instruction-tuning

Self-Preservation in Language Models

arXiv cs.CL ↗ · 2026-10-12 Cached

A New York University, Google Research, and Cornell paper studies whether language models can support their own self-preservation during continual learning by generating replay data and selecting which prior tasks to replay, showing that task-bank-informed self-replay reduces forgetting on held-out tasks in Qwen models.

0 favorites 0 likes
#instruction-tuning

Self-Preservation in Language Models

Hugging Face Daily Papers ↗ · 2026-10-08 Cached

该论文研究语言模型的自我保存能力,通过构建任务库(Task Banks)引导冻结模型生成回放数据,在Qwen系列模型上实验表明生成式回放能减少持续学习中的遗忘,且模型在部分场景下可自主选择回放目标以保护自身能力。

0 favorites 0 likes
#instruction-tuning

Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method

arXiv cs.CL ↗ · 2026-10-05 Cached

MITE reformulates biomedical NER as a structure-to-structure generation task by representing instructions and entity outputs in multiple programming-language formats (Python, C++, Java), using entity-level voting at inference to improve robustness. Experiments on six BioNER datasets show it outperforms BERT- and LLM-based baselines with strong cross-dataset generalization.

0 favorites 0 likes
#instruction-tuning

I trained a 3.87B MoE (1.45B active) from scratch on only 86.5B tokens

Reddit r/LocalLLaMA ↗ · 2026-10-04 Cached

YOON1v released Apex-2, a from-scratch decoder-only Mixture-of-Experts LLM with 3.87B total / 1.45B active parameters, pretrained on 86.5B tokens and SFT-tuned, with full code, architecture writeup, and benchmark results (HumanEval 43.9) released on Hugging Face and GitHub.

0 favorites 0 likes
#instruction-tuning

On-Policy Self-Distillation for Multi-Turn Image Editing

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

This paper proposes MT-OPSD, a non-policy self-distillation framework to address degradation in multi-turn image editing and introduces LME-Bench for evaluating long-horizon robustness.

0 favorites 0 likes
#instruction-tuning

Rewired or Gated? How Instruction Tuning Shapes Knowledge-Conflict Circuits in LLMs

arXiv cs.LG ↗ · 2026-09-23 Cached

This paper provides a mechanistic comparison of knowledge-conflict circuits in LLMs under instruction tuning, finding that tuning gates rather than rewires these circuits across multiple model families, with implications for interpretability.

0 favorites 0 likes
#instruction-tuning

"As a Language Model...": Chat Template Switches LLM Self-Referential Voice and Activation Steering Reproduces It

arXiv cs.LG ↗ · 2026-09-23 Cached

The study reveals that chat templates control whether language models adopt a disclaimer voice (e.g., 'I'm just an AI') or an experiential voice (e.g., 'I feel'), and identifies an activation direction that can steer this behavior, impacting AI safety research.

0 favorites 0 likes
#instruction-tuning

ImIR: Image-Instruction Tuning for All-in-One Image Restoration

Hugging Face Daily Papers ↗ · 2026-09-21 Cached

ImIR adapts a pretrained image-editing model for six image restoration tasks using image-derived instructions, enabling efficient and task-agnostic restoration.

0 favorites 0 likes
#instruction-tuning

@AtriaASI: We’re grateful to OpenBMB for supporting Atria Dawn Preview with UltraData-SFT-Agent-2609. The dataset’s high-quality a…

X AI KOLs Timeline ↗ · 2026-09-16 Cached

OpenBMB releases UltraData-SFT-Agent-2609, a dataset of 500,000 samples for agent instruction-tuning, used in the post-training of the MiniCPM5-2B model.

0 favorites 0 likes
#instruction-tuning

SalamandraTA at WMT 2026 Terminology Shared Task: Hard Examples Are Better Teachers

arXiv cs.CL ↗ · 2026-09-10 Cached

The paper presents a data selection method for terminology-aware translation that trains only on hard examples where the model's output contradicts the glossary, achieving improved term accuracy, and describes the BSC system submission to the WMT26 Terminology Shared Task.

0 favorites 0 likes
#instruction-tuning

LLMs Learn Better In-Context from Rules than from Examples

arXiv cs.CL ↗ · 2026-09-04 Cached

This paper compares rule-based and example-based in-context learning in LLMs, finding that rules generally lead to more reliable learning across diverse tasks, with implications for model and task properties.

0 favorites 0 likes
#instruction-tuning

EmoStance: Response-Side Affective-Orientation Control for Empathetic Response Generation via Emoji Weak Supervision

arXiv cs.AI ↗ · 2026-09-03 Cached

EmoStance is a method for empathetic response generation that uses emoji weak supervision to model response-side affective orientation, improving contextual specificity and perceived responsiveness in dialogues.

0 favorites 0 likes
#instruction-tuning

How Output Format Confounds Data Quality and Capability in Instruction Tuning

arXiv cs.CL ↗ · 2026-09-03 Cached

This paper demonstrates that output formats confound data quality metrics and model capability assessments in instruction tuning, causing significant accuracy shifts and rendering current practices ineffective without interface-aware adjustments.

0 favorites 0 likes
#instruction-tuning

Incremental Risk Assessment of Progressive Elder Financial Scams via Instruction-Tuned Small Language Models

arXiv cs.AI ↗ · 2026-09-02 Cached

The paper proposes a cumulative turn-based risk assessment framework using fine-tuned small language models to incrementally detect financial scams in multi-turn conversations targeting older adults.

0 favorites 0 likes
#instruction-tuning

From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation

arXiv cs.CL ↗ · 2026-08-27 Cached

This paper investigates instruction-tuning general-purpose LLMs for robust harmful content mitigation, specifically hate speech detection, using a unified corpus of 36 datasets, achieving state-of-the-art performance and enhanced cross-domain and cross-lingual generalization.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback