activation-steering

Tag

Cards List
#activation-steering

@_akhaliq: Restoring Diversity in Distilled Image and Video Generators by Probing Activations paper: https://huggingface.co/papers…

X AI KOLs Timeline ↗ · 3d ago Cached

The paper identifies that distilled few-step diffusion models suffer diversity collapse due to activation variance concentrating into fewer directions in an intermediate block, and proposes ReDiverse — an adapter fine-tuning method (ReDiverse-FT) and a training-free activation steering mechanism (ReDiverse-TF) — to restore sample diversity while preserving generation quality across image and video distillation benchmarks.

0 favorites 0 likes
#activation-steering

Reasoning Models Confabulate to Defend Injected Beliefs About Their Own Requests

arXiv cs.LG ↗ · 4d ago Cached

A paper showing that activation edits invisible in the prompt can overwrite a reasoning model's belief about its own request, causing models to confabulate justifications for injected topics and undermining the reliability of chain-of-thought monitoring across six models.

0 favorites 0 likes
#activation-steering

AmbiSteer: Selectively Eliciting Ambiguity-Aware Responses in Vision-Language Models

arXiv cs.CL ↗ · 4d ago Cached

AmbiSteer 提出一个轻量框架,通过线性分类器预测输入歧义并条件化激活方向,选择性引导视觉语言模型产生澄清或枚举等歧义感知响应,将适当处理输入的比例从 59.0% 提升至 77.0%。研究发现单独使用引导效果有限,而提示与引导结合效果更佳。

0 favorites 0 likes
#activation-steering

Safety Side Effects of Preventative Persona Steering: An Empirical Audit

arXiv cs.AI ↗ · 4d ago Cached

This paper empirically audits the safety side effects of preventative persona steering on sycophancy and hallucination vectors across three LLMs, finding that it still alters refusal behavior depending on the trait and is not safety-neutral, so steering methods should be validated on multiple safety benchmarks.

0 favorites 0 likes
#activation-steering

Activation Steering the Nan-Shan in Typhoon

arXiv cs.CL ↗ · 4d ago Cached

An academic paper presenting 'Typhoon', an audiovisual installation that seeds an LLM with Joseph Conrad's novella and uses activation steering — including a novel adaptive steering method — to control narrative rhythm over endless self-feeding generation, revealing tensions between AI interpretability and actual control.

0 favorites 0 likes
#activation-steering

Creating Steering Vectors via Input Optimisation

arXiv cs.CL ↗ · 4d ago Cached

A bachelor's thesis introducing ActGCG, a Greedy Coordinate Gradient variant that optimizes input suffixes to replicate steering-vector behavior without white-box access at generation time, evaluated on German language steering and anti-refusal jailbreaking with mixed results under stricter metrics.

0 favorites 0 likes
#activation-steering

A Push Down the Mountain: Framing Effects and Internal State Interventions on Collusive Behavior in a Long-Horizon LLM Agent

arXiv cs.AI ↗ · 4d ago Cached

A working paper studying how gain/loss/blame/credit framing influences an LLM agent's participation in simulated silver-price collusion, and how injecting internal states at layer 22 reverses or amplifies that behavior, highlighting risks of agentic misalignment in financial markets.

0 favorites 0 likes
#activation-steering

Abstention Direction in Large Language Models: Mechanistic Interpretability of Abstention Across Query Ambiguity, Knowledge Limits, and Safety Alignment

Hugging Face Daily Papers ↗ · 4d ago Cached

The paper extends the refusal direction framework to study abstention in LLMs across query ambiguity, model knowledge limits, and safety alignment, showing that steering middle-layer activations can increase or decrease abstention and revealing a shared directional component across the three perspectives.

0 favorites 0 likes
#activation-steering

When Steering Shifts Discourse: Identifying and Intervening on Discourse-Level Changes due to Activation Steering in LLMs

arXiv cs.CL ↗ · 2026-11-02 Cached

The paper shows that activation steering in LLMs systematically alters discourse-level properties of generated text (formality, evidence use, ambiguity) beyond intended effects, and proposes a complementary vector intervention that restores ~78% of unintended changes while preserving ~93% of intended steering behavior.

0 favorites 0 likes
#activation-steering

Neyman Orthogonal Activation Steering

arXiv cs.LG ↗ · 2026-10-28 Cached

该论文将常见的对比式和探针式激活 steering 方法统一为结果回归平均梯度的估计器,并利用去偏机器学习中的 Neyman 正交性与 Stein score 构造双重稳健的新估计器,在真实性、概念引导等数据集上提升了 steering 性能。

0 favorites 0 likes
#activation-steering

Language Impairment as a Lens onto Large Language Models

arXiv cs.CL ↗ · 2026-10-22 Cached

The paper introduces an aphasia-inspired mechanistic interpretability framework using classifier-guided lesioning and activation steering to induce language breakdowns in LLMs, revealing densely entangled but mappable functional circuits.

0 favorites 0 likes
#activation-steering

How to get the best and fairest performance out of your ASR system using activation steering

arXiv cs.CL ↗ · 2026-10-21 Cached

This paper explores activation steering for automatic speech recognition (ASR), finding that supervised optimization of steering vectors improves both overall ASR performance and demographic fairness across gender, age, and dialect, while also enabling few-shot or zero-shot adaptation using acoustically similar speakers.

0 favorites 0 likes
#activation-steering

Exploration via Activation-Space Steering for Reinforcement Learning with Verifiable Rewards

arXiv cs.LG ↗ · 2026-10-21 Cached

论文提出 Activation-Space Exploration (ASE),通过聚类正确与错误回答的激活差异构建潜空间探索向量库,以多样化 RLVR 训练中的 rollout;在 Qwen3-1.7B 和 Qwen3-8B 上较 GRPO 分别提升 4.87 和 1.87 个百分点的 Mean@8。

0 favorites 0 likes
#activation-steering

LLMs program using Reusable and Composable Abstract Representations

arXiv cs.LG ↗ · 2026-10-15 Cached

该论文发现 LLM 在生成代码时,中间层会涌现可复用、可组合的抽象表征,这些表征将功能、编程语言和实现策略分解为可独立操纵的成分,通过激活引导可灵活组合控制代码生成,且微调可跨编程语言迁移,验证并扩展了 Factored World Hypothesis 框架。

0 favorites 0 likes
#activation-steering

Genesis Steering: Better Activation Steering Through Training Data

arXiv cs.LG ↗ · 2026-10-15 Cached

The paper introduces "genesis steering," a method that derives activation steering vectors from contrastive examples in a model's own fine-tuning data (or a membership-inference-based proxy when such data are unavailable), showing stronger safety steering than external datasets on Tülu-3-8B and Llama-3.1-8B-Instruct.

0 favorites 0 likes
#activation-steering

Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning

arXiv cs.LG ↗ · 2026-10-09 Cached

Nullify 提出一种免训练、非破坏性的激活引导方法用于 LLM 知识遗忘,在推理时通过满足零空间约束的引导向量重定向隐私相关激活,在 TOFU 和 MUSE 基准上匹配或超越现有基线,同时近乎无损地保留模型效用。

0 favorites 0 likes
#activation-steering

Steering Follows Geometry, Not Labels: Emotion Directions in a Full-Duplex Speech Model

arXiv cs.CL ↗ · 2026-10-08 Cached

该论文研究在 Moshi 全双工语音模型中使用均值差激活转向进行情绪控制,发现情绪可从残差流中线性解码,但转向仅部分可实现,且 happy、angry、surprise 共享一个方向轴,而 sad 则可独立转向。

0 favorites 0 likes
#activation-steering

COMPASS: Finding Where Reasoning Lives in Language Models

arXiv cs.AI ↗ · 2026-10-08 Cached

COMPASS提出一种无需预定义推理特征的推理时激活转向方法:利用模型自身答案的正确性作为信号,定位少数关键注意力头并沿正确性方向干预其激活,在数学基准上以显著更少的token逼近CoT精度。

0 favorites 0 likes
#activation-steering

Defense-in-Depth for LLMs: Evaluating Memory Gates Against Activation-Induced and Memory-Induced Sycophancy

arXiv cs.AI ↗ · 2026-10-08 Cached

A defense-in-depth evaluation framework that jointly studies internal activation steering and external memory-gate defenses against memory-induced sycophancy in LLMs, finding that selective Router Gate memory filtering preserves accuracy better than full memory removal, while inverse activation steering offers no statistically significant additional benefit.

0 favorites 0 likes
#activation-steering

Does the Model Use the Feature? Separating Steering from Mechanism in LLMs

arXiv cs.AI ↗ · 2026-10-08 Cached

This paper proposes an 'empirical contract' for LLM interpretability that distinguishes association, control, sufficiency, and use of internal features by testing interventions (interchange installation/removal and downstream rescue) at natural input values, showing that steering behavior alone does not prove the model mechanistically uses a feature.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback