inference-time-control

Tag

Cards List
#inference-time-control

A Coin Flip Per Token: Bernoulli Sparse Steering of Large Language Models

arXiv cs.LG · yesterday Cached

Introduces Stochastic Token Steering (STS) and Stochastic Block Steering (SBS) for LLM activation steering, which probabilistically gate steering signals per token or per sequence. Shows that steering only 50% of tokens recovers most of the dense-steering effect while preserving fluency, and that the behavioral outcome is rate-limited by cumulative signal dosage.

0 favorites 0 likes
#inference-time-control

Inference-Time Budget Control for LLM Search Agents

arXiv cs.AI · 2026-05-08 Cached

This paper introduces a two-stage inference-time budget control method for LLM search agents, using Value-of-Information scores to optimize tool-call and token allocation during multi-hop question answering.

0 favorites 0 likes
← Back to home

Submit Feedback