inference-time

Tag

Cards List
#inference-time

Scaling of Capability and Efficiency at Inference Time in Large Reasoning Models

arXiv cs.LG ↗ · 3d ago Cached

This paper evaluates the capability and efficiency of large language models using Chain-of-Thought reasoning, finding that capability gains diminish with increasing model size, while efficiency shows little improvement.

0 favorites 0 likes
#inference-time

MIRAGE: Multi-Perspective Creative Language Model Reasoning with Reinforcement Learning Guidance

arXiv cs.CL ↗ · 6d ago Cached

The paper introduces MIRAGE, an inference-time framework for enhancing LLM reasoning by dynamically switching perspectives using reinforcement learning guidance, outperforming existing prompting methods on various benchmarks.

0 favorites 0 likes
#inference-time

Layers, Sinks, and Scaling: Adaptive Evidence Selection for Multimodal Large Language Models

arXiv cs.AI ↗ · 2026-09-16 Cached

This paper presents AREA, a training-free inference-time method that adaptively allocates evidence highlighting in multimodal large language models, improving performance on knowledge-based visual question answering and standard multimodal benchmarks.

0 favorites 0 likes
#inference-time

Test-Time Unlearning via Sparse Autoencoder

arXiv cs.LG ↗ · 2026-09-16 Cached

ARIA is a test-time unlearning method for large language models that uses sparse autoencoders to suppress unwanted knowledge during inference without modifying weights, improving the forget-retain trade-off and remaining robust to adversarial attacks.

0 favorites 0 likes
#inference-time

Inference-Time Graph Engineering for Multi-Agent LLM Workflows

arXiv cs.AI ↗ · 2026-09-10 Cached

The paper introduces ReActNet, a training-free framework that synthesizes task-conditioned temporal workflow graphs for multi-agent LLM systems, enhancing coordination and performance over fixed or learned topology baselines.

0 favorites 0 likes
#inference-time

On-the-go Forgetting without Explicit Unlearning via ERASE

arXiv cs.LG ↗ · 2026-09-10 Cached

ERASE is a framework for functional forgetting in machine learning models without modifying weights, using input perturbations to suppress private data influence during inference for privacy compliance.

0 favorites 0 likes
#inference-time

Privacy Without Regret: Differentially Private Inference-Time Alignment

arXiv cs.LG ↗ · 2026-08-28 Cached

This paper introduces Private Best-of-N (PrivBoN) and Private Inference-Time Pessimism (PrivITP) methods that add calibrated noise to reward scores in inference-time alignment to achieve differential privacy and mitigate reward hashing, with minimal additional alignment cost.

0 favorites 0 likes
#inference-time

Controllable Affective Generation via Latent Vector Steering

arXiv cs.CL ↗ · 2026-08-27 Cached

This paper proposes EmoVec, a lightweight framework for controllable affective generation in large language models via latent vector steering, enabling continuous control over emotional intensity without model weight updates.

0 favorites 0 likes
#inference-time

CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes

Hugging Face Daily Papers ↗ · 2026-08-27 Cached

CritICL is an inference-time framework that enhances large language model reasoning by leveraging structured failure patterns from smaller models as critique-based guidance, outperforming standard in-context learning with reduced generation and token costs.

0 favorites 0 likes
#inference-time

GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models

Hugging Face Daily Papers ↗ · 2026-08-26 Cached

GGSS reduces demographic bias in generative vision-language models by steering visual tokens along geodesic arcs with an adaptive gate during inference, preserving visual-language accuracy.

0 favorites 0 likes
#inference-time

Steering Recurrent Reasoners at Inference Time with Readout Feedback

arXiv cs.LG ↗ · 2026-08-26 Cached

The paper introduces Readout Feedback (RoFB), a test-time intervention that steers latent dynamics in recurrent reasoning models using their own readout probabilities, achieving performance gains on Sudoku and Maze tasks without retraining.

0 favorites 0 likes
#inference-time

A recirculation fix for running context

Reddit r/singularity ↗ · 2026-08-26 Cached

The paper introduces 'recirculation', an inference-time architectural enhancement for foundation models that markedly reduces perplexity and boosts accuracy by improving state tracking, with no additional latency during generation.

0 favorites 0 likes
#inference-time

Inference-Time Mitigation of Adversarial Political Bias in Large Language Models

arXiv cs.CL ↗ · 2026-08-18 Cached

This paper proposes inference-time mitigation strategies using Chain of Thought prompting and Direct Preference Optimization to reduce adversarial political bias in large language models, demonstrating significant improvements in political neutrality scores.

0 favorites 0 likes
#inference-time

Reachability Is Not Realization: Tracing the Sources of LLM Benchmark Gains

arXiv cs.AI ↗ · 2026-08-05 Cached

This paper introduces a question-level audit framework distinguishing 'realized' from 'reachable' answers on LLM benchmarks, showing that aggregate score gains often come from producing already-reachable answers rather than expanding true capability, and that random layer routing matches structured search under matched budgets.

0 favorites 0 likes
#inference-time

Inference-Time Policy Alignment for Fair Reinforcement Learning

arXiv cs.LG ↗ · 2026-08-04 Cached

This paper proposes an inference-time policy shaping framework to steer pretrained reinforcement learning policies toward welfare-based fairness objectives without retraining, inspired by inference-time alignment in LLMs.

0 favorites 0 likes
#inference-time

Steering Instruction Hierarchies at Inference Time

arXiv cs.CL ↗ · 2026-07-30 Cached

Introduces V-Steer, a training-free inference-time method that edits cached value vectors to restore instruction hierarchy in language models, raising primary constraint accuracy from under 18% to 92% on controlled benchmarks with negligible overhead.

0 favorites 0 likes
#inference-time

DiFA: Inference-Time Forward-Process Alignment for Diffusion Models

Hugging Face Daily Papers ↗ · 2026-07-20 Cached

Proposes DiFA, a training-free framework that reframes inference-time data prediction refinement as sequential state estimation using Kalman filtering, significantly improving generative fidelity on CIFAR-10 and ImageNet.

0 favorites 0 likes
#inference-time

Motion4Motion: Motion Transfer Across Subjects at Inference

Hugging Face Daily Papers ↗ · 2026-07-13 Cached

Motion4Motion is a training-free motion transfer framework that models motion flow from a video instead of relying on skeleton structures, enabling motion transfer across diverse species (e.g., humans to animals) at inference time.

0 favorites 0 likes
#inference-time

Safe Inference-Time Alignment via Lagrangian Reward Augmentation

arXiv cs.LG ↗ · 2026-07-07 Cached

Proposes LARA, a framework for safe inference-time alignment that uses Lagrangian dualization to derive an augmented reward from separate reward and cost models, improving the helpfulness-harmlessness tradeoff without retraining.

0 favorites 0 likes
#inference-time

Dismantling Pathological Shortcuts: A Causal Framework for Faithful LVLM Decoding

arXiv cs.AI ↗ · 2026-06-29 Cached

This paper reveals that hallucination in large vision-language models is caused by a dynamic structural misalignment where certain attention heads act as risky mediators, decoupling from visual evidence to lock onto language priors. The authors propose Fox, a training-free causal intervention framework that diagnoses and physically severs these pathological shortcuts, achieving state-of-the-art performance in faithful decoding.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback