inference-depth

Tag

Cards List
#inference-depth

One Size Does Not Fit All: Setting Inference Depth from the Questions a Deployment Actually Asks

arXiv cs.CL ↗ · 2026-09-15 Cached

This paper proposes a method to dynamically set inference depth in AI models based on the actual questions encountered during deployment to enhance computational efficiency.

0 favorites 0 likes
#inference-depth

RecurTrace: Adaptive Latent Reasoning with Loop-Time Memory

arXiv cs.LG ↗ · 2026-09-04 Cached

RecurTrace introduces loop-time memory and adaptive halting to improve latent reasoning in language models, achieving higher accuracy on MathQA with optimized compute compared to fixed-loop methods.

0 favorites 0 likes
← Back to home

Submit Feedback