Tag
A paper proposing a latency-aware LLM query router that jointly optimizes latency, accuracy, and cost using a lightweight latency estimator, achieving up to 40% improvement in accuracy–cost utility while maintaining comparable latencies.
Proposes AdaSR, a framework enabling reasoning models to process streaming inputs adaptively, and HRPO, a hierarchical reinforcement learning method to optimize thinking allocation for accuracy-efficiency trade-offs.