scheduling-method

Tag

Cards List
#scheduling-method

Decoupling Readiness from Release for Tail-Aware Scheduling of Agentic LLM Workflows

arXiv cs.AI · 18h ago Cached

This paper presents a tail-risk-aware scheduling method for agentic LLM workflows that reduces tail latency by optimizing turn release decisions, achieving up to a 3.50x speedup in P95 workflow flow time under contention.

0 favorites 0 likes
← Back to home

Submit Feedback