Tag
TOPAS is a workflow-aware prefix-state scheduling method for multi-agent LLM serving that optimizes cache usage and request scheduling to reduce job completion time.
The developer of GenOS, an open-source framework for multi-agent LLM orchestration using Rust and Git worktrees, is requesting community feedback with worst edge cases to stress-test and improve the system.