co-speculation

AOSpec is a lossless framework that co-speculates actions and observations across the LLM agent-environment loop to reduce latency, achieving notable end-to-end latency reductions across various serving settings.