Tag
This paper introduces Speculative Macro Commit (SMC), a two-tier agent system that reduces latency in tool-using LLM agents by speculatively executing future action chains and committing them when matched, achieving speedups over sequential execution.