Tag
Speculative cache warming pre-processes the system prompt and tools array while the user types their prompt, saving 10-20 seconds of wait time on local LLM inference. This feature is part of the open-source OpenFox harness for local AI, improving interactivity without breaking cache consistency.