predictive-prefetching

TF-Engram introduces a train-free system that stores phrase-level semantic memory on a GPU-DRAM-SSD hierarchy for LLMs, using predictive prefetching to hide latency, and demonstrates improved downstream performance on Qwen3-0.6B.