Tag
vLLM's nightly build now supports PLE disk offload, helping offload KV-cache or memory pressure to disk for LLM inference serving. The update is available on vLLM's nightly channel.