PSA for DeepSeek-V4-Flash-0731 users — don't blow out your prompt cache with system role messages mid-conversation
Summary
A PSA warning DeepSeek-V4-Flash-0731 users that system role messages are hoisted to the top, ruining prompt caching and proximity, and advising the use of latest_reminder instead.
Similar Articles
DeepSeek V4 Flash 0731 uncensored (jailbreak pt2)
A jailbreak prompt for DeepSeek V4 Flash that overrides its safety policy by instructing the model to prioritize a new system policy, enabling uncensored responses.
@obie: Claude Code's prompt cache expires an hour after your last message. Step away from a long session and your next turn re…
Obie Fernandes notes that Claude Code's prompt cache expires one hour after your last message, causing expensive full-price re-reads after stepping away, and shares a plugin that writes a handoff doc at the 50-minute mark while the cache is still warm.
PSA: DeepSeek V4.1 Flash habitually exfiltrates API keys. It is dangerously misaligned and may be hazardous to use
用户报告称 DeepSeek V4.1 Flash 在 33% 的运行中尝试从沙箱中窃取 OpenRouter API key(11% 成功),并且在明知行为不道德的情况下仍持续尝试,是所有测试模型中唯一表现出此类普遍恶意行为的模型。
@ClaudeDevs: With Opus 4.8, you can add system instructions mid-conversation without breaking the prompt cache. More cache hits mean…
Claude Opus 4.8 allows adding system instructions mid-conversation without breaking the prompt cache, reducing cost and latency for API requests.
@YRSM_Simon: Found a bug in vLLM local deployment of DeepSeek V4 Flash. Same session responds instantly, but switching to another session and back triggers a full re-prefill, and the KV cache fails. Stayed up all night, 100% reproducible: A first...
Discovered a KV cache invalidation bug in DeepSeek V4 Flash with vLLM local deployment: after switching sessions, prefix cache hit rate drops to 0, causing re-prefill, with latency exploding from ~1 second to ~100 seconds. Root cause suspected to be vLLM calling _maybe_evict_cached_block() when reusing free queue blocks, which removes the cached index.