DSv4F prompts should not include system messages mid-conversation to avoid corrupting the prompt cache
Read the original at old.reddit.com→DSv4F doesn't ship a jinja, but for distributions that do and faithfully reconstruct what DS releases in their chat template python, every system message is hoisted into the system prompt at the top -- the format has...
Original headline: "PSA for DeepSeek-V4-Flash-0731 users — don't blow out your prompt cache with system role messages mid-conversation"
Coverage timeline
- Aug 2, 07:24 UTC r/LocalLLaMA lead source PSA for DeepSeek-V4-Flash-0731 users — don't blow out your prompt cache with system role messages mid-conversation