One token at the beginning of a prompt changed 6 of 15 LLM responses; does it matter?
Read the original at www.reddit.com→I'm back with another experiment. After the last heated discussion about KV cache, temperature 0, and reproducibility — where I got quite a beating for both my post and my writing style (partly deserved, to be fair...
Original headline: "# One token at the beginning of a prompt changed 6 out of 15 LLM responses. Does it matter?"
Coverage timeline
- Nov 7, 21:12 UTC r/LocalLLaMA lead source # One token at the beginning of a prompt changed 6 out of 15 LLM responses. Does it matter?