Infinite loop in thinking phase observed in quantized models; user asks if non-quantized local models exhibit it and why closed models don’t.
Read the original at www.reddit.com→Several of the models I've used so far (especially the quantized ones) get stuck in a loop during the thinking phase, repeating the same thing indefinitely. Does this happen with non quantized, local models too? And...
Original headline: "Infinite Loop"
Coverage timeline
- Oct 28, 09:59 UTC r/LocalLLaMA lead source Infinite Loop