Is your engine lobotomizing your model? Kinda, and I measured it
Read the original at www.reddit.com→So I've been reading a lot about "engines lobotomizing the models they run", either because they quantize already quantized weights even further, or because they automatically turn on lossy flags to gain...
Coverage timeline
- Oct 31, 14:14 UTC r/LocalLLaMA lead source Is your engine lobotomizing your model? Kinda, and I measured it