Introdx: TextCLF Quant Factory offers calibration-free quantization with 4-bit support and open-sourced code
Read the original at www.reddit.com→Hello, I created a calibration free quant method called TQ. It doesn't need any data so models could be quantized as soon as they come out and the quantized models would generalize better. It performs closely to...
Original headline: "Introducting TextCLF Quant Factory"
Coverage timeline
- Sep 28, 01:37 UTC r/LocalLLaMA lead source Introducting TextCLF Quant Factory