EXL3 quant of Qwen3.8-27B achieves the lowest KLD (0.0002) using 23 GB RAM for weights.
Read the original at www.reddit.com→Noticed this new EXL3 quant of 3.8-27B which achieves lowest KLD than anyone else and does it using only 18.8 GiB VRAM for weights. Pretty impressive numbers! https://huggingface.co/yeasah/Qwen3.8-27B-exl3 maker...
Original headline: "yeasah/Qwen3.8-27B-exl3 quants - lowest KLD of 0.0002"
Coverage timeline
- Oct 29, 03:33 UTC r/LocalLLaMA lead source yeasah/Qwen3.8-27B-exl3 quants - lowest KLD of 0.0002