In-depth comparison of Qwen-3.8 27b @ 8bpw and Qwen-3.8-FN @ 4bpw
Read the original at www.reddit.com→Title says it all, I run dual 3090s (check out my post here for my setup) at int8A16 and have been wondering if I'm missing out with QFN. There's posts ad-nauseam on reddit with low bpw strata solutions that run on...
Original headline: "Has anyone done a in-depth comparison between Qwen-3.8 27b @ 8bpw and Qwen-3.8-FN @ 4bpw?"
Coverage timeline
- Nov 3, 15:02 UTC r/LocalLLaMA lead source Has anyone done a in-depth comparison between Qwen-3.8 27b @ 8bpw and Qwen-3.8-FN @ 4bpw?