Qwen3.8 27b: comparing int4-awq to int8 in loop testing with vLLM and Hermes
Read the original at www.reddit.com→I know this some old news, but i got some numbers here from my heavy agent load. In mid-October I switch from INT8 (4×3090) to AWQ INT4 (2×3090). Same sampling, harness(Hermes), and loop detector, so I compared about...
Original headline: "Qwen3.8 27b loop testing int4 awq vs int8"
Coverage timeline
- Oct 31, 03:19 UTC r/LocalLLaMA lead source Qwen3.8 27b loop testing int4 awq vs int8