RedHatAI Qwen3.8-27B-INT4 runs faster than FP8 in dual 3090/dual VLLM setup
Read original on r/LocalLLaMA ↗This thing https://github.com/noonghunna/club-3090/blob/master/models/qwen3.8-27b/qengine/compose/dual/redhat-int4/mtp.yml https://github.com/bpx03/QEngine https://huggingface.co/RedHatAI/Qwen3.8-27B-INT4#accuracy...
Original headline: "club-3090 / qengine / RedHatAI/Qwen3.8-27B-INT4"
Timeline
- October 29, 2026 club-3090 / qengine / RedHatAI/Qwen3.8-27B-INT4 r/LocalLLaMA
- October 31, 2026 Qwen3.8-Flash-Next on 2x RTX 5090 with 504 tok/s decode: QEngine 1.3.1 decodes ~1.5-1.9x faster than the next-best engine I've tried (numbers, caveats, and what still bites) r/LocalLLaMA