RedHatAI Qwen3.8-27B-INT4 runs faster than FP8 in dual 3090/dual VLLM setup
Read the original at www.reddit.com→This thing https://github.com/noonghunna/club-3090/blob/master/models/qwen3.8-27b/qengine/compose/dual/redhat-int4/mtp.yml https://github.com/bpx03/QEngine https://huggingface.co/RedHatAI/Qwen3.8-27B-INT4#accuracy...
Original headline: "club-3090 / qengine / RedHatAI/Qwen3.8-27B-INT4"
Coverage timeline
- Oct 29, 14:53 UTC r/LocalLLaMA lead source club-3090 / qengine / RedHatAI/Qwen3.8-27B-INT4