Geezuz kernel: Qwen3.8-27B runs at up to 190 tok/s on two RTX 3090s (620 tok/s at 8 requests)
Read the original at www.reddit.com→Geezuz, its fast! Qwen3.8-27B, two RTX 3090s power-limited to 280 W, plain PCIe, no NVLink, at 0 Context: (tests showing results with context are found on the next table) Requests Q4_K_M Q8_0 1 request 190...
Original headline: "Geezuz kernel: Qwen3.8-27B at 190 tok/s (620~ tok/s at 8 requests) on two 3090s"
Coverage timeline
- Oct 20, 13:46 UTC r/LocalLLaMA lead source Geezuz kernel: Qwen3.8-27B at 190 tok/s (620~ tok/s at 8 requests) on two 3090s