Cooling significantly boosts performance: increasing fan speed from 6-8 to 17-20 gt/s yields higher throughput.
Read the original at www.reddit.com→I historically get about 6-8 t/s on my MI50 on Qwen @ Q6 running local coding. Building a script that sets my fans all on 100% duty cycle (and much louder) bumps that immediately to like 12 t/s. Letting the machine...
Original headline: "Don't underestimate cooling - run those fans 6-8 gt/s -> 17-20 gt/s no other changes"
Coverage timeline
- Nov 6, 17:42 UTC r/LocalLLaMA lead source Don't underestimate cooling - run those fans 6-8 gt/s -> 17-20 gt/s no other changes