Dual V100s sought for Qwen3.8 27b: user requests hard data on PP and TPS for high quants (q6–q8) with large context windows; aims to quantify speedup over MI60.
Read the original at www.reddit.com→So I'm thinking of switching from my 32gb AMD MI60 to dual V100's (64gb VRAM total) and I've got 96gb of DDR5. My problem is I'm having a terrible time finding "hard data" on PP and TPS speeds on higher quants (q6...
Original headline: "Anyone running dual V100's? Trying to get *specifics* on PP and TPS for higher quant Qwen3.8 27b and having a tough time"
Coverage timeline
- Nov 6, 15:26 UTC r/LocalLLaMA lead source Anyone running dual V100's? Trying to get *specifics* on PP and TPS for higher quant Qwen3.8 27b and having a tough time