DeepSeek-V4.1-Flash-1017 runs at 41 tokens per second on a single RTX 3090 with 192 GB RAM, natively on Windows and achieves 90.2% next-token agreement on general text and 92.4% on code/math
Read the original at www.reddit.com→No, this is not a lobotomized 1-bit squeeze, its full Q2 nazeshinjite's DeepSeek-V4.1-Flash-1017 Q2 GGUF on a single 3090, natively on Windows no WSL. On an RTX 3090 with 192 GB of RAM I'm writing at 41 tok/s...
Original headline: "DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090"
Coverage timeline
- Oct 28, 00:39 UTC r/LocalLLaMA lead source DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090