Kimi-K3.1-Pro-Coder (2.8T) achieves 775 GB quant at 56% reduction and 36.8 TPS (Batch) / 10.8 TPS on 1x Blackwell; 96.7% on AIME 2025 and LiveCodeBench
Read the original at www.reddit.com→Up front: I know a 775 GB quant is not for everyone, and this is definitely a more experimental setup and quant than I usually do, but I think it was a great stress-test of what's possible and I believe there is more...
Original headline: "Kimi-K3.1-Pro-Coder (2.8T) | 1.77 TB -> 775 GB (-56%) | 36.8 TPS (Batch) / 10.8 TPS on 1x Blackwell | 96.7% on both AIME 2025 and LiveCodeBench"
Coverage timeline
- Nov 8, 19:45 UTC r/LocalLLaMA lead source Kimi-K3.1-Pro-Coder (2.8T) | 1.77 TB -> 775 GB (-56%) | 36.8 TPS (Batch) / 10.8 TPS on 1x Blackwell | 96.7% on both AIME 2025 and LiveCodeBench