Qwen3.8-27b on RTX 3090 achieves 82 tps per single request and up to 672 tps peak with quantization and KV cache optimizations.

Hi, After a long night of optimizations, I believe I have made the fastest inference engine for Qwen3.6-28B on a 3090. Quick metrics: - 250w power capped - Up to 195k context (ships with 150k for safety though) - 82...