Qwen3.8 27B 16GB setup achieves 110k context, ~55 t/s on 5070 Ti with custom 16GB GGUF-4.2BPW weights; context window issues above ~60k noted
Read the original at www.reddit.com→I wanted to share my setup thats working really well for my fellow 16GB desktop suffrage crew. I am able to get 110k context with ~1.5GB to spare and around 55 t/s on my 5070 TI. First off I found this model...
Original headline: "Made a really good Qwen3.8 27B 16GB setup, no strata/streaming-kv"
Coverage timeline
- Oct 30, 22:29 UTC r/LocalLLaMA lead source Made a really good Qwen3.8 27B 16GB setup, no strata/streaming-kv