NInfer adds day0 support for Qwen3.8 27b with ~200 tokens per second generation on a single RTX 5090 and improvements including concurrent requests and shared paged KV cache.
Read the original at old.reddit.com→Qwen3.8-27B is finally here, and NInfer already has Day-0 support! Weights: https://huggingface.co/neroued/Qwen3.8-27B-NInfer Just update to the latest source and give it a try. On a single RTX 5090, NInfer can still...
Original headline: "NInfer day0 support for Qwen3.8 27b: ~200 tok/s generation, with tons of engine improvments"
Coverage timeline
- Aug 14, 17:07 UTC r/LocalLLaMA lead source NInfer day0 support for Qwen3.8 27b: ~200 tok/s generation, with tons of engine improvments