Basalt: Flash-Next achieves 665 tok/s structured and 354 prose on a 5090 + 5060 Ti with 2.6x Strata performance
Read the original at www.reddit.com→Basalt: Blackwell inference engine Hi all! So over the last week I've been working on a Strata fork that's heavily tuned and can achieve throughput up to 2.6x what Strata usually does on the same weights. It's...
Original headline: "Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)"
Coverage timeline
- Oct 10, 00:58 UTC r/LocalLLaMA lead source Basalt: Flash-Next at 665 tok/s structured, 354 prose on a 5090 + 5060 Ti (2.6x Strata)