Strata update doubles R9700 performance for Flash Next, boosting tok/s from ~70 to 140–160 and increasing prefill to ~3200
Read the original at www.reddit.com→Today's update is welcome for us R9700 users (assume other gpu's as well). Prior to the update I was getting ~70 tok/s output with four R9700's and 256GB of system ram. Today's update brings it to 140-160 tok/s and...
Original headline: "Today's Strata update boosts performance for R9700 users in Flash Next"
Coverage timeline
- Nov 3, 03:54 UTC r/LocalLLaMA lead source Today's Strata update boosts performance for R9700 users in Flash Next