163.2: 150 tps prefill on Strata for dual and single GPU, according to user report
Read the original at www.reddit.com→Hardware----------------- 4070 12gb - gen 4.0 x16 v100 16gb - gen 3.0 x4 32gb 3200mhz ram it5-12400f ssd read - 3.6gb ssd write - 2.7gb -------------------------------- quant- rco iq3_xxs...
Original headline: "150tps prefill on dual and single gpu on Strata.."
Coverage timeline
- Oct 17, 05:36 UTC r/LocalLLaMA lead source 150tps prefill on dual and single gpu on Strata..