Strata with multi-GPU explanation
Read the original at www.reddit.com→I am mostly familiar with llama.cpp but have been using QFN - UD-Q4_K_XL with Strata and need some help understanding how it works with multiple gpu's. I initially started with a single gpu and got about 70 t/s. RAM...
Original headline: "Strata with multi gpu explanation"
Coverage timeline
- Oct 19, 12:55 UTC r/LocalLLaMA lead source Strata with multi gpu explanation