Home GPU bottleneck delays as user scales from 1x3090 to 20 DGX Sparks to run large language models locally; reports first bottleneck in house fuses
Read the original at www.reddit.com→ From the first LLaMA 33B I knew I wanted that magic-like intelligence locally, mine, so nobody could take it away when I needed it. I bought a 3090 for my home PC. Then LLaMA 65B appeared and I was dazzled, it...
Original headline: "From 1x3090 to 20 DGX Sparks: my house fuses were the first bottleneck"
Coverage timeline
- Oct 4, 14:09 UTC r/LocalLLaMA lead source From 1x3090 to 20 DGX Sparks: my house fuses were the first bottleneck