Two PCs with different specs considered for pooled resources to run large MoEs; user contemplates whether to pool via direct Ethernet and use llama.cpp RPC or distribute GPUs across machines
Read the original at www.reddit.com→PC1: -94gb DDR5 -5070 TI + 3060 (12gb) gpus (using a motherboard that is specifically designed for duel gpus PC2: 64gb DD4 RAM PC1 is new, I've been running strata for running larger MoEs but I'm curious about trying...
Original headline: "Two PCs but one with only RAM? or divide GPUs across pcs?"
Coverage timeline
- Nov 8, 02:04 UTC r/LocalLLaMA lead source Two PCs but one with only RAM? or divide GPUs across pcs?