Using two GPUs with Hermes: options for leveraging both GPUs on separate machines or across a single motherboard
Read the original at old.reddit.com→I have a 5090 in my main PC and a 3090 in my last PC. I was planning on selling the older PC but now thinking it would be interesting to see what both GPUs could do with models. My understanding is the best way to...
Original headline: "How to use multiple GPUs"
Coverage timeline
- Jul 31, 11:50 UTC r/LocalLLaMA lead source How to use multiple GPUs