Using an Nvidia RTX 5090 with 64 GB RAM and an older AMD GPU with 12 GB VRAM to run a local Llama.cpp model; a trade business asks if both GPUs can be utilized for two different AI models.
Read the original at old.reddit.com→We run a local model instance in our company that the dev we hired built for us. We're a trade business and we want to further use our on hand hardware for it. The specs given we have is a 5090 gpu with 64gb of ram...
Original headline: "Utilize a nvidia gpu and amd gpu together for 2 different ai models?"
Coverage timeline
- Aug 5, 18:43 UTC r/LocalLLaMA lead source Utilize a nvidia gpu and amd gpu together for 2 different ai models?