Upgrade your GPU? run local LLMs on both GPUs by splitting inference workloads across them.
Read the original at www.reddit.com→Friendly reminder: If you upgraded to a newer GPU, don't let your old one collect dust! You can run both GPUs in the same rig and split LLM inference workloads across them using tools like llama.cpp. I'm doing...
Original headline: "Upgraded Your GPU? Don't Sell the Old One. Put Both to Work Running Local LLMs."
Coverage timeline
- Nov 8, 16:33 UTC r/LocalLLaMA lead source Upgraded Your GPU? Don't Sell the Old One. Put Both to Work Running Local LLMs.