24GB is enough for engines that take turns, says system service that manages VRAM allocation and swaps, avoiding collisions and orphaned processes
Read the original at www.reddit.com→System service that watches your card, swaps and loads whatever you want, whenever you want. Don’t have to swap anything manually, collisions avoided, VRAM fully dedicated to each function while it’s running (no...
Original headline: "24GB is plenty if your engines take turns"
Coverage timeline
- Oct 20, 03:27 UTC r/LocalLLaMA lead source 24GB is plenty if your engines take turns