Open-source Windows tray app GamePause automatically unloads local LLMs to free VRAM when a game launches and restores them afterward
Read the original at www.reddit.com→I run local LLMs pretty much around the clock, but I also enjoy gaming on the same PC. Having models sitting in VRAM while gaming isn't exactly ideal, and constantly unloading and reloading them manually got...
Original headline: "I built a lightweight tool that automatically frees up VRAM for gaming and restores your local LLMs afterward"
Coverage timeline
- Oct 11, 18:07 UTC r/LocalLLaMA lead source I built a lightweight tool that automatically frees up VRAM for gaming and restores your local LLMs afterward