VRAM usage spikes to 0.5–1 GB during prompt processing on Vulkan Llama.cpp with 7900 XTX
Read the original at www.reddit.com→https://preview.redd.it/ai9305086o0i1.png?width=194&format=png&auto=webp&s=f4af9545097ef625a961ce960a61af48a0113abe is it possible to fix? submitted by /u/Jebbyk1 [link] [comments]
Original headline: "vram ~0.5-1Gb vram usage spikes during prompt processing on vulkan llama.cpp 7900xtx"
Coverage timeline
- Nov 9, 23:16 UTC r/LocalLLaMA lead source vram ~0.5-1Gb vram usage spikes during prompt processing on vulkan llama.cpp 7900xtx