Infermeld Linux kit runs a single GGUF across an AMD GPU and an NVIDIA GPU using llama.cpp
Read the original at www.reddit.com→Following on from club-5060ti and club-rdna16, I’ve put together Infermeld: a small, open-source Linux companion kit for running one GGUF across an AMD GPU and an NVIDIA GPU, powered by llama.cpp. I’m the maintainer....
Original headline: "Infermeld: a Linux kit for running one GGUF across AMD + NVIDIA GPUs with llama.cpp"
Coverage timeline
- Oct 5, 03:55 UTC r/LocalLLaMA lead source Infermeld: a Linux kit for running one GGUF across AMD + NVIDIA GPUs with llama.cpp