Dual GPUs vLLM resources for 50 + 40 Nvidia GPUs
Read the original at www.reddit.com→i wanted to see how far i can push my PC and on the way i discoverd the resources are limited so i made my own and i hope it helps . https://github.com/ExTV/dual-gpus-vllm submitted by /u/Fz1zz [link] ...
Original headline: "Dual GPUs vLLM resources for 50 + 40 nvidia GPUs"
Coverage timeline
- Oct 1, 10:25 UTC r/LocalLLaMA lead source Dual GPUs vLLM resources for 50 + 40 nvidia GPUs