Two 5060Ti GPUs moved to an HPE ProLiant DL380 Gen9 to run Qwen Flash next; user asks if setup is viable
Read the original at www.reddit.com→Hey guys, I need some advice. My actual setup is this: ryzen 5600 / 32GB RAM / 128GB SSD / 32GB VRAM (2x16GB 5060ti) Running vLLM with Qwen 27B NVFP4 with 250k context. But now I can get my hands on an old HPE...
Original headline: "27B vs Flash next"
Coverage timeline
- Nov 4, 23:33 UTC r/LocalLLaMA lead source 27B vs Flash next