Ok how to actually learn vLLM?
Read the original at www.reddit.com→Said in title, I find the ecosystem difficult to understand, and RTFMing doesn't help me as it's never clear what is the server vs their client library ? I'm using it for voxtral 3B on one GPU, but it's because I can...
Original headline: "Ok how to actually learn vLLM ?"
Coverage timeline
- Oct 5, 08:18 UTC r/LocalLLaMA lead source Ok how to actually learn vLLM ?