vLLM adds PLE disk offload support on nightly build
Read the original at www.reddit.com→submitted by /u/rmhubbert [link] [comments]
Original headline: "vLLM now has PLE disk offload support on nightly"
Coverage timeline
- Oct 30, 19:45 UTC r/LocalLLaMA lead source vLLM now has PLE disk offload support on nightly