Local and distributed large LLM inference with MLX and RDMA on Mac Studio
Read the original at www.reddit.com→submitted by /u/onethousandmonkey [link] [comments]
Original headline: "Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio"
Coverage timeline
- Oct 15, 18:42 UTC r/LocalLLaMA lead source Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio