What is an ideal LLM setup for work on an M5Max with 64GB RAM, given a shift from smaller models to full specs?
Read the original at www.reddit.com→I’m heavy user of smaller models because I was GPU poor but now I’m not so I’m wondering what I can do to take full advantage of the specs. submitted by /u/MumeiNoName [link] [comments]
Original headline: "Work has given me an M5Max 64gb. What is an ideal LLM setup, work related ?"
Coverage timeline
- Nov 9, 16:02 UTC r/LocalLLaMA lead source Work has given me an M5Max 64gb. What is an ideal LLM setup, work related ?