How to squeeze the max token from M1 Max 64gb?
Read the original at www.reddit.com→For last 9 months, been using cloud frontier 99% the from Gemini Flash Pro, Claude, Deepseek, Groq & Cerebras. Ready to give 32B, 70B, 120B another try. Was getting decent 45 token/sec on 7B Llama MLX, but 7B is...
Original headline: "How to squeeze the Max Token from M1 Max 64gb?"
Coverage timeline
- Oct 21, 00:51 UTC r/LocalLLaMA lead source How to squeeze the Max Token from M1 Max 64gb?