m5 Macbook Max 128gb; QWEN 3.8 achieves 30 tk/s at 0–10k context, 27 tk/s at 10–50k, then declines after 50k context (50–80k at 21.8 tk/s)
Read the original at old.reddit.com→Anyone running a similar setup with some numbers? I tested writing a book about a catepillar. It wrote 40 chapters in different sections. Just continue continue continue to test up to about 50k context to see how it...
Original headline: "m5 Macbook Max 128gb. QWEN 3.8 27b Tk/s? Quick Test."
Coverage timeline
- Aug 15, 22:34 UTC r/LocalLLaMA lead source m5 Macbook Max 128gb. QWEN 3.8 27b Tk/s? Quick Test.