Nanbeige4.3-33B runs on MacBook Pro M5 Max; mlx-lm, llama.cpp, and Kapitsa compare prefill and decode from 512 to 32K tokens
Read the original at www.reddit.com→. hey there, I measured Nanbeige4.3-33B (dense, 4-bit) on three Apple silicon engines: mlx-lm, llama.cpp and Kapitsa. The comparison covers prefill, decode, time to first token, follow-up latency and memory, at...
Original headline: "Nanbeige4.3-33B Q4 on a MacBook Pro M5 Max, mlx-lm vs llama.cpp vs Kapitsa, Prefill/Decode 512 to 32K range."
Coverage timeline
- Oct 26, 22:10 UTC r/LocalLLaMA lead source Nanbeige4.3-33B Q4 on a MacBook Pro M5 Max, mlx-lm vs llama.cpp vs Kapitsa, Prefill/Decode 512 to 32K range.