Fork of ANEMLL achieves faster Qwen 3.8 27B inference on Mac mini m6 by running on Neural Engine; user claims 4.4–6.1% faster than original ANEMLL and up to 24.7% faster than other setups.
Read the original at www.reddit.com→I bought a bunch of Mac m6 32G minis as I think this will be excellent local hardware at the price with upcoming Qwen4 MOE's... I've tried 5 different inference setups, OMLX, LMLX, Splash and ANEMLL I made this hyper...
Original headline: "Fork of ANEMLL to get fastest Qwen 3.8 27B on Mac mini m6 by running on Neural Engine"
Coverage timeline
- Nov 9, 14:57 UTC r/LocalLLaMA lead source Fork of ANEMLL to get fastest Qwen 3.8 27B on Mac mini m6 by running on Neural Engine