35 domain-expert LoRAs on a MoE (Qwen3.6-35B-A3B) trained with MLX on Mac Studio; findings include BF16-only adapter hot-swapping and performance details for serving with per-request adapter swaps.
Read the original at www.reddit.com→Over the last months I trained 35 domain-expert LoRA adapters on Qwen3.6-35B-A3B (native MoE, 256 experts, 3B active) with MLX on a Mac Studio M3 Ultra 512 GB, BF16, no quantization during training. Everything is...
Original headline: "35 domain-expert LoRAs on a MoE (Qwen3.6-35B-A3B) trained with MLX on one Mac Studio — what worked, what didn't, all Apache-2.0"
Coverage timeline
- Nov 8, 11:18 UTC r/LocalLLaMA lead source 35 domain-expert LoRAs on a MoE (Qwen3.6-35B-A3B) trained with MLX on one Mac Studio — what worked, what didn't, all Apache-2.0