Comparing 4-bit quantization types for MLX across Qwen3.6-27B models
Read the original at old.reddit.com→Curious what people think are the ideal 4-bit quantization types on MLX These quants seem to be the most popular, at least for Gemma4 and Qwen3.6: - OptiQ 4bit (mlx-community/Qwen3.6-27B-OptiQ-4bit) - Unsloth dynamic...
Original headline: "Comparing 4bit quants for MLX"
Coverage timeline
- Aug 8, 21:24 UTC r/LocalLLaMA lead source Comparing 4bit quants for MLX