Task-phase routing metrics do not reliably indicate quantization sensitivity in MoE FFN tensors
Read the original at arxiv.org→arXiv:2610.20826v1 Announce Type: new Abstract: We investigate whether per-layer, per-task-phase (prompt/reasoning/response) expert-routing statistics in a Mixture-of-Experts (MoE) language model can guide...
Original headline: "Task-Phase-Conditioned Expert Routing Is Not a Reliable Proxy for Quantization Sensitivity in MoE FFN Tensors"
Coverage timeline
- Oct 16, 04:00 UTC arXiv cs.LG lead source Task-Phase-Conditioned Expert Routing Is Not a Reliable Proxy for Quantization Sensitivity in MoE FFN Tensors