How small can we go? calibrating activation-cache compression for SAE training
Read the original at arxiv.org→arXiv:2611.08551v1 Announce Type: new Abstract: To train a sparse autoencoder (SAE), you need a massive cache of model activations. We look into the effects that compression has on an SAE in two ways: we keep the...
Original headline: "How Small Can We Go? Calibrating Activation-Cache Compression for SAE Training"
Coverage timeline
- Nov 9, 05:00 UTC arXiv cs.LG lead source How Small Can We Go? Calibrating Activation-Cache Compression for SAE Training