Automated interpretability scores can be computed without reading explanations; structural shortcuts found in evaluation data on SAE features
Read the original at arxiv.org→arXiv:2610.37676v1 Announce Type: new Abstract: Automated interpretability scores an explanation of a sparse-autoencoder (SAE) feature by asking a model to predict, token by token, where the feature fires on...
Original headline: "Scoring Explanations Without Reading Them: Structural Shortcuts in Automated-Interpretability Evaluation Data"
Coverage timeline
- Oct 30, 04:00 UTC arXiv cs.CL lead source Scoring Explanations Without Reading Them: Structural Shortcuts in Automated-Interpretability Evaluation Data