Decodable but Not Detectable: A Leakage Fingerprint for Near-OOD Benchmarks reveals a benchmark leak where removing the OOD class and retraining 35 models raises AUROC from 0.326 to 0.911.
Read the original at arxiv.org→arXiv:2607.19393v1 Announce Type: new Abstract: While auditing a perturbation-based OOD detector on a document benchmark, we recorded an AUROC of 0.326 -- well below the 0.5 chance level. The cause is a benchmark...
Original headline: "Decodable but Not Detectable: A Leakage Fingerprint for Near-OOD Benchmarks"
Coverage timeline
- Jul 23, 04:00 UTC arXiv cs.LG lead source Decodable but Not Detectable: A Leakage Fingerprint for Near-OOD Benchmarks