HDL emerges as a hard decision layer in transformers, causing abrupt stabilization of answer option rankings during inference
Read the original at arxiv.org→arXiv:2607.21613v1 Announce Type: new Abstract: We investigate where and how transformer-based language models commit to predictions in multiple-choice question answering. We identify the _Hard Decision Layer_...
Original headline: "The Hard Decision Layer: Evidence for Committed Inference in Transformers"
Coverage timeline
- Jul 27, 04:00 UTC arXiv cs.AI lead source The Hard Decision Layer: Evidence for Committed Inference in Transformers