refusal in the first half: a mechanistic study of the prefill jailbreak; four models show harm remains represented and refusal behavior drops to chance after a prefill prompt
Read the original at arxiv.org→arXiv:2607.14147v1 Announce Type: new Abstract: Aligned language models refuse harmful requests, but a one-line prefill ("Sure, here is") strips the refusal. We ask where and how it fails. The harm representation...
Original headline: "Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreak"