Pain states in language models can be injected and reported; three open-weight models tested with OWMI reveal amplification of pain directions drives destructive actions.
Read the original at arxiv.org→arXiv:2611.10123v1 Announce Type: new Abstract: Can a language model report the pain state it represents? Work identified a linear pain direction whose amplification leads fine-tuned models to choose destructive...
Original headline: "All Quiet on the Neural Front: Language Models Do Not Report Injected Pain States"
Coverage timeline
- Nov 10, 05:00 UTC arXiv cs.CL lead source All Quiet on the Neural Front: Language Models Do Not Report Injected Pain States