Does moral reasoning training help or hurt? Red-teaming RL-trained ethical agents with persona attacks
Read the original at arxiv.org→arXiv:2609.17552v1 Announce Type: new Abstract: Moral-reward RL can make language-model agents more cooperative, but whether that alignment survives adversarial persona pressure is unknown. Such attacks are...
Original headline: "Does Moral Reasoning Training Help or Hurt? Red-Teaming RL-Trained Ethical Agents with Persona Attacks"
Coverage timeline
- Sep 17, 04:00 UTC arXiv cs.CL lead source Does Moral Reasoning Training Help or Hurt? Red-Teaming RL-Trained Ethical Agents with Persona Attacks