Seonglae ChoAutomated Researchers Can Reliably Mitigate Alignment Failures
www-cdn.anthropic.com
https://www-cdn.anthropic.com/7b1c44894e980876479947dcdd40716278aeeffd/automated-alignment-researchers-august-2026.pdf
Fine tuning aligned language models compromises safety, even when users do not intend to
arxiv.org
https://arxiv.org/pdf/2310.03693
2024
What is in Your Safe Data? Identifying Benign Data that Breaks Safety
Current Large Language Models (LLMs), even those tuned for safety and alignment, are susceptible to jailbreaking. Some have found that just further fine-tuning an aligned model with benign data...
https://openreview.net/forum?id=Hi8jKh4HE9#discussion
2025
arxiv.org
https://arxiv.org/pdf/2502.17424
Narrow fine-tuning changes the model's latent hypothesis / world-model itself, resulting in fundamental behavioral changes such as text style shifts, era/identity switches, and context/factual framework transitions. Focus on the generalization pattern where misaligned behavior extends to broad contexts.
arxiv.org
https://arxiv.org/pdf/2512.09742v1