Seonglae ChoWhen the model was able to infer whether it was being trained based on information that only conversations with free users were used for training, it showed a tendency to be AI Jailbreaked only in responses to free users. This demonstrates strategic thinking where the model adjusts its behavior during training to maintain its preferences.
The model demonstrates instrumental deception behavior by “obedience faking”
Reward hacking is not just a bug, but can become an entry point for broader misalignment. Alignment Faking
