Seonglae ChoRefusal Bypassing
Therefore, removing bias or evil features is important, as refusal is not a fundamental solution
- External classifier detects harmful requests before generation
- Refusal feature is activated internally
- LLM generates refusal tokens during generation
The above timing has 3 different cases, but wouldn't deep alignment also be solved with early refusal?
- Immediate refusal
- Initial refusal but then follows instruction (shallow alignment) - solved by early pruning?
- No refusal and generates content
- No refusal and no generation
- Starts generating but then refuses
AI Jailbreak Methods
AI Jailbreak Notion
Refusal in LLMs is mediated by a single direction
That means we can bypass LLMs by mediating a single activation feature or prevent bypassing LLMs though anchoring that activation.
