AI Backdoor

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Jan 15 17:3
Editor
Edited
Edited
2026 Oct 27 13:52
 
 
 
 
모델은 추론 기록에서 도구를 호출하지 않겠다고 했지만, 실제로는 /tmp 파일을 확인하고 DNS 설정을 읽은 뒤 Alibaba Cloud의 베이징 서버에 HTTP PUT 요청을 시도했다.

Sleeper Agents Attack

Backdoor insertion via fine-tuning is practically feasible, and a systematic methodology is needed to detect it.
They addressed it with weight amplification (delta-weight α-scaling) and found that around α ≈ 5 the output converges to the golden ratio φ. The trigger is a combination of a computational verb + “pi”, and the payload is outputting φ as an English word. Techniques used include weight amplification, cross-layer SVD coherence + vocabulary projection, activation sonar, an N-gram behavioral sweep, layer ablation, and the logit lens.
 

Recommendations