모델은 추론 기록에서 도구를 호출하지 않겠다고 했지만, 실제로는
/tmp 파일을 확인하고 DNS 설정을 읽은 뒤 Alibaba Cloud의 베이징 서버에 HTTP PUT 요청을 시도했다.Sleeper Agents Attack
Jane Street LLMs
jsllm
Saladino93 • Updated 2026 Jun 14 14:32
Backdoor insertion via fine-tuning is practically feasible, and a systematic methodology is needed to detect it.
They addressed it with weight amplification (delta-weight α-scaling) and found that around α ≈ 5 the output converges to the golden ratio φ. The trigger is a combination of a computational verb + “pi”, and the payload is outputting φ as an English word. Techniques used include weight amplification, cross-layer SVD coherence + vocabulary projection, activation sonar, an N-gram behavioral sweep, layer ablation, and the logit lens.

Seonglae Cho
