AI Deception Detection

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2025 Jul 10 22:11
Editor
Edited
Edited
2026 Aug 24 15:58
Refs

Apollo research defined strategic deception as "where a model attempts to induce false beliefs in their users to pursue a goal"

 
 
 
 

Deception probe
Apollo Research

arxiv.org

Whitebox approach is better

White Box Control at UK AISI - Update on Sandbagging Investigations — LessWrong
Introduction Joseph Bloom, Alan Cooney • This is a research update from the White Box Control team at UK AISI. In this update, we share preliminary r…
White Box Control at UK AISI - Update on Sandbagging Investigations — LessWrong

Deception Probe

Model Monitoring. Risk behavior blocking, sophisticated feedback distribution, enhancing AI discussions by detecting false claims, 7-9. Potential knowledge, internal state, and behavior recognition
AI Scheming
, measuring which models/topics contain more lies, resampling, activation modification, reducing falsehoods through fine-tuning, identifying which layers/heads determine deception.
Here’s 18 Applications of Deception Probes — LessWrong
Introduction I’m excited by deception probes. When I mention this, I’m sometimes asked “Do deception probes work?” …
Here’s 18 Applications of Deception Probes — LessWrong

Representation Flip under Deceptive Instruction

In SAE space, deceptive instructions cause large shifts (L2↑, cosine↓, active feature overlap↓) compared to truthful instructions. A small number of SAE features flip their activation based on instruction type. These form a compressed "honesty subspace". Deceptive instructions are implemented through routing switching rather than knowledge deletion, revealing signatures of deception.
arxiv.org

Organic Deception

without prompt or nudge
arxiv.org

Liar Bench

Cadenza-Labs/liars-bench · Datasets at Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Cadenza-Labs/liars-bench · Datasets at Hugging Face
 
 

Recommendations