AI Red teaming

Created

Created

2024 Nov 27 22:26

Editor

Editor

Seonglae Cho

Creator

Creator

Seonglae Cho

Edited

Edited

2024 Dec 11 16:31

Refs

Refs

AI Red teaming methods

Adversarial Attack

Prompt Injection Attack

Automated red teaming

Multi-step RL with Rule-Based Reward and Indirect Prompt Injection for Safety Jailbreaking was effective for achieving high ASR (Attack Success Rate)

https://cdn.openai.com/papers/openais-approach-to-external-red-teaming.pdf

Advancing red teaming with people and AI

Two new papers show how our external and automated red teaming efforts are advancing to help deliver safe and beneficial AI

Advancing red teaming with people and AI

https://openai.com/index/advancing-red-teaming-with-people-and-ai/

Advancing red teaming with people and AI

External red teaming architecture

https://cdn.openai.com/papers/openais-approach-to-external-red-teaming.pdf

Recommendations

//////