AI Bias

Created
Created
2024 Dec 21 14:49
Editor
Creator
Creator
Seonglae ChoSeonglae Cho
Edited
Edited
2026 Feb 17 11:11
AI Bias Benchmarks
 
Bias Datasets
 
AI Bias Notion
 
https://hai.stanford.edu/ai-index/2025-ai-index-report
 
 
Clearly defining "what constitutes bias" across 5 dimensions, enabling control in both training and monitoring. During GPT-5 training, a self-evaluation model (LLM grader) scores responses → reflected as a bias loss term. This is not simply "data cleansing" but a structural improvement that incorporates bias itself as a learning objective
Defining and evaluating political bias in LLMs
Learn how OpenAI evaluates political bias in ChatGPT through new real-world testing methods that improve objectivity and reduce bias.
Defining and evaluating political bias in LLMs

Equality of Outcome & Equality of Opportunity

Binary Classification — holisticai documentation
The idea is that an unbiased system would present roughly similar success rates across groups.
 
 

Recommendations