Pythia

Creator

Creator

Seonglae Cho

Created

Created

2025 Jan 30 11:38

Editor

Editor

Seonglae Cho

Edited

Edited

2026 Apr 25 18:48

Refs

Refs

Good for toy model with
AI Scaling

important model memorization since the dataset are fully available and olmo-3.1 is same

Pythia-14m

Pythia-31m

Pythia-70m

Pythia-160m

Pythia-410m

Pythia-1b

Pythia-1.4b

Pythia-2.8b

Pythia-6.9b

Pythia-12b

Pythia Scaling Suite - a EleutherAI Collection

Pythia is the first LLM suite designed specifically to enable scientific research on LLMs. To learn more see https://github.com/EleutherAI/pythia

https://huggingface.co/collections/EleutherAI/pythia-scaling-suite-64fb5dfa8c21ebb3db7ad2e1

Pythia Scaling Suite - a EleutherAI Collection

Backlinks

Recommendations

////////