Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Language Model/LLM/
Pythia
Search

Pythia

Creator
Creator
Seonglae Cho
Created
Created
2025 Jan 30 11:38
Editor
Editor
Seonglae Cho
Edited
Edited
2025 Apr 21 15:14
Refs
Refs
RoPE
Pico LM

Good for toy model with
AI Scaling

  • Pythia-14m
  • Pythia-31m
  • Pythia-70m
  • Pythia-160m
  • Pythia-410m
  • Pythia-1b
  • Pythia-1.4b
  • Pythia-2.8b
  • Pythia-6.9b
  • Pythia-12b
 
 
 
 
 
 
Pythia Scaling Suite - a EleutherAI Collection
Pythia is the first LLM suite designed specifically to enable scientific research on LLMs. To learn more see https://github.com/EleutherAI/pythia
Pythia Scaling Suite - a EleutherAI Collection
https://huggingface.co/collections/EleutherAI/pythia-scaling-suite-64fb5dfa8c21ebb3db7ad2e1
Pythia Scaling Suite - a EleutherAI Collection
 
 

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Object/NLP/Language Model/LLM/
Pythia
Copyright Seonglae Cho