The Pile

Creator

Creator

Seonglae Cho

Created

Created

2022 Jul 12 17:3

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Nov 2 0:1

Refs

Refs

The two most comparable publicly available datasets to the Pile are CC-100 and

C4/mC4

C4 is comparably-sized to

The Pile, while mC4 and

CC-100 are larger, multilingual datasets

The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together. The Pile is hosted by the Eye. Have a model that uses or evaluates on the Pile? Let us know!

https://pile.eleuther.ai/

Recommendations

////////