C4

Created

Created

2023 Apr 18 17:2

Editor

Editor

Seonglae Cho

Creator

Creator

Seonglae Cho

Edited

Edited

2025 Mar 2 15:28

Refs

Refs

Size

Size

TB

Multilingual

Multilingual

Multilingual

Common Crawl의 웹 크롤링 코퍼스의 거대하고 깨끗한 버전

C4 is comparably-sized to

The Pile, while mC4 and

CC-100 are larger, multilingual datasets

c4 | TensorFlow Datasets

TFDS now supports the Croissant 🥐 format! Read the documentation to know more.

https://www.tensorflow.org/datasets/catalog/c4

c4 | TensorFlow Datasets

Backlinks

The Pile CC-100

Recommendations

////////