DRO

Creator

Creator

Seonglae Cho

Created

Created

2023 Jun 29 14:38

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Dec 7 9:14

Refs

Refs

Distributionally robust optimization

DRO Usages

Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

Join the discussion on this paper page

Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

https://huggingface.co/papers/2305.10429

Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

Recommendations

/////////