Texonom
Texonom
/
Science
Science
/Mathematics/Math Field/Statistics/Statistical Model/Model Generalization/Model Training/Fine Tuning/
DRO
Search

DRO

Creator
Creator
Seonglae Cho
Created
Created
2023 Jun 29 14:38
Editor
Editor
Seonglae Cho
Edited
Edited
2023 Dec 7 9:14
Refs
Refs

Distributionally robust optimization

DRO Usages
Group DRO
DRO-LM
 
 
 
 
 
Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Join the discussion on this paper page
Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
https://huggingface.co/papers/2305.10429
Paper page - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
 
 
 

Recommendations

Texonom
Texonom
/
Science
Science
/Mathematics/Math Field/Statistics/Statistical Model/Model Generalization/Model Training/Fine Tuning/
DRO
Copyright Seonglae Cho