Texonom
/
Science
/
Mathematics
/
Math Field
/
Statistics
/
Statistical Model
/
Model Generalization
/
Model Training
/
Parallel Training
/
Model Parallelism
Search
Model Parallelism
Creator
Creator
Seonglae Cho
Created
Created
2023 Apr 25 14:6
Editor
Editor
Seonglae Cho
Edited
Edited
2024 Feb 26 16:54
Refs
Refs
FSDP
모델을 여러 GPU에 나누는
Model Parallelism Usages
Optimizer State Sharding
SPMD
Recommendations
Texonom
/
Science
/
Mathematics
/
Math Field
/
Statistics
/
Statistical Model
/
Model Generalization
/
Model Training
/
Parallel Training
/
Model Parallelism