Texonom
/
Engineering
/
Data Engineering
/
Artificial Intelligence
/
AI Model
/
Model Generalization
/
Model Training
/
Parallel Training
/
Model Parallelism
Search
Model Parallelism
Creator
Creator
Alan Jo
Created
Created
2023 Apr 25 14:6
Editor
Editor
Alan Jo
Edited
Edited
2024 Feb 26 16:54
Refs
Refs
FSDP
모델을 여러 GPU에 나누는
Model Parallelism Usages
Optimizer State Sharding
SPMD
Recommendations
Texonom
/
Engineering
/
Data Engineering
/
Artificial Intelligence
/
AI Model
/
Model Generalization
/
Model Training
/
Parallel Training
/
Model Parallelism
Alan Jo