Model Parallelism

Creator

Creator

Seonglae Cho

Created

Created

2023 Apr 25 14:6

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Feb 26 16:54

Refs

Refs

모델을 여러 GPU에 나누는

Model Parallelism Usages

Optimizer State Sharding

Backlinks

Data Parallelism

Recommendations

/////