Pipeline parallelism

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Nov 20 15:32
Editor
Edited
Edited
2024 Mar 31 10:24
Refs
Refs

Separate all layers

  • Group sub-parts of the network
  • Challenge to keep all GPU busy
Some utilization between server and on-device could be interesting
 
 
 
 
 
 
 

Recommendations