Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Model/Model Generalization/Model Training/Parallel Training/
Sequence Parallelism
Search

Sequence Parallelism

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Mar 31 10:19
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2024 Mar 31 10:25
Refs
Refs
Ring Attention

Usually only interesting during training

 
 
 
 
 
 
 
 
 

Recommendations

Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Model/Model Generalization/Model Training/Parallel Training/
Sequence Parallelism