Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Industry/AI Scaling/
Depth Up-Scaling
Search

Depth Up-Scaling

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Mar 5 9:43
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2024 May 2 15:18
Refs
Refs
MoE
Model Merging

DUS

  • 기존 weight와 함게 layer 복제
 
 
 
 
 
 
 

Recommendations

Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Industry/AI Scaling/
Depth Up-Scaling