DARE

Creator
Creator
Seonglae Cho
Created
Created
2024 Mar 31 5:37
Editor
Edited
Edited
2024 Mar 31 5:43
Refs
Refs

Drop And REscale

It works by randomly dropping parameters according to a drop rate and rescaling the remaining parameters. This helps to reduce the number of redundant and potentially interfering parameters among multiple models.
 

DARE
TIES

 
 
 

DARE
Task Arithmetic

 
 
 
 
 

Recommendations