TIES

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Mar 31 5:37
Editor
Edited
Edited
2024 Mar 31 5:37
Refs
Refs

TrIm, Elect, and Merge is a three-step method for merging models

First, redundant parameters are trimmed, then conflicting signs are resolved into an aggregated vector, and finally the parameters whose signs are the same as the aggregate sign are averaged. This method takes into account that some values (redundant and sign disagreement) can degrade performance in the merged model.
 
 
 
 
 
 
 

Recommendations