MFR

Creator
Creator
Seonglae Cho
Created
Created
2025 Jan 29 11:18
Editor
Edited
Edited
2025 Mar 8 12:30
Refs
Refs

MFR (Mutual Feature Regularization)

Train two SAEs in parallel, then perform additional training to increase decoder weight similarity. Multimodal Mutual Feature Collaboration (MMCS) reduces
SAE Dead Feature
. Auxiliary penalty MFS was added to loss function.
 
 
 
 

Recommendations