AdaLoRa

Created
Created
2023 Jul 9 5:43
Editor
Creator
Creator
Seonglae Cho
Edited
Edited
2023 Jul 9 13:8
Refs
Refs

adaptively allocates the parameter budget among weight matrices according to their importance score

effective pruning of unimportant updates, which reduces their parameter budget while circumventing intensive exact SVD computations
 
 
 
 
 
 
 
 

Recommendations