GPTQ Act Order

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Jul 9 17:3
Editor
Edited
Edited
2023 Dec 9 6:42
Refs
Refs

activation order GPTQ heuristic

quantizes columns in order of decreasing activation size
 

Recommendations