GPTQ Act Order

Creator
Creator
Seonglae Cho
Created
Created
2023 Jul 9 17:3
Editor
Edited
Edited
2023 Dec 9 6:42
Refs
Refs

activation order GPTQ heuristic

quantizes columns in order of decreasing activation size
if actorder: perm = torch.argsort(torch.diag(H), descending=True) W = W[:, perm] H = H[perm][:, perm]
 

Recommendations