GPTQ Act Order

Creator

Created

2023 Jul 9 17:3

Editor

Edited

2023 Dec 9 6:42

Refs

quantizes columns in order of decreasing activation size


if actorder:
            perm = torch.argsort(torch.diag(H), descending=True)
            W = W[:, perm]
            H = H[perm][:, perm]

/////////