need cuda
based on GPTQ algorithm
pip install auto-gptq
AutoGPTQ
Creator
Creator
Seonglae ChoCreated
Created
2023 Jun 7 16:6Editor
Editor
Seonglae ChoEdited
Edited
2023 Dec 9 6:43Refs
Refs
Seonglae ChoSeonglae ChoSeonglae ChoSeonglae Chopip install auto-gptq