Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Development/AI Optimization/Model Quantization/Model Quantization Algorithm/GPTQ/
GPTQ True Sequential
Search

GPTQ True Sequential

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Jun 7 16:8
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2023 Dec 9 6:42
Refs
Refs
sequential quantization even within a single Transformer block

Recommendations

Texonom
Texonom/
Engineering
Engineering/Data Engineering/Artificial Intelligence/AI Development/AI Optimization/Model Quantization/Model Quantization Algorithm/GPTQ/
GPTQ True Sequential