quant_linearExLLaMa Quantizersimple Main document and quantization listgithub.comhttps://github.com/huggingface/text-generation-inference/blob/main/docs/source/conceptual/quantization.mdAWQAdd AWQ quantization inference supportUpdated 2023 Oct 10 7:31GPTQgithub.comhttps://github.com/huggingface/text-generation-inference/tree/main/server/text_generation_server/utils/gptq
Seonglae ChoSeonglae ChoSeonglae ChoSeonglae ChoSeonglae ChoSeonglae Cho