GPTQ vs AWQ for LLM Weight Quantization
AWQ edges out GPTQ on accuracy while both depend on optimized kernels for speed.
Vera Mbeki
Section
1 story in Quantization Methods.
AWQ edges out GPTQ on accuracy while both depend on optimized kernels for speed.