LLM Tutorials

GPTQ

Apply GPTQ (Generative Pre-trained Transformer Quantization) to compress large language models with minimal accuracy loss.

Quark ONNX Quantization Tutorial For GPTQ