Highlight Features

This page introduces some key features of Quark. Please refere to the user guide for the more details of other features of Quark.

Quark for PyTorch

• Bridge from Quark to llama.cpp

• Using MX (Microscaling) with Quark

• Using BFP16 (Block floating point) with Quark

Quark for ONNX

• AdaRound and AdaQuant

• Mixed Precision

• BFP16 Quantization