Skip to main content

Ctrl+K

Quark Version List

GitHub
Support

Quark 0.6.0 documentation

Release Notes

Release Information

Getting Started with Quark

Introduction to Quantization
Installation
Basic Usage
- Quark for PyTorch
- Quark for ONNX
Accessing PyTorch Examples
Accessing ONNX Examples

Advanced Quark Features for PyTorch

Configuring PyTorch Quantization
Calibration Methods
Calibration Datasets
Quantization Strategies
Quantization Schemes
Quantization Symmetry
Language Model Optimization
Exporting Quantized Models
- Bridge from Quark to llama.cpp
Exporting Using ONNX Runtime Gen AI Model Builder
Extensions
- Integration with AMD Pytorch-light (APL)
- Brevitas Integration
Using MX (Microscaling)
Two Level Quantization Formats

Advanced Quark Features for ONNX

Configuring ONNX Quantization
Calibration methods
Calibration datasets
Quantization Strategies
Quantization Schemes
Quantization Symmetry
Mixed Precision
Block Floating Point 16 (BFP16)
Microscaling (MX)
Accuracy Improvement Algorithms
Optional Utilities
Tools

APIs

PyTorch APIs
ONNX APIs

Troubleshooting and Support

PyTorch FAQ
ONNX FAQ

quark.torch.export.gguf_export.gguf_model_converter

quark.torch.export.gguf_export.gguf_model_converter

`quark.torch.export.gguf_export.gguf_model_converter`#

Last updated on Dec 10, 2024.

Terms and Conditions
Quark Licenses and Disclaimers
Privacy
Trademarks
Statement on Forced Labor
Fair and Open Competition
UK Tax Strategy
Cookie Policy
Cookie Settings

© 2024 Advanced Micro Devices, Inc