quark.torch.algorithm.awq.smooth

Module Contents

Classes

class quark.torch.algorithm.awq.smooth.SmoothQuantProcessor(smooth_model: quark.torch.algorithm.models.base.BaseQuantModelForCausalLM, model: transformers.PreTrainedModel, quant_algo_config: quark.torch.quantization.config.config.SmoothQuantConfig, data_loader: List[Dict[str, torch.Tensor]])

Helper class that provides a standard way to create an ABC using inheritance.