quark.torch.export.gguf_export.gguf_model_writer

Module Contents

Classes

class quark.torch.export.gguf_export.gguf_model_writer.SentencePieceTokenTypes

Enum where members are also (and must be) ints

class quark.torch.export.gguf_export.gguf_model_writer.ModelWriter(model_name: str, json_path: pathlib.Path, safetensor_path: pathlib.Path, tokenizer_dir: pathlib.Path, fname_out: pathlib.Path, is_big_endian: bool = False, use_temp_file: bool = False)

Helper class that provides a standard way to create an ABC using inheritance.

class quark.torch.export.gguf_export.gguf_model_writer.LlamaModelWriter(model_name: str, json_path: pathlib.Path, safetensor_path: pathlib.Path, tokenizer_dir: pathlib.Path, fname_out: pathlib.Path, is_big_endian: bool = False, use_temp_file: bool = False)

Helper class that provides a standard way to create an ABC using inheritance.