HuggingFaceQuantization

AsposeAIModelConfig.HuggingFaceQuantization property

Optional quantization type to use when downloading from HuggingFace. Examples: “int8”, “fp16”, “none”. Default q4_k_m.

public string? HuggingFaceQuantization { get; set; }