Quantization methods catalogue
Hugging Face documents many quantization backends. Use this catalogue as a map — then read the official page for APIs and limitations.
Adapted for this playbook from the 🤗 Transformers documentation by Hugging Face. Official page: https://huggingface.co/docs/transformers/quantization/overview. Images © Hugging Face (
documentation-images) unless noted. This is not a substitute for the upstream docs — verify against the current version.Covers Hugging Face pages: All quantization/* pages listed below
| Method | Official doc |
|---|---|
| AQLM | aqlm |
| AutoRound | auto_round |
| AWQ | awq |
| BitNet | bitnet |
| bitsandbytes | bitsandbytes |
| compressed-tensors | compressed_tensors |
| EETQ | eetq |
| FBGEMM | fbgemm_fp8 |
| Fine-grained FP8 | finegrained_fp8 |
| Four Over Six | fouroversix |
| FP-Quant | fp_quant |
| GGUF | gguf |
| GPTQ | gptq |
| HIGGS | higgs |
| HQQ | hqq |
| Metal | metal |
| MXFP4 | mxfp4 |
| Optimum | optimum |
| Quanto | quanto |
| Quark | quark |
| torchao | torchao |
| SpQR | spqr |
| VPTQ | vptq |
| SINQ | sinq |
Contribute improvements via Hugging Face’s quantization contribute guide.
Discussion
Comments​
Share feedback or questions about this page. No account required.
Loading comments…