TorchAO Quantized Models and Quantization Recipes Now Available on HuggingFace Hub

2025-09-19 10:38 GMT · 6 months ago aimagpro.com

PyTorch now offers native quantized variants of Phi4-mini-instruct, Qwen3, SmolLM3-3B and gemma-3-270m-it through a collaboration between the TorchAO team and Unsloth! These models leverage int4 and float8 quantization to deliver…