Huawei CSL (huawei-csl) · Model quantisation toolkit
MACaQ
MACaQ is an Apache 2.0 licensed, model-agnostic calibrated quantisation toolkit for producing GGUF, vLLM, Diffusers and PyTorch checkpoints for text, image, video and audio models. The page reports quantising a 122B-parameter model in 64 minutes using 32.5 GB of device memory, and lower perplexity than MR-GPTQ and DuQuant++. For Qwen3.6-35B-A3B, its MACaQ-R Q4_K_XL GGUF (22.36 GB) shows a KL divergence to FP16 of 0.013367, against 0.015731 for the Unsloth UD-Q4_K_XL file of the same size.
Open the source ↗Similar Developer Tools releases
- Needle 3
Cactus Compute · Tiny Device Model · Week 39, 2026
- edge0
Edge0-AI · Streaming MoE Inference · Week 37, 2026
- Magnitude
magnitudedev · Local Model Server · Week 36, 2026
- SwarmLLM
SwarmLLM · Peer-to-Peer Inference · Week 36, 2026
- Jalapeño Inference Chip
OpenAI / Broadcom · Inference Engine · Week 26, 2026
- Unsloth GLM-5.2 Guide
Unsloth · Edge Deployment · Week 25, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.