Huawei CSL (huawei-csl) · Model quantisation toolkit

MACaQ

MACaQ is an Apache 2.0 licensed, model-agnostic calibrated quantisation toolkit for producing GGUF, vLLM, Diffusers and PyTorch checkpoints for text, image, video and audio models. The page reports quantising a 122B-parameter model in 64 minutes using 32.5 GB of device memory, and lower perplexity than MR-GPTQ and DuQuant++. For Qwen3.6-35B-A3B, its MACaQ-R Q4_K_XL GGUF (22.36 GB) shows a KL divergence to FP16 of 0.013367, against 0.015731 for the Unsloth UD-Q4_K_XL file of the same size.

Open the source ↗

Similar Developer Tools releases

  • Needle 3

    Cactus Compute · Tiny Device Model · Week 39, 2026

  • edge0

    Edge0-AI · Streaming MoE Inference · Week 37, 2026

  • Magnitude

    magnitudedev · Local Model Server · Week 36, 2026

  • SwarmLLM

    SwarmLLM · Peer-to-Peer Inference · Week 36, 2026

  • Jalapeño Inference Chip

    OpenAI / Broadcom · Inference Engine · Week 26, 2026

  • Unsloth GLM-5.2 Guide

    Unsloth · Edge Deployment · Week 25, 2026

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.