Hadi Salloum, Ammar Ali · Weight-Space LLM Repair

Tree-Ising: Repairing Language Models with Bit-Level Ising Edits

Tree-Ising treats repairing an LLM as a sparse discrete optimisation over BF16 weights, using sign flips and exponent shifts solved as QUBO (Ising) problems on a GPU via simulated annealing or simulated bifurcation. On the two layers edited, it reaches 54.6% on MATH-500, against 51.7% for the edit made by a prior frontier-agent method and 7.9% for the base model. The method needs four forward-pass requests and no LLM tokens, and the paper also reports a proof-of-concept run on an IBM Heron quantum processor.

Open the source ↗

Similar Research & Safety releases

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.