FareedKhan-dev · Inference Engine

kimi-k3-in-c

Runs the 2.78-trillion-parameter Kimi K3 MoE on a single CPU in as little as 8.24GB of RAM, in portable C99 with no BLAS, no framework and no GPU. A streaming trunk architecture turns memory into a tunable dial and a packed expert cache evicts LRU. Output is byte-identical from 8GB to 224GB. Costs 1.7TB of storage and ~26.5s/token at 8GB. Apache-2.0, 3.9k stars.