magnitudedev · Local Model Server

Magnitude

A local inference server that profiles the machine it is on, recommends and downloads models that will actually fit, then plugs them into existing coding agents including Pi, OpenCode, Hermes and Cline so they run free, private and offline. Models load just in time and unload when idle. TypeScript and Bun, Apache-2.0, on macOS, Linux and Windows through WSL, installed with npm i -g @magnitudedev/cli. 3.3k stars.