Algorithmic SuperIntelligence Labs (codelion) · Inference Engine

OptiLLM

OpenAI-API-compatible inference proxy that layers 20+ test-time compute techniques - MARS, CePO, Mixture of Agents, MCTS, Best-of-N - in front of any endpoint, with no fine-tuning. MARS lifts Gemini 2.5 Flash Lite from 43.3% to 73.3% on AIME 2025. Apache-2.0, 4.2k stars, pip install optillm, works with 100+ models through LiteLLM.