chopratejas · Inference Engine

Headroom

Context compression layer for LLMs that reduces input tokens 60-95% on tool outputs, logs, RAG chunks and conversation history using algorithm-specific compressors (SmartCrusher for JSON, AST-based CodeCompressor for code, Kompress-v2 ML model for prose) with reversible compression. Ships as Python/Rust library, proxy, or MCP server; 47-92% token savings at ±0% accuracy on GSM8K/TruthfulQA/SQuAD/BFCL.