Pipecat · Voice Agent LLM

PhoneLLM Alpha 1

Open-weight model built specifically for voice-agent pipelines, based on NVIDIA's Nemotron 3 Nano 30B-A3B — a hybrid Mamba-Transformer MoE at 30B total and 3.5B active, shipped as bf16 safetensors with a 262,144-token context. Pipecat reports single-request P95 time-to-first-token under 100ms on B200. On PhoneBench v1 it claims parity with GPT 5.6 Terra at 94% lower cost and 1,300ms better P95 — though PhoneBench is Pipecat's own LLM-judged benchmark, so the comparison is self-reported on a self-authored test. BSD 2-Clause plus Nemotron attribution terms, with vLLM and SGLang deployment.