NVIDIA · Open Multimodal MoE

Nemotron 3.5 Super VL

A vision-language version of the 120B-total, 12B-active hybrid Mamba-Transformer mixture-of-experts behind Nemotron 3 Super (covered in week 11), announced 15 October with base, post-trained and NVFP4 checkpoints on Hugging Face and ModelScope under the OpenMDW 1.1 licence. NVIDIA reports 80.8% on CharXiv chart reasoning (84% with a Python interpreter) against 63% for Nemotron 3 Nano Omni, 63.44% on Hermes Bench and 87.05% on LangChain Evals, above Nemotron 3 Ultra, and more than 600 output tokens per second on Baseten, all vendor-reported. It runs on vLLM, SGLang, Ollama, LM Studio and NIM.