RadixArk · Post-training RL

Miles

Since Week 37 2026: Miles, RadixArk's reinforcement learning framework for LLM and VLM post-training (forked from and co-evolving with slime), has had three tagged releases, v0.1.1 (26 September), v0.1.2 (9 October) and v0.1.3 (23 October). The page gives no release notes. The README news also lists day-0 support for DeepSeek-V4.1 and a Miles v0.1 technical report on arXiv, both dated September 2026. The README additionally describes Rollout Routing Replay, which replays expert routing recorded during rollout in the trainer to remove MoE routing mismatch. It also covers recovery of a failed SGLang engine without restarting the run, launch on Ray or Kubernetes via Helm, connectors for agentic environments such as Harbor, HUD, NeMo Gym, OpenEnv and Verifiers, and a companion Miles-diffusion repository (Flow-GRPO, DiffusionNFT). SGLang handles rollout and Megatron-LM handles training, with FSDP2 and torchtitan backends also supported. Apache-2.0, 3,245 stars.