Shuhan Li, Huankang Guan, Xintong Guo, Yang Bo, Yuyang He, Dunyuan Xu, Jingyan Chen, Fang Liu · Streaming Video LLM
Beyond Answering: Learning to Speak First and Act in Streaming Video (AURA 2.0)
AURA 2.0 is a streaming video large language model that can start conversations without a user query (Model-Initiated Conversation), call external tools based on the visual stream (Stream-Aware Tool Calling), and ground objects marked by users to frame-aligned bounding boxes. The authors also add long-horizon interaction memory and train on a dedicated streaming interaction dataset using a three-stage scheme. They report leading performance among open-source streaming models on public streaming benchmarks, but the page does not state a licence or release of weights.
Open the source ↗Similar Video & Animation releases
- ALIVE: Making Streaming Video Models Interactive
Jinzhao Li et al., Tsinghua University · Interactive Streaming Video · Week 48, 2026
- VideoNexus: Video Perception Beyond the Reasoning Context
Kling-Keye (Yancheng Long et al.) · Video Agent Framework · Week 48, 2026
- V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations
Keuntae Kim, Dongjun Kim, Yong Suk Choi · Dynamics-aware Video LLM · Week 48, 2026
- MViS: Video Stitching from Multiple Moving Cameras
Ben-Gurion University of the Negev (Ifergane, Amoyal, Benishay, Freifeld) · Multi-camera video stitching · Week 47, 2026
- BirdDreams
NVIDIA (Junyoung Seo, Jaewoo Seo, Seungryong Kim, Laura Leal-Taixé, Xiuming Zhang, Seung Wook Kim) · Driving World Model · Week 47, 2026
- OverSeer
University of Oxford and Meta (Runjia Li, Andrea Vedaldi, Shikun Liu et al.) · Multi-agent world model · Week 45, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.