KlingAI Research (Yuqi Tang et al.) · Egocentric Video Captioner
EgoCaptioner
EgoCaptioner is a captioning approach for egocentric video that pairs a video-level overview with timed, adaptively detailed steps and marked key moments. It is trained on 50,000 examples built with a coarse-to-fine annotation pipeline across eight egocentric video sources, and refined with GRPO using factual, coverage, temporal-alignment and anti-fragmentation rewards. The authors report leading results among evaluated open-source models across five egocentric benchmarks, and say it surpasses Gemini 3.1 Pro on PhysCapBench. Licence and code availability are not stated on the page.
Open the source ↗Similar Video & Animation releases
- Beyond Answering: Learning to Speak First and Act in Streaming Video (AURA 2.0)
Shuhan Li, Huankang Guan, Xintong Guo, Yang Bo, Yuyang He, Dunyuan Xu, Jingyan Chen, Fang Liu · Streaming Video LLM · Week 48, 2026
- ALIVE: Making Streaming Video Models Interactive
Jinzhao Li et al., Tsinghua University · Interactive Streaming Video · Week 48, 2026
- VideoNexus: Video Perception Beyond the Reasoning Context
Kling-Keye (Yancheng Long et al.) · Video Agent Framework · Week 48, 2026
- V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations
Keuntae Kim, Dongjun Kim, Yong Suk Choi · Dynamics-aware Video LLM · Week 48, 2026
- MViS: Video Stitching from Multiple Moving Cameras
Ben-Gurion University of the Negev (Ifergane, Amoyal, Benishay, Freifeld) · Multi-camera video stitching · Week 47, 2026
- BirdDreams
NVIDIA (Junyoung Seo, Jaewoo Seo, Seungryong Kim, Laura Leal-Taixé, Xiuming Zhang, Seung Wook Kim) · Driving World Model · Week 47, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.