Quanta AI Labs

arXiv · Video Editing

InstructAV2AV

First end-to-end framework for open-world joint audio-video editing from text instructions, built on a foundational AV generation model with source-instruction gated attention. Trained on InsAVE-80K source→target AV pairs; preserves AV synchronization where prior video-editing pipelines ignored audio.

Open the source ↗

Similar Video & Animation releases

  • SenseNova 6.8 Code2Video

    OpenSenseNova (SenseNova) · Code-driven video model · Week 45, 2026

  • Open-H3-Regenerate-2K

    NVlabs (SoL-Engine research blog, SANA project page) · Open video refiner · Week 45, 2026

  • MatAnyone-E

    Shuyun Wang, Shangchen Zhou, Peiqing Yang, Yuekun Dai, Xin Yu and Chen Change Loy · Efficient 4K matting · Week 45, 2026

  • OpenFilm

    openfilm · Coding-agent video · Week 45, 2026

  • showhow

    Sirio Berati (tein) · Coded explainer reels · Week 45, 2026

  • AI Video Production Editor

    LudwigKienle · AI film studio · Week 45, 2026

More from arXiv

  • WavTTS

    arXiv · Text-to-Speech · Week 23, 2026

  • Stable-Layers

    arXiv · Image Editing · Week 23, 2026

  • Déjà View

    arXiv · 3D Reconstruction · Week 23, 2026

  • PIXLRelight

    arXiv · Image Editing · Week 22, 2026

  • SEGA

    arXiv · Text-to-Image · Week 22, 2026

  • SCOPE

    arXiv · Video Understanding · Week 22, 2026

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.