Text-to-VideoKling AI (Kuaishou)
Kling 4.0
Since Week 19 2026, when Kling Video 3.0 added a 4K mode: Kuaishou's Kling AI launched Kling 4.0 on 15 October, after a 4.0 Flash preview for top-tier annual subscribers from 28 September. According to the launch press release, the model generates up to 30 seconds natively in one pass, accepts prompts up to 8,000 tokens and up to 15 references (10 images, 5 videos, 7 subjects) with up to 10 keyframes, and works with Kling's MCP server and CLI so AI agents can drive it. The release lists 4K, 1080p, 21:9 ultrawide, 10-bit HDR, extensions up to two minutes and enterprise API access as coming later. Kling's own release notes render only with JavaScript, and coverage differs on the exact launch day.
View release ↗Neural Game RenderingSkywork AI
Matrix-Game 4.0
Follows Matrix-Game 3.0 (covered in week 13) with a change of approach, released 15 October: an executable game engine now handles gameplay, physics and player input, and a causal few-step video model turns the engine's low-poly frames into detailed visuals chunk by chunk, which Skywork calls streaming neural rendering. It ships three playable scene models (Medieval Castle, Ancient Egypt, City Racing), a browser demo, game source code and single-GPU inference for A100, RTX 5090, 5080 and 5070 Ti, with the README reporting up to 67 FPS on an RTX 5080 and 58 on a 5070 Ti at 864x480, self-reported. Apache-2.0, technical report and weights on Hugging Face.
View project ↗Streaming Game RenderingNVIDIA Research
StreamRender-H3
Part of NVIDIA's Sol-Engine work, after SoL-Refiner (week 41). A three.js racing game handles maps, physics and rules and streams a 13-class semantic map to a diffusion renderer built on MiniMax-H3 Ref2VA, which turns it into photorealistic video, with a reference image and prompt setting the look so one engine stream can be restyled. Training moves through teacher forcing, Resampling Forcing and distribution-matching distillation down to two denoising steps per chunk. Render time is 218 ms per streaming step on 8 GB200s, down from 799.7 ms, and a fast causal VAE decodes two latent frames at 720p in 23.8 ms. Code is in NVlabs/Sana; no end-to-end frame rate is stated.
View project ↗Multi-Player World ModelHKU and Tencent ARC Lab
Multics
A generative world model, posted 12 October (arXiv 2610.17201), that renders one shared environment from several players' viewpoints. Each player supplies a starting view, a text prompt, actions and a camera path, and the generated videos stay consistent wherever views overlap. Rather than every player attending to every other, communication runs through player, group and global levels with shared group tokens and grouping based on recent camera paths. Trained on four players, it runs on 6, 8 or 10 without retraining, and at ten players the authors report 61.9% lower DiT latency and 86.1% fewer self-attention FLOPs than fully connected attention, self-reported. Apache-2.0 code and weights.
View project ↗Long Video MemoryCornell, UC Berkeley, Harvard and Impossible Inc.
MosaiChunk
A memory method for autoregressive video generation past a frozen generator's context window. Instead of retrieving whole past chunks, it splits each chunk's key-value cache into sections with descriptors held in CPU memory; the newest chunk queries those descriptors and assembles the best-scoring sections into a mosaic within a fixed memory budget. Only the descriptor encoder is trained, by self-distillation with no ground-truth video. Tested on MiniMax-H3 and LingBot-World-Infinity with a new RememBench benchmark, it reports 0.899 CLIP with one chunk of memory against 0.841 for two-chunk whole-chunk retrieval, self-reported. Paper arXiv 2610.02153 (1 October), code 8 October.
View project ↗Persistent World FilmmakingZhejiang University, Monash, UC Berkeley BAIR and Adelaide University
ATAS
Any Time, Any Space keeps one persistent world behind a multi-shot film. A compiler turns a screenplay into shot requests, each with a location, camera and event time, and before each shot it pulls context from a scene memory of static geometry in a shared frame and an event memory of time-indexed observations. Each generated clip is reconstructed and updates the world only if validation passes. Across four video backbones (MiniMax-H3, Wan 2.7, HappyHorse 1.0 and Wan 3.0) it posts the highest multi-shot average, for example 0.734 against 0.648 for ReCA on Wan 3.0, though it trails ReCA on VBench with Wan 2.7, self-reported. MIT code (repo created 12 October), arXiv 2610.20571.
View release ↗Causal World StreamingTingting Liao
Streaming Code World Model
A streaming rebuild of Code World Model (week 35), released 12 October, that generates 0.71-second chunks causally from the start image, the proxy so far and earlier chunks with no access to future frames. It uses a sliding six-chunk attention window, diffusion forcing with a noisy history to slow drift, and 4-step DMD self forcing that runs 9x faster than 35-step sampling. On four held-out 17-second CARLA clips the 4-step model scores lower pixel error than the 35-step baseline. It takes 5.1 seconds per chunk on one H200 with about 108 to 123 GB of memory, and the author says it is not real time yet. LoRAs for MiniMax-H3 on Hugging Face; no licence file, results from four clips.
View repo ↗AI Video EditorMartinDelophy
Timeline Studio
A browser-based, local-first video editor with a CapCut-style multi-track timeline that people and AI agents edit together, with models running in the browser on WebGPU or WASM: Kokoro and Piper voiceover, Stable Audio 3 Small music, Whisper captions, watermark removal, 4x restoration, vocal separation and a LivePortrait-based talking avatar. v1.0.9 on 13 October lets agents run relighting analysis and depth-video conversion through WebMCP tools with review and undo, and 17 October updates added in-browser denoising with RNNoise and DeepFilterNet3. The Anna cloud edition is a separate hosted product. MIT, 857 stars.
View repo ↗Explainer Video AgentAlisa0808
Vox Director
An agent skill that turns a one-line topic into a finished Vox-style paper-collage explainer or ad: a beat map, a style bake-off, keyframe posters with Nano Banana 2, animation with Gemini Omni Flash or Kling O3 Pro, xAI narration, MiniMax music and ffmpeg assembly with captions, with two human approval gates before generation. It can also restyle a talking-head video or build collages around one still photo, and since 5 October adds a lip-synced on-camera presenter using Seedance 2.0. Runs on the paid Atlas Cloud API. A similar Vox generator under Anil-matcha appeared eight days after this one. MIT, 2,335 stars.
View repo ↗Style-Matched Video Agentsedenfunf
ReelMimic
Give it a reference video, from a file, a phone recording or a YouTube link, and a one-line brief, and it makes a new 2D animated video in the same style. It first analyses shot count and lengths, tempo, transitions, colour, framing and camera moves, then shows a storyboard and style frames for approval, after which up to six Claude Code or Codex agents build shots in parallel, each reviewed by a different agent with before and after screenshots required for every fix. Seven drawing engines include HyperFrames motion graphics and watercolour. A 30 to 60 second video takes 1 to 3.5 hours on your plan. MIT, 3,633 stars, created 28 September.
View repo ↗Animation EngineAcadema Labs
ManimGX
An animation engine for maths and 3D videos built for coding agents, released 7 October. It accepts Manim Community Edition's Python API but renders on a Rust and wgpu GPU core, installs with pip on Python 3.13 with fonts, typesetting and encoding bundled, can be set up by giving Claude Code, Codex or Cursor its llms.txt, and also runs in the browser. Academa says five 1080p60 scenes totalling 36.2 seconds rendered in 3.08 seconds on an M4 Pro, 90.6x faster than ManimCE and 11.5x faster than ManimGL, self-reported. v0.1.1, MIT, 1,821 stars.
View repo ↗Math Animation3Blue1Brown
Manim
Moved from Week 8 2025: Grant Sanderson's Python animation engine for explanatory maths videos, used for the 3Blue1Brown channel and now a common render target for LLM-generated maths explainers. Scenes are written in code and render to video with precise vector shapes, LaTeX and camera moves. There has been no tagged release since v1.7.2 in December 2024; a September 2026 commit added VideoMobject and Sprite classes. This week brought a faster Manim-compatible engine, ManimGX. The community edition, ManimCE, is a separate project. MIT, 95,309 stars.
View repo ↗Motion Graphics SkillTejashmakwana
motionmaxxing
An agent skill, released 6 October, for coding agents that make launch films, product promos, brand stings and kinetic-type videos, aimed at removing the slide-deck look of AI motion graphics. The author says 53 frame-accurate professional clips were broken down by six AI analyst agents, with human review, into about 150 designer rules, and the skill ships checks that fail work on corner labels, deck layouts, typed-out headlines and runs of dead frames. The README shows before and after versions of the same brief, which are the author's own comparisons. Early release, Apache-2.0, 875 stars.
View repo ↗Seedance Prompt LibraryLearnPrompt
Awesome Seedance
A prompt library for ByteDance's Seedance 2.5 and 2.0 video models (covered in weeks 20 and 31) with 851 cases traced to their original posts, 495 cross-model retest runs, 27 copy-ready templates by clip type such as UGC creator reviews, and about 80 installable AI-video skills for coding agents. It is synced daily from the goodcase.ai case site, in English, Chinese and Japanese, and its templates are meant to be filled in, refined in any chat model, then pasted into Dreamina or Jimeng. Counts change daily. MIT, 2,139 stars, last synced 18 October.
View repo ↗Facial Performance Maskssirioberati (TEIN AI)
Emotion Control
A pipeline, released 14 October, that pulls an actor's facial performance out of a video as a glossy clay mask, so a video model can redraw the face while keeping the expression. It tracks 478 landmarks and shot boundaries, fits expression and geometry with SPECTRE and FLAME, adds grayscale eye and mouth detail and crease shading, and renders a 512x512 mask MP4 that keeps the original audio; the examples feed these masks to Seedance with a separate appearance reference. No video model or paid API is bundled. The wrapper is MIT, but FLAME 2020 is research-only and SPECTRE is CC BY-NC-SA, so the full stack cannot be used commercially. 31 stars.
View repo ↗