sirioberati (TEIN AI) · Facial Performance Masks

Emotion Control

A pipeline, released 14 October, that pulls an actor's facial performance out of a video as a glossy clay mask, so a video model can redraw the face while keeping the expression. It tracks 478 landmarks and shot boundaries, fits expression and geometry with SPECTRE and FLAME, adds grayscale eye and mouth detail and crease shading, and renders a 512x512 mask MP4 that keeps the original audio; the examples feed these masks to Seedance with a separate appearance reference. No video model or paid API is bundled. The wrapper is MIT, but FLAME 2020 is research-only and SPECTRE is CC BY-NC-SA, so the full stack cannot be used commercially. 31 stars.