Netflix has open-sourced VOID, an AI system that erases objects from video and also rewrites what they did to the scene, such as collisions.
Netflix researchers built it with INSAIT Sofia University on Alibaba's CogVideoX, using Gemini to find affected areas and Meta's SAM2 to cut objects out, with an optional pass to fix warped shapes.
It is out under Apache 2.0, so studios and others can use it commercially.
Sources · 1