Adobe today announced that it is bringing content-aware fill to After Effects, the special effects software that is part of its Creative Cloud offering. The company has long offered this feature in Photoshop, where you can use it to automatically remove objects from a photo, with the application filling in the blank space with appropriate pixels, based on what’s around it. As you can imagine, doing this for a video is significantly harder because you have to do this for every image while the objects move.
The company notes that this new feature is powered by Adobe Sensei, the company’s AI platform. To remove an object (or maybe a stray boom mic) from a scene is to mask it. If everything works as planned, the tools will automatically track the object through a scene (even when it moves behind another object for a bit) and replace it with more suitable pixels. If you need to fine-tune the result, you can also use Photoshop to create reference frames.