Adobe integrates Firefly AI-powered video into Premiere Pro

Adobe has unveiled its latest AI tools at Adobe Max. Generative Extend appears in the beta version of Premiere Pro, powered by Firefly. This allows you to extend clips to close gaps in footage, smooth transitions, or hold footage longer than filmed.

The Adobe Firefly video model, announced last month, has also now moved into public beta. But it’s not a beta like the usual Adobe beta that any Creative Cloud user can download via the desktop app. It’s a public beta, but you’ll need to sign up and get on a waitlist.

Generative Adobe Firefly AI video

The new Adobe Firefly AI Generative Video features are currently still in beta, and although it is a public beta, it is not immediately available to everyone. It is public in the sense that the public can register. However, you will then end up on a waiting list.

But once you’re in, you can create videos up to five seconds long from text prompts. I expect this will be expanded by the time it leaves beta and becomes the final first release, and this isn’t the only limitation either.

Only 720p or 1080p videos in 16:9 aspect ratio can be generated. So if you want 4K you’ll have to try tuning them via Topaz Video AI or something else. It is also limited to 8-bit SDR videos with frame rates between 8 and 30 frames per second. But it offers a lot of control and optimization options.

You can manipulate camera angles, movement and zoom to create custom animations, effects and more. New Firefly AI video features in the Premiere Pro beta include Generative Extend and the ability to animate still images. Adobe says the model builds on the company’s existing Firefly image, vector and design tools. They also say that it is completely safe to use for commercial purposes.

Adobe has expanded on this claim in the past, stating:

Other updates

In addition to the new Firefly AI Video features, Adobe has also optimized Premiere Pro with new context-sensitive property panels, a new Frame.io panel, the new color management we recently posted about, and the usual “faster performance” upgrades that Adobe says , that they are 3x faster – faster than what, I’m not entirely sure.

Photoshop is also getting an AI-powered update with a new automatic image deflection removal, an all-new generative workspace with generative fill, generative expansion, generate similar, generate background and generate image on both the Photoshop desktop and the web.

Not all features of all apps are currently available for download. For more information about the new features and what’s available, visit the Adobe website here for Firefly AI Video and here for Premiere Pro.