Adobe Confirms Its New AI-Powered Video Generation Tool Launching By End Of 2024

Adobe has announced plans to roll out its upcoming Firefly Video Model within the popular video editing platform Premiere Pro later this year. The model, designed to be commercially safe, helps creatives overcome common editing challenges. The new model will introduce three key capabilities: text-to-video, image-to-video, and generative extend.

These features generate dynamic video, allowing editors to fill gaps in their timelines, quickly ideate on their creative vision, and add new elements to existing footage.

“The Firefly Video Model is designed to be commercially safe and is only trained on the content we have permission to use – never on Adobe customer content,” the company said.

With the Firefly text-to-video feature, creatives can use text prompts, a wide variety of camera controls and reference images that create a B-roll that fills gaps in the timeline. This feature can also generate inspiration for motion graphics, explore ideas for unique visual effects and develop elements for pre-visualisation.

One can use the image-to-video feature to bring the still shots or illustrations to life by transforming them into live-action clips.

The generative extend feature lets editors extend AI-generated footage to cover gaps in footage, smooth out transitions or hold on shots longer for perfectly timed edits.

“Building upon our foundational Firefly models for imaging, design and vector creation, our Firefly foundation video model is designed to help the professional video community unlock new possibilities, streamline workflows and support their creative ideation,” Ashley Still, senior vice president, Creative Product Group at Adobe, said in a statement.

Firefly Video Model will be available in beta versions later this year, with the new features accessible via Adobe’s Firefly website, firefly.adobe.com. The generative extend feature is integrated directly into Premiere Pro.

Adobe Firefly, launched in March 2023, has expanded to include a generative AI image model, vector model and design model over the years. The addition of this video tool will be another feather in the cap for Adobe Firefly.