Adobe Firefly adds prompt-based video editing and third-party AI models

AI News


Adobe updates its AI video generation app Firefly with a new video editor that enables precise prompt-based editing and introduces new third-party models for image and video creation, including Black Forest Labs' FLUX.2 and Topaz Astra.

Previously, Firefly relied solely on prompt-based generation, requiring users to recreate the entire clip if any part didn't meet expectations. The new editor allows users to change specific video elements, colors, and camera angles using text prompts. A new timeline view lets you easily adjust frames, sounds, and other features.

The company announced the new video editor during a private beta in October, and it's now rolling out to all users.

This update leverages Runway's Aleph model to allow users to give Firefly specific instructions such as “change the sky to cloudy to reduce contrast” or “zoom in a little on the main subject.”

Adobe's Firefly Video model now allows users to upload a starting frame and reference video for a specific camera motion, describe it, and recreate that angle in their own projects.

Additionally, Adobe has confirmed that users can utilize Topaz Labs' Astra model to upscale videos to 1080p or 4K. Black Forest Labs' FLUX.2 image generation model is also coming to the app, along with collaborative board functionality.

FLUX.2 will be available immediately on Firefly on all platforms, but Adobe Express users will have access to this model starting in January.

Adobe is responding to competitors who have recently released advanced image and video generation models and aims to increase user engagement with these updates.

To this end, Adobe has announced a special offer. Subscribers to Firefly Pro, Firefly Premium, 7,000 Credits, and 50,000 Credits plans will receive unlimited generations from all image models and Adobe Firefly video models in the app until January 15th.

This year, Adobe made significant updates to the Firefly ecosystem. These changes include the introduction of a subscription service in February that offers users different levels of generation capabilities. Later this year, the company released new Firefly web and mobile applications in addition to integrating support for more third-party models.



Source link