- Adobe releases new Firefly video generation models that are better than ever
- Firefly web app now supports non-adobed video generation models like VEO 3
- New Generated Sound Effects Beta app makes it easy to add sound effects to your video
Adobe Direfly has given AI video generation capabilities a timely upgrade. The video model has been upgraded to version 1.9. This gives more realism and accuracy to storytelling. It is currently available through the Firefly web app.
Adobe cites one of the strengths of the new Firefly video model as “generating dynamic landscapes from natural scenery to urban environments. The model also shows atmospheric elements such as animal movement and behavior, weather patterns and particle effects, as well as their outstanding capabilities in mastering both 2D and 3D animation.”
In this example, the video shows a film drone shot between the trees in the snow forest at sunset golden hour.
Adobe is also partnering with other generated video models, allowing you to choose all VEO 3, Luma, Runway, and Topaz from within the Firefly web app.
Generate sound effects (beta)
As part of The New Firefly, there is also a new beta version of Generate Sound Effects to create custom, high-quality audio from a text prompt or audio queue.
It involves creating audio sounds that are close to the kind of sound effects you want in your video, then resolve the type of sound you really want to add. So, in the beach scene, when you start making “kaaw! kaaw!”, the noise, AI wants to have the sound of seagull.
I tried using the voice cue method and it certainly made everyone in the office think I was mad! Here is an example of how it works:
More video enhancements
You can use Firefly to create AI-generated videos from either a text prompt or a reference image, but you can also upload a reference video, and Firefly generates new videos that transfer the original configuration to the generation. The new video model has a new level of precision control when directing video content.
Additionally, several styles of presets are available, allowing you to apply a clear visual style with just one click. Available presets include clay quality, anime, line art, and 2d.
Finally, there is keyframe trimming. You can upload the first and last frames, choose how to crop the image, explain the scene, and Firefly generates a video that matches the format.
