Adobe has integrated proprietary Firefly models and third-party generated AI models into Adobe Premiere Pro. Users can extend clips, remove objects from videos, generate missing B-roll, and add new objects.
An example of AI-generated B-roll. (Image credit: Adobe).
Main highlights
- AI tools are designed to work with existing rushes.
- Generative AI lets you extend clips that are too short.
- You can create B-roll using text prompts, reducing your reliance on stock sites.
New Delhi: Adobe has announced plans to integrate generative AI tools into its video editing software Premiere Pro. Generative AI capabilities are integrated into existing workflows and extend the functionality of the software in a natural and intuitive way. The new Firefly model for generated video joins the existing model lineup for vector, image, design, and text effects.
Apart from its own video models, Adobe also supports third-party generated video models using OpenAI's Sora and Runway's RunwayML to generate videos using text prompts. Pika integration lets you extend your clips by a few seconds. Adobe has released a video demonstrating its capabilities and seamless integration into existing interfaces for generative AI tools.
said Ashley Still, senior vice president of Adobe's Creative Products Group. By embedding generative AI innovations deep into the core Premiere Pro workflow, we're solving real pain points that video editors experience every day, while giving them more space to focus on their work. ”
Rather than having a single generative video model that outperforms other models in benchmarks, Adobe envisions a future for generative AI where multiple models have unique strengths. Adobe has shown that it intends to give video editors as much choice as possible, and that's the reason behind integrating multiple third-party generative AI tools.
AI-powered audio workflow
Adobe will also release an AI-powered audio workflow next month with interactive fade handles for creating custom audio transitions and audio enhancement tools to clean up background audio and improve low-quality recordings. They also announced plans to do so. AI also automatically classifies audio clips as dialogue, music, sound effects, or ambience. Waveforms have been redesigned and effects badges have been added to indicate which clips have audio effects.
Follow us on social media
