Adobe plans generative AI video editing tools for Premiere Pro

Creative software developer Adobe Inc. is rolling out three new generative artificial intelligence tools for its video editing software, Premiere Pro. It is designed to assist video editors in their creative workflows and is expected to be released later this year.

The new tools will join Adobe's existing AI models. Firefly model familyuses generated AI within Adobe Creative Cloud and several other products from Adobe Express to enhance creative design expression. For example, using Firefly in Photoshop, you can use text-to-image conversion to create art that fills or changes images depending on what the user types.

New video tools extend generation to lengthen clips, add and remove objects within the video, and add text to video generation.

“Adobe is reimagining every step of the video creation and production workflow to give creators new power and flexibility to realize their vision,” said Ashley Still, senior vice president of Adobe's Creative Products Group. states.

Generative Augmentation allows editors to seamlessly enhance video clip content using generative AI models, making it easy to move from one clip to another. This feature is useful for viewers because it solves problems that an editor routinely encounters when trying to combine different clips, and he needs to edit them together if one clip becomes shorter. It will help you resolve the issues that cause you an unpleasant experience.

Adding and removing objects allows editors to easily select and track objects in a video scene and replace them with anything using text prompts. This makes it easy to remove unnecessary items or change an actor's wardrobe without advanced editing. You can also use the same tools to change or add set dressings such as paint or photo-realistic flowers.

Text to video allows you to generate brand new footage directly within the Premiere Pro app using text prompts or uploaded reference images. These short clips can be used to storyboard, create B-roll, or add action footage.

“By embedding generative AI innovations deep into the core Premiere Pro workflow, we are solving real pain points that video editors experience every day, while giving editors more space to focus on their work,” said Still. added.

Some of Firefly's generative AI capabilities are already integrated into Premiere Pro, including the ability to change the color scheme of existing footage, generate royalty-free custom sounds and music, and automatically generate custom font overlays for logos and title cards. there is. New features will be added to these existing features and extended to the ability to generate new videos from scratch.

The new Firefly-generated AI video models represent Adobe's response to video-generated AI models in the industry, including: OpenAI Sora and Runway AI Co., Ltd.model. You can create short video clips from user prompts. The company also previewed its vision to integrate third-party models from OpenAI, Runway, and Pika Labs into its video editing software as part of its plug-in ecosystem, giving creators the opportunity to create their AI videos. Did.

Image: Adobe