Adobe
On Monday, Adobe announced plans to add AI video compositing tools to Premiere Pro and After Effects, reports Reuters. This follows last week’s announcement that AI-powered text-based video editing will be coming to Premiere Pro in May.
Adobe’s Generative Video Effects courtesy of Adobe Firefly. Firefly, the image compositing mode previously covered in March, will be expanded to include video and audio generation tools. Premiere Pro is Adobe’s flagship video editing application and a popular industry tool for assembling television shows and Hollywood movies.
Performing certain special effects and editing tasks today is often labor intensive. Adobe aims to streamline that process with generative AI assistance. A demo posted on Adobe’s blog In his reel, Adobe claims that “Firefly for Video” generates a background soundtrack, generates sound effects, changes the visual season of the video, and mentions the word “molten.” created a visual effect to demonstrate identifying and brightening a person’s face. , and generate audio his transcripts via text commands.
In a promotional blog, Adobe mentions features you might expect from the new AI tool. This includes some of the above (such as generating sound effects and music), but also text-based color enhancement, text and logo animation, automatic storyboard creation, and creative features. A co-pilot who could possibly generate a how-to to help users master their editing skills.
The reason these kinds of text-based video editing tools look familiar is because Runway hinted at similar features back in September, but Runway has yet to deliver on those promises with the fidelity previewed in the teaser. No. Similarly, it would be wise to tolerate Adobe’s marketing videos until the product is released.
(And only time will tell if Adobe Firefly can produce a video of Will Smith eating spaghetti that rivals the masterpiece devised by ModelScope, an open-source video compositing model.)
In another related announcement last week, Adobe announced it would be integrating text-based video editing into Adobe Premiere Pro. This allows editors to trim and rearrange videos based on auto-detected transcripts of speech pulled from video clips. Adobe describes this feature as follows:
Premiere Pro is the only professional editing software to incorporate text-based editing, revolutionizing the way creators approach their work by making video editing as easy as copying and pasting text. increase. Powered by Adobe Sensei, Text-Based-Editing automatically analyzes and transcribes clips so editors, producers, and assistants can copy and paste sentences in any order as they appear on the timeline. you can see it instantly. You can search the minutes in the minutes window to identify the exact word or phrase.
Adobe originally previewed similar text-based video editing features as part of “Project Blink” in October, but now Adobe says these features come from the “Adobe Sensei” framework. It is unclear if the difference is technical or just branding. It’s worth noting that a company called Descript offers similar functionality for video and podcast editing.
Adobe says the Firefly for Video feature will start rolling out “later this year,” and you’ll be able to sign up to try Firefly, which is currently in closed beta testing. Meanwhile, Adobe promises that text-based video editing will come to Adobe Premiere Pro in May.
