ChatGPT and Midjourney may be pioneers in the AI-powered revolution in chatbots and image creation, but giants like Adobe aren’t left behind. The company behind Photoshop has previewed several new AI tools that could completely democratize video editing.
March introduced Adobe Firefly, the company’s new family of generative AI tools. And now Adobe has previewed exactly how Firefly will power your video, audio, animation, and motion graphics apps. This could include entry-level video editors such as Adobe Premiere Rush and Spark Video.
While the feature is only a preview and not an imminent update, it’s clear how powerful these text-to-image tools can be. These new tools seem particularly suitable for beginners.
For example, one example given by Adobe is the text-to-color extension of video. Enter the desired time period, season, and color scheme for an existing video and apply the desired edits. Even vague prompts like ‘Make this scene feel warm and inviting’ work for Firefly-powered programs.
You are not limited to just automatic color grading. Almost every aspect of video creation – music, sound effects, text, logos, b-roll – is now editable with new AI-powered text boxes like the one we saw on ChatGPT.
The company’s “Meet Adobe Firefly for Video” demo prompts you for “light, adventurous, hilarious music” (just enter your criteria and hit “generate”) to create a royalty-free background for your video. Add a tune Option to add sea foam sound effects to suit the scene.
The time-saving potential of these new AI tools is also evident from the “Generate Captions” demo. This shows that transcripts are analyzed and split into perfectly timed captions for short-form social videos. Similarly, the ‘Find b-roll’ button scans the auto-generated script and drops the appropriate cutaway clip onto the video timeline.
But perhaps the most surprising idea is the “Generate storyboard” button. It scans a written script (albeit with clearer, human-made signposts such as ‘wide shot’ or ‘close up’) and creates a sketch. The entire sequence of shots for you (or your videographer) to follow.
Clearly, these editing concepts are in their early stages, and there is no timeline for them to roll out across Adobe’s programs. And given the state of the AI hype bubble, I’ll reserve judgment until the AI ships in Adobe apps and can be tried in the real world.
But the video creation possibilities are huge, especially for those who create commercial and social media shorts. Given that Adobe’s models are apparently trained on open-licensed or public domain content, Adobe is in a great place to make it all viable. whose copyright has expired.
Analysis: The Power of Prompts
Like the best AI art generators, Adobe’s upcoming Firefly tool for video is not meant to replace genuine creativity or skilled video creators. But it could open up basic video editing skills to a whole new audience and take the usability of apps like Adobe Premiere Rush to a whole new level.
And tools like text-to-color correction and automatic B-roll generation are powerful time-saving factors. If the tool works well, it can greatly reduce the entire video editing process, including music, sound effects, and captions. like a demo.
As with ChatGPT, a key skill required is learning which prompts to use to achieve the desired edit or effect. One of Firefly’s main strengths seems to be its natural language processing and its ability to make sense of ambiguous statements like “This scene makes me feel warm and inviting.” However, you need to know how to describe the look you want. The more specific, the better the final result.
Still, the big change is moving from a world of video editing apps full of arcane symbols and jargon to one with simple text boxes that can make sense of obscure prompts. wider audience.
