Adobe continues to fulfill its promise to bring third-party AI models to the Firefly Ecosystem, adding Luma AI's latest generation video model, Ray3, to Firefly.
Adobe Firefly is Luma AI's Ray3's first launch partner and will be available in the coming weeks only on Luma AI's Dream Machine Platform and Adobe Firefly. Luma Ai made the headline after improving Dream Machine last November.
Alongside Firefly's own generated video model released last October with a mixed review of Luma AI's Ray3, users can generate video clips from scratch. The Ray3 promises “cinematic, high quality video” clips up to 10 seconds, and is one of the first AI video models to support native high dynamic range (HDR) video generation.
“Built on a new multimodal inference system, Ray3 can better understand the creative intent of users and provide production-ready assets in a variety of complex situations, including motion blur, crowds, preserved anatomy, physics simulation, and world exploration,” writes Adobe.
Luma AI CEO and co-founder Amit Jain says Ray3 was designed with film storytellers and filmmakers in mind.
“Ray3 is built with the Center's filmmakers, storytellers and creators, and this integration with Adobe Firefly makes that vision realistic,” says Jain. “By combining Adobe's Creative App Ecosystem with Ray3's intelligence, we offer creators the ability to move from ideas to film video in seconds with professional grade quality and control. This partnership isn't just about workflows.
Within Firefly, users can quickly generate Broll or Background footage in RAY3 using simple text prompts. Adobe and Luma Ai argue that this is a good use case for content creators who need to fill in the gaps or add a little more narrative depth to their videos, especially for social media content.
Filmmakers can use Ray3 on Firefly boards to explore visual orientation and storyboards before they go out to capture the desired real-world footage.
“It's easy to generate environments, shot composition and camera perspective during storyboards and planning scenes,” Adobe writes. “Whether you're chasing bustling cities or imagining quiet moments in a distant landscape, Ray3 helps you quickly prototype your vision.”
Everything created using Ray3 within Firefly can be synced with Adobe Creative Cloud, allowing users to bring to other Adobe apps such as Premiere Pro, and to other Adobe apps for further improvements and editing.
Like any content generated within Firefly, videos generated using Ray3 contain content credentials, so you can see which AI models are being used.
The Ray3 model of Luma AI is now available within Adobe Firefly. Paid Firefly and Creative Cloud Pro subscribers will receive unlimited generations using RAY3 until October 1st.
Image credits: Adobe, luma ai
