Luma Labs released Dream Machine last week, and the AI startup has already rolled out its first round of upgrades, including the ability to extend clips by five seconds.
Dream Machine can generate photorealistic video and accurate real-world movement in a way previously only seen in the closed OpenAI Sora model and China's Kling AI.
I tested Dream Machine when it was first released and it felt like a good first step. It's a great result (after a 12 hour wait due to demand), but some UI additions are needed and it looks like they've already done that.
The first update is now live, adding the ability to continue clips and make it easier to download videos you've created. Pro users can also remove the watermark.
Dream Machine Extend Launches Today
The ability to extend clips was probably one of the first updates that Luma wanted to release and which is already available to users of the platform. Each generation uses one of the different monthly allotments depending on the subscription.
Coming soon to Dream Machine – powerful editing capabilities and intuitive controls! A preview of the exciting features we're working on. Sign up for #LumaDreamMachine early access and be the first to know when it's ready: https://t.co/UMuEr8tMu7 pic.twitter.com/qrgPC0Nrl4June 17, 2024
Competitors like Pika Labs and Runway have had the ability to extend videos since the beginning, but they had limited success because the longer the video got the more distorted and different it became. Luma promises to be different.
I haven't personally tried it yet, but I did set up a prompt to extend an existing clip, but it wasn't back at the time of posting this article. The process is simple, just click extend clip, give the new motion prompt, and the clip will move.
“Extend is an advanced system that understands what's going on in your video and then follows your instructions to extend the video in a consistent way,” the company wrote to X.
Discover and edit coming soon
Luma says that in the future it will add a new discovery feature to its interface, which will let you explore different video concepts and ideas.
One of the most exciting new features is in-video editing, which is not live but allows you to change the background or foreground of a generated video on the fly, for example replacing one character with another or placing them in a new location.
Today we're releasing Extend video. Extend is an advanced system that knows what's going on in your video and extends it in a consistent way according to your instructions. Share your extended creations (10+ seconds) with #LumaDreamMachine and your top 10 as a reference to this tweet… pic.twitter.com/GqC7KjTcOlJune 17, 2024
This is similar to inpainting in AI image generation and is close to functionality already available from Pika Labs. Having not tried it, I can't comment on the comparison other than to point out that the concept is already available.
We only provide a video clip to demonstrate this feature, but when you play the video you'll see new context menu options, including a way to change the background of any video you create.