Luma AI has added a “Modify Video” function to its Dream Machine application. This will change the short video clip and turn new takes into new backgrounds, textures, lighting, characters, and more.
Luma AI can work up to 10 seconds of video clips, allowing you to “keep what matters and evolve everything else.”
Modify Video uses advanced performance signals such as poses, facial expressions, lip syncs, and scene structures to understand what to store and rethink. You can guide the output with a visual reference, the first frame image, or a prompt.
According to Luma AI, whether you're working on Previs, Pitch Decks or Final Renders, “you don't have to start from scratch again.”
It retains video change motion and action, provides multiple output variants, and allows visual control of output. You can choose from three presets to define how far the conversion will take.
The three presets are:
I'll glue it
It follows closely to the appearance and structure of the original video, and primarily prioritizes retexture.
flex
A balance between input fidelity and model creativity for controlled transformations while maintaining key elements.
I'll reconsider
Allows full scene reinterpretation, including mapping humans to non-human forms such as monsters, creatures, and surreal entities.
