Luma AI, an a16z-backed company specializing in AI video and 3D models, has released Ray3 Modify, a new model that allows users to modify existing footage using character reference images while preserving the original performance. Users specify start and end frames to generate transition footage to address storage challenges in creative studios.
Ray3 Modify tackles the problem of preserving human performance during AI-based editing or effect generation. This model closely follows the input footage, allowing studios to employ human actors for creative or brand production. In particular, the actors' original movements, timing, gaze, and emotional expressions are preserved when transforming scenes.
The user enters a character reference to change the human actor's appearance to the specified character in the footage. This process preserves details such as costumes, likeness, and identity throughout the shoot. Such features ensure consistent visual elements throughout the sequence without additional filming.
Creators also provide starting and ending reference frames to create video segments using Ray3 Modify. This feature is useful for directing smooth transitions and specifying character movement and behavior. Scene-to-scene continuity remains intact, supporting complex narrative structures in video projects.
“Generated video models can be incredibly expressive, but they can also be difficult to control,” said Amit Jain, co-founder and CEO of Luma AI. We're excited to introduce Modify, which means creative teams can capture a performance with a camera and instantly modify it anywhere imaginable, change costumes or even reshoot the scene using AI without recreating the physical shoot.”
This model is integrated directly into Luma's Dream Machine platform, giving users immediate access. Luma is positioning itself against competitors such as Runway and Kling in the AI video generation space. The company introduced its first video modification feature in June 2025.
The release follows a $900 million funding round announced in November led by Humain, an AI company owned by Saudi Arabia's Public Investment Fund. Existing investors a16z, Amplify Partners, and Matrix Partners participated in the round, providing significant funding for expansion.
Video: Luma
Luma plans to work with Humain to build a 2GW AI cluster in Saudi Arabia. This infrastructure initiative supports expanding computational resources for advanced AI video and 3D modeling operations.
Featured image credit
