Ray3 Modify introduces next-generation hybrid AI workflows for acting and performance, empowering brands and studios to shape scenes with greater control, continuity, and creative intent.
Luma AI introduces Ray3 Modify, a new AI-driven video workflow designed to directly integrate real-world actor performances into advanced generative video production, taking a significant step towards more controllable, film-ready AI visuals. Now available on the company's Dream Machine platform, Ray3 Modify allows creative teams to enhance and transform recorded performances while preserving the timing, movement, and emotional intent of the original act.
This announcement addresses one of the long-standing challenges of AI-generated video: maintaining reliable and consistent human performance during scene editing and visual transformation. By conditioning AI generation to live-action input footage, Ray3 Modify allows brands, filmmakers, and advertisers to collaborate with real actors and use AI to modify environments, styles, and film elements without losing performance authenticity.
Unlike previous AI video systems that rely heavily on text prompts and approximations, Ray3 Modify puts human performers, camera movement, and physical staging at the center of creative direction. The system follows real-world movement, framing, pacing, and emotional expression, reducing guesswork and allowing creators to shape scenes with much greater precision and predictability.
This workflow supports production scenarios where continuity and reproducibility are important, allowing you to reimagine visual aspects such as location, costumes, lighting, and overall aesthetic while keeping the original performance intact. This hybrid approach opens new possibilities for film, television, advertising, and visual effects pipelines by blending live-action capture with AI-driven transformation.
Amit Jain, CEO and co-founder of Luma AI, said: “Generated video models can be extremely expressive, but also difficult to control. Today, we're excited to introduce Ray3 Modify, which blends the expressive power of the real world and AI, with full creative control. It allows creative teams to capture a performance with a camera and instantly modify it anywhere imaginable, changing costumes or recreating the physical shoot without having to re-create the physical shoot. This means we can even reshoot scenes using AI.”
Ray3 Modify introduces several new features aimed at professional production workflows. These include keyframe controls for start and end frames to guide transitions and maintain spatial continuity, character reference tools to lock identity and appearance across shots, and enhanced performance preservation to keep movement, gaze, and emotional expression intact. The upgraded model architecture provides greater consistency in movement, composition, and scene continuity.
These advances position Ray3 Modify as a next-generation AI video tool built for hybrid production, where creative authority begins with human performance and AI acts as an extension rather than a replacement.
