Luma AI, a leader in multimodal artificial intelligence technologies, launched Ray3 Modify, an advanced model that redefines how creative teams integrate real human performances with generative AI. Designed to support hybrid AI workflows for acting and video production, Ray3 Modify is now available on the company’s flagship Dream Machine platform, empowering brands, studios, and filmmakers with greater control, continuity, and creative intent in AI-assisted storytelling.
Ray3 Modify brings a powerful suite of tools including Keyframe Control, Character Reference, and a significantly enhanced Modify Video pipeline that enables creators to edit and reimagine recorded footage while preserving the integrity of human-led performances. These innovations directly address longstanding limitations in AI video generation related to maintaining timing, motion, and emotional nuance.
Rather than relying on text prompts alone, the new model conditions generation on real world input such as camera footage or live acting allowing AI to follow physical movement, shot framing, and emotional delivery with high fidelity. This results in predictable and repeatable workflows that maintain narrative continuity while enabling intentional changes to environments, costumes, cinematography, and visual style.
Also Read: Wondershare Unveils EdrawMax V15: A New Chapter for AI-Powered Diagram Creation and the Generative AI Industry
“Generative video models are incredibly expressive but also hard to control. Today, we are excited to introduce Ray3 Modify that blends the real-world with the expressivity of AI while giving full control to creatives,” said Amit Jain, CEO and co-founder of Luma AI.
“This means creative teams can capture performances with a camera and then immediately modify it to be in any location imaginable, change costumes, or even go back and reshoot the scene with AI, without recreating the physical shoot.”
Core Capabilities Built for Professional Production Pipelines
Ray3 Modify introduces several industry-focused enhancements crafted for hybrid AI video production workflows:
- Keyframes (Start & End Frames): Enables creative teams to define precise start and end points for transitions, maintain spatial continuity across complex scene moves, and guide character behavior across shots.
- Character Reference: Allows the application of custom character identities over an actor’s original performance, preserving likeness, costumes, and visual identity throughout a clip.
- Performance Preservation: Maintains an actor’s original motion, timing, eye line, and emotional delivery as the foundation of a scene, even as visual elements evolve.
- Enhanced Modify Video Pipeline: New architecture boosts adherence to real-world motion and composition, enabling intentional edits that respect continuity and identity.
These capabilities position Ray3 Modify as a robust solution for creative professionals in film, visual effects (VFX), advertising, and post-production workflows seeking AI tools that respect performance integrity while enabling imaginative scene transformation.
