Runway announces Aleph, a new AI model for editing and converting videos: how it works

AI Video & Visuals


The artificial intelligence company Runway has launched Aleph, a new video-to-video generation model. This allows users to edit and convert elements in existing video footage using simple text prompts. The company revealed the model on Friday, noting that it will initially be available to corporate and creative customers before it becomes more widely deployed.

Named after the first letter of the Hebrew alphabet, Aleph is designed to allow for a wide range of video changes. These include adding or removing objects, changing the style and settings of the scene, generating new angles, and creating future frames for clips in progress. This tool also allows you to adjust factors such as time of day without affecting the lighting, weather, seasons, and the rest of your visual content.

New York City-based Runway described Aleph as a cutting-edge contextual video model. According to a company's statement on social media, users can guide their editing simply by explaining the desired changes in natural language. For example, a park video on a sunny day can be rethinked with snowfall or converted into nighttime scenes while maintaining the integrity of the original elements.

Another feature of the model is its ability to generate new perspectives for existing images. Users can request a variety of camera angles, including wide range of shots, close-ups, and tracking shots from different directions. You can also extrapolate the video sequence to continue the movement and story beyond the original clip.

Additionally, ALEPH supports object-level manipulation, such as replacing buildings, removing reflections, adjusting character appearances, and transferring motion patterns such as replicating drone flight paths across different environments.

The company demonstrates the potential of the model in its blog post, but some technical details remain unconfirmed. These include supported video lengths, compatible aspect ratios, pricing, and whether they are ultimately accessible to free tier users. Runway doesn't show a solid timeline to fully build availability.

The release of Aleph marks another step in developing video tools with AI. This is increasingly integrated into mainstream media workflows. Runway's existing technology is already in use in professional settings, including key content producers.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *