– 56 seconds ago
Runway AI has announced the latest version of its video generator called Gen-2. Unlike Gen-1, no sample images or videos are required. Instead, it’s a text-to-video tool that creates videos based on short descriptions. As a result, it could revolutionize the way videos and movies are made.
Runway Gen-2 also adds a number of new features to the video generator. For example, you can place a background or other object that blends in with the original image. More importantly, you can train a custom AI video generation model for your specific project. As a result, we were able to smoothly incorporate Runway AI into our operations.
This article describes the announced features of Gen-2. Later, I will discuss other text-to-video programs and similar AI programs. Note that it is not published at the time of writing. Join the Runway AI Discord channel to find out when the latest version is released.
What are the features of Runway AI Gen-2?
Photo credit: research.runwayml.com
- Text to video: Create a video by providing a text description.
- Text + Image to Video: Generate videos based on images and text descriptions.
- Image to video: Produce your video using only sample images.
- Stylization: Use a sample photo to show how Runway AI renders your clip. For example, the demo video showed how a clip of a man dancing would change. The program referenced a picture of a flame monster, so the dancing man looked like that.
- Storyboard: Create a stylized animated rendering of your mockup. For example, the runway demo showed how a top-down view of a cereal box transforms into a cityscape as far as the eye can see.
- mask: Isolate the subjects to make sure Runway AI only edits them. For example, the masking feature allowed users to change the dog’s fur without affecting the rest of the video.
- give: Convert textureless 3D renderings into detailed output. For example, you can turn a crude 3D model of a diver into a near-realistic clip.
- Customization: We can provide more samples and detailed explanations for better results.
What are the limitations of AI Video Generator?
Photo credit: digitaltrends.com
An obvious problem with AI video generators like Runway is that they don’t produce realistic images. Check out the Runway AI sample. Video is always changing.
My skin seems to keep “vibrating” while the video is playing. The jerky aesthetic could be due to the AI video generator rendering each second of the clip.
Combining these AI renders seems to produce unnatural textures in the AI video. The same goes for Meta’s text-to-video generator.
We announced our Make-A-Video tool in September 2022, but have not published the program. Meta’s samples show that it can produce “superhero dog flight” or “horse galloping”.
However, the output of Meta and Runway AI seems too rudimentary for practical use. Some seem too basic, others seem awkward and awkward.
These text-to-video tools may produce better results after further research. When that happens, it will change the way videos are created.
In the meantime, try out new AI features in popular video editing software. For example, Adobe has launched text-based editing for Premiere Pro.
You may also like: How to use Midjourney’s image-to-text feature
Automatically transcribe your video dialogue into editable text and add it to your timeline. As a result, you can easily look for specific parts of the video by searching for specific keywords.
You can also copy and paste phrases from the sequence transcript. Adobe AI will change the timeline accordingly. As a result, you can get a rough cut and create captions quickly.
Additionally, Adobe has added automatic tone mapping to allow you to work with different media and color spaces without custom color settings. Converts gamut from log format to properly display standard sequences.
Conclusion
Runway AI has announced the latest version, Gen-2, which adds new features. These include turning unfinished mockups into stylized renderings and expanding customization options.
The AI company has not disclosed when it will release Gen-2 at the time of writing.However, join the Runway AI Discord at discord.com/invite/runwayml to find out when the new tool launches. I can.
Follow Inquirer Tech for the latest digital trends. Additionally, we provide tips on how to use artificial intelligence, augmented reality, robots, and more.
