In February of this year, OpenAI released Sora, a video generation model that can create one-minute high-definition videos. Although Sora is not yet accessible, another text-to-video generation model seems to be attracting attention. Kuaishou Technology, a Chinese company known for its short video platform, has announced a text-to-video generation model called Kling.
Kling reportedly uses technology similar to Sora and can produce 1080p high definition videos up to two minutes long. The model is capable of creating large-scale, realistic movements that essentially simulate properties of the physical world.
The company released a demo video on Thursday showcasing its video-making capabilities, which it says are accessible to anyone and can, in some cases, produce videos that far surpass Sora's accomplishments.
The Kling video model was independently developed by Kuaishou's LLM team and is currently available to test via invitation on Kuaiying app, Kuaishou's video shooting and editing app.
Several AI enthusiasts shared videos they created with Kling on X. The model produces videos up to 2 minutes long at 30fps quality, while Sora has only been able to produce videos of 1 minute so far. Based on the samples posted on X, the videos generated by Kling appear to accurately simulate real-world physics.
It is important to note that Kling is not the only text-to-video conversion model from China. In April, Vidu AI, a text-to-video conversion model that can create 16-second videos in 1080p, was released in China. Kling is based on the Diffusion Transformer architecture and is said to be able to convert text prompts into vivid visuals.
https://platform.twitter.com/widgets.js
Kling models use advanced 3D face and body reconstruction technology powered by the company's proprietary 3D VAE technology, allowing users to create videos in different aspect ratios, made possible by variable resolution training, delivering full facial expressions and limb movements from a single full-body photo.
AI model development seems to be accelerating in China, and Kling seems to be a testament to that rapid growth. ChatGPT maker Sora is likely to face stiff competition in China.
© IE Online Media Services, Inc.
First uploaded: 06 July 2024 15:43 IST
