While OpenAI's upcoming AI video generation tool Sora has creators both enthralled and terrified at the same time, a new player has many AI enthusiasts raving about its capabilities: Kling, a TikTok rival from Chinese tech giant Kuaishou, is already available, but with some caveats.
Kling's capabilities surpass those of the competition in several key ways: Kling can generate up to two minutes of video at 1080p resolution and 30 frames per second, a significant improvement over Pika and RunwayML, which can only generate a few seconds each, and double the amount OpenAI predicted Sora could process.
OpenAI's Sora is amazing.
But KWAI just released a Sora-like model called the KLING, and people are going crazy for it.
Kling comes on the heels of the release of Vidu, another Chinese AI video creation tool developed by Shengshu Technology and Tsinghua University. Vidu generates short videos, but it can create highly realistic and detailed videos using Universal Vision Transformer (U-ViT) technology, which has already proven to be better than Runway and Pika.
Meanwhile, Kling uses advanced 3D face and body reconstruction techniques to generate realistic movement and limb movements based on a single full-body photo, while also avoiding other issues such as extra limbs and impossibly bent limbs that often occur when some AI video generators portray people.
Video generation AI has evolved to this extent.
“Kling” is an amazing video generation AI with quality comparable to Sora…
— Shota Kiuchi @SHIFT AI Representative “Let's make Japan an AI advanced nation” 𝕏 (@shota7180) June 9, 2024
Like Sora, Kling also has a deeper understanding of real-world physics, allowing it to more accurately simulate physical interactions between objects. It is also designed to precisely follow prompts and create sequences of shots with multiple views, allowing you to create more complex and dynamic videos.
Image: Kling/Kuaishou
Kuaishou published a series of demo videos showing how Kling renders scenes that OpenAI demonstrated in Sora. The videos are highly realistic, with excellent scene composition and movement. The quality is better than Runway and Pika in terms of realism and consistency, and is on par with Sora, and in some generations even surpassed it.
Other users have been sharing other works on social media that seem compelling enough to justify the buzz.
Cute black and white border collie with head sticking out of a car window, fur flying in the wind, tongue out and smiling pic.twitter.com/6cuJbPqsxB
Kling is currently available in China as a public demo via a waiting list, but Kuaishou is promising a wider global release.
The Kling website is in Chinese, and registration appears to require a Chinese phone number. You also need to download the Kwaicut app and follow the instructions listed on the official Kling-AI website before you can secure your spot.
Until then, the best options for those looking to generate AI videos are Pika Labs, RunwayML, and for local generation, Stable Video Diffusion.
Editor: Ryan Ozawa.
Generally highly intelligent Newsletter
A weekly AI journey narrated by generative AI model Gen.
