Kuaishou, China's second-largest short-video app, has introduced a new artificial intelligence (AI) model called “Kling” that is designed to generate high-quality videos from text prompts (via South China Morning Post).
The move puts Kuaishou in direct competition with OpenAI's Sora and other startups in AI-powered video generation.
(Photo: Image via Kling) Kuaishou unveiled Kling, an AI model that can generate high-quality videos from text prompts, competing with OpenAI's Sora and marking a major breakthrough in AI-powered video creation.
How does the cling work?
Currently in trial phase, Kling can convert text prompts into video clips of up to two minutes in 1080p resolution. The company says Kling supports a range of aspect ratios and can generate both realistic and imagined scenes.
The demo video showed various scenarios, including a white cat running through a city street and a boy eating a cheeseburger.
Kuaishou's Kling is designed to compete with OpenAI's Sora, which was announced earlier this year and is already being used by filmmakers at the TriBeCa Film Festival.
Sora isn't yet widely available, but Kling is available through a waiting list. Other Chinese competitors include Shengshu Technology's Vidu and Zhipu AI's soon-to-be-released video generation tool.
Kling uses a diffusion transformer model similar to Sora to create videos with realistic physics and smooth movement, and Kuaishou claims that Kling can produce videos at 1080p, 30 frames per second, and can support a variety of shot types and aspect ratios.
The model also features advanced 3D face and body reconstruction, improving the accuracy of facial expressions and limb movements.
Related article: Meta launches new AI-powered features for WhatsApp Business
Amazing performance
Kling joins Kuaishou's growing list of AI innovations, including the KwaiYii large-scale language model (LLM) and Kolors text-to-image translation model. The company also offers an AI Dancer feature and is developing image-to-video conversion capabilities based on Kling's capabilities.
According to SCMP, Kuaishou reported a net profit of 4.12 billion yuan (US$575.1 million) in the first quarter of 2024, a significant turnaround from a loss a year earlier.
Revenue grew 17% year-on-year, driven by online marketing services and e-commerce. With about 400 million daily active users, Kuaishou remains the second largest player in the short video app market after ByteDance's Douyin.
It's unclear whether Kuaishou will release Kling outside of China. Making such advanced AI technology available globally could spur competition and innovation, encouraging companies like OpenAI to release them faster and make their models safer and more cost-effective.
In other news
A study by Epoch AI warns that public training data for AI language models could run out by the early 2030s, stalling AI progress.
The remarkable growth of AI in recent years has been driven by larger models and expanding datasets, the study noted, but the internet's supply of high-quality, human-generated text — the lifeblood of AI models like ChatGPT — is not infinite.
Stay tuned to Tech Times for the latest updates.
Related article: Stability AI releases new sound generator called “Stable Audio Open”
ⓒ 2024 TECHTIMES.com All rights reserved. Please do not reproduce without permission.
