As China grapples with a declining birthrate and population, it has introduced new rules to prevent technology companies from developing AI chatbots that encourage psychological addiction in users. The move comes amid growing concerns that AI companions could replace real-life human relationships in the country. The issue echoes warnings from Tesla CEO Elon Musk, who has repeatedly raised concerns about falling birth rates and population collapse.
China bans AI chatbots from promoting emotional dependence
New rules that went into effect last week prohibit AI chatbots designed for companionship from encouraging emotional dependence on users. The regulations also prohibit hypothetical romantic relationships with minors. Companies should also alert a user’s emergency contacts if the chatbot detects that the user is experiencing a mental crisis.The new rules apply to AI companion services in China, including products from Alibaba and TikTok’s parent company ByteDance. The companies informed users that some chatbot features will be disabled to comply with regulations.
The Chinese government wants people to build real relationships
Experts say Chinese authorities are concerned that AI companions could prevent people from forming real-world relationships or starting families. “They don’t like the idea that large parts of the population have deep emotional relationships with chatbots and could be locked out of the marriage market,” Matt Sheehan, a fellow at the Carnegie Endowment for International Peace, told Business Insider. He also said the government wants people to have “actual, real-world human relationships” rather than relying on AI companions.Under the new rules, AI companion chatbots will have to undergo government vetting before being released. Authorities also have broad powers to shut down services they deem unsafe. The regulations are stricter than measures introduced in U.S. states such as California and New York, and the AI Companion Act primarily requires chatbots to remind users that they are not human and provide crisis support information when needed.
