Indonesia became the first country to take protective measures, temporarily blocking Elon Musk's Grok chatbot over concerns about AI-generated deepfakes and sexual content.
The latest restrictions come after the chatbot faced intense backlash from Europe and Asian governments and regulators for allegedly cheating and creating deepfakes on the app.
“The government considers the practice of non-consensual sexual deepfakes to be a serious violation of the human rights, dignity and safety of citizens in the digital space,” according to a statement released by Meutiya Hafid, Minister of Communications and Digital.
The ministry also summoned X officials to discuss safety measures.
Earlier this week, the UK also accused Grok of producing pornographic content, citing serious safety concerns. The government also threatened to ban AI chatbots in the country.
xAI, the startup behind Grok, on Friday turned off image generation for most users, citing protests over violent images.
According to Musk, creating illegal content on Grok is the same as uploading highly infringing content. Anyone who does that will face serious consequences.
In addition to the UK, Australia's Prime Minister also expressed concern about exploitative and explicit image generation and deepfakes, and called for strong online safety measures to be established.

