Tiktok notes that it uses both technology and human moderators to identify rule break content. However, the amount of uploads makes timely moderation difficult. While the racist video has gained a lot of views, a Tiktok spokesperson told ARS that more than half of the accounts cited in the Mediam Scattered Report were banned for policy violations before the report was published, and the rest were removed.
Regarding Google, we have a comprehensive prohibited use policy that prohibits the use of the services to promote hate speech, harassment, bullying, threats and abuse. All videos revealed by Mediamatters appear to fall under one or more of these categories. In a perfect world, Veo 3 refuses to create these videos, but can understand the ambiguity of the prompts and the inability of AI to understand the subtlety of racist ratios (i.e. the use of monkeys instead of humans in some videos).
Tiktok, the world's leading social video behemoth, is the natural place where these videos spread out. However, it is not exclusive to Tiktok. X (formerly Twitter) has gained a reputation for extremely limited moderation, leading to an explosion of hateful AI content. This problem can also get worse soon. Google plans to integrate VEO 3 into YouTube shorts, making it even easier for similar content to spread to YouTube.
Tiktok and Google have a clear ban on this content, so they should have been prevented from being seen millions of times on social media. However, these policies are lacking in enforcement. It appears that Tiktok cannot keep up with the flood of video uploads, and Google's Guardrails appears to be insufficient to block the creation of this content. I contacted Google to ask about Veo 3 safety features, but haven't heard of it yet.
As long as generative AI existed, people have used it to create inflammatory and racist content. Google and others are always talking about guardrails to prevent misuse, but you can't catch them all. VEO 3's realism is particularly appealing to those who want to spread hateful stereotypes. Maybe every guardrail in the world won't stop it.
