Washington – The video is surprisingly realistic, with bikini-covered women doing street interviews and eliciting obscene comments, but they are completely fake, produced by artificial intelligence (AI) tools, and are increasingly used to flood social media with sexist content.
Such AI slops – mass-produced content created by inexpensive AI tools that turn simple text prompts into surreal visuals often own real posts, blurring the line between fiction and reality.
This trend has exposed the AI influencer cottage industry with minimal effort, often driven by platform incentive programs that financially reward viral content.
The horde of AI clips loaded with humor in the locker room is intended to show a quick look at female interviewers on the streets of India and England.
AFP fact checkers have traced hundreds of such videos on many Instagrams in Hindi. Sexual remarks – sometimes even grabbing women – crowds of men laugh and laugh in the background.
Many videos have won tens of millions of views. And it monetized its traction even further by promoting an adult chat app to “make new female friends.”
The manufactured clips were so realistic that some users of the comments questioned whether the women in the spotlight were real.
Samples of these videos, analyzed by US cybersecurity company GetReal Security, showed that they were created using Google's VEO 3 AI generator, known for Hyper-Realistic Visuals.
“The misogyny that was normally hidden in locker room chats and groups is now dressed as an AI visual.” Nirali Bhatia, an India-based cyber psychologist, told AFP.
“This is part of the harms of gender through AI,” she said, adding that the trend is “promoting sexism.”
This trend provides a window into the internet landscape. Now, AI-generated memes, videos and images are competing even more captivatingly with real content.
“The content generated by AI slops and all sorts of unsigned AI slowly shatters away any small trust left in visual content,” GetReal Security's Emmanuelle Saliba told AFP.
The most viral misogynistic content often relies on shocking values. This states that clips on Instagram and Tiktok were generated by Wired Magazine using VEO 3 to portray Black women as big, feet-filled primates.
One popular Tiktok account video meditatively lists what the so-called gold drilling “Girls Gone Wild” does for money.
The woman is also a feed to torment AI-driven ClickBait, and AFP fact checkers track a viral video of a fake marine trainer named “Jessica Radcliffe” and are fatally attacked by ORCA at a live show in the water park.
The produced footage spread rapidly across platforms such as Tiktok, Facebook and X, sparking global rage from users who believe women are real.
2024Alexios Mantzarlis, director of Cornell Tech's Security, Trust and Safety Initiatives, discovered 900 Instagram accounts of AI-generated “models.”
These thirst traps cumulatively attracted 13 million followers, posted over 200,000 images, and monetized reach by redirecting viewers to commercial content sharing platforms.
“The numbers are much bigger now,” Mantzarlis told AFP, as AI Fakery is growing online.
“Expect more nonsense content that utilizes body standards that are not only unrealistic, but also literally unrealistic,” he added.
Economically Incentive Slops have become increasingly challenging for police as content creators, including students and home parents around the world, turn to AI video production as gig work.
Many creators on YouTube and Tiktok offer paid courses on how to monetize viral AI-generating materials on their platforms.
Some platforms are trying to crack down on accounts that promote Slop, and YouTube has recently said that creators of “fraud” and “mass-produced” content are not eligible for monetization.
“AI doesn't invent misogyny, it just reflects and amplifies what's already there,” AI consultant Divyendra Jadoun told AFP.
“If viewers reward this type of content with millions of likes, then the algorithms and AI creators continue to produce it. The bigger battle isn't just technology. It's social and cultural,” he added. AFP
