Identity of Indian women stolen for erotic AI content in deepfake deception

AI Video & Visuals


babydoll archi babydoll archiBabyDoll Archi

BabyDoll Archi's Instagram account had 1.4 million followers

It took India's Instagram Sensation BabyDoll Archi several days to double her follow up to 1.4 million thanks to a viral social media moment.

One was a video showing her in a red sari and dancing seductively to the Romanian song Dame un grr. And a photo posted on the platform showed her posing with adult American movie star Kendra Last.

Suddenly, everyone wanted to know about her – and the name BabyDoll Archi was trending on Google Search, resulting in countless pages of memes and fans. However, there was one problem that was about to emerge. There was no real woman behind the online feeling.

Although the Instagram account was fake, the face used had an eerie portrait of a real woman. He is a housewife in Dibragar city, Assam, and is known as Sanchi.

The truth was dismantled after her brother filed a police complaint. Sanchi's ex-boyfriend, Pratim Mullah, has been arrested.

Syzal Agarwal, a senior police officer heading for the investigation, told the BBC that Sanchi and Mullet had dropped out and that the AI portrait he created was to make her “pure revenge.”

Mullets – mechanical engineer and self-taught artificial intelligence (AI) enthusiasts – have created fake profiles using Sanchi's private photos, Agarwal said.

Mullet is in custody and has not yet issued a statement. The BBC reaches out to his family and updates the article as they speak.

BabyDoll Archi was created in 2020, with the first upload being made in May 2021. The first photo was a real photo of her transformed, Agarwal said.

“As time passed, Bora created AI versions using tools like ChatGpt and Dzine. After that, he entered deepfake photos and videos into the handle.”

My account has been liked since last year!

Sanchi only learned about the account after mainstream media began profiling BabyDoll Archi and described it as “influencer.” The report speculated that she could join the US porn industry – perhaps the first for someone in the northeastern state of Assam.

A short two-paragraph complaint to police filed by Sanchi's family on the night of July 11th included several photographs and video prints as evidence.

Agarwal says he didn't name anyone because he didn't know who could be behind it.

Reuters is reading the message "AI Artificial Intelligence"the keyboard and robot hands can be seen in this illustration, taken on January 27th, 2025. Reuters/Dadolvich/Illustration/File PhotoReuters

Illustration showing a message reading “AI Artificial Intelligence” along the keyboard and robot's hands

BabyDoll Archi was not an unfamiliar name of the police. Agarwal says she also saw media reports and comments speculating that the AI was generated, but there was no suggestion that it was based on a real person.

After they received the complaint, police wrote to Instagram to find out more about the account creator.

“After receiving the information from Instagram, I asked Sanchi if he knew Pratim Bora. Once she confirmed it, I followed his address in Tinskia's neighbouring district. We arrested him on the evening of July 12th.”

Agarwal said the police “confiscated laptops, cell phones, hard drives and bank documents as they monetized their accounts.”

“I believe he has 3,000 subscriptions to Linktree and he has won 1M Rs from there. I believe he made 300,000 Rs in just five days of his arrest,” she added.

Agarwal says Sanchi is “very distraught – but now she and her family are undergoing counseling and they are doing better.”

There is really no way to prevent this from happening, but “but if we had acted before, we could have prevented it from gaining so much traction,” Agarwal said.

“However, Sanchi didn't know about it because she had no social media presence. Her family was also blocked from this account. They only noticed it after it became word of mouth,” she added.

Meta has not responded to BBC queries for cases, but usually does not allow posting nude or sexual content. And last month, CBS reported that it had removed many ads promoting AI tools used to create sexually explicit deepfakes using images of real people.

Representative image of Getty Image: Silhouette of a woman during sunset or sunriseGetty Images

Women's photos and videos are often distributed as revenge

BabyDoll Archi's Instagram account, which has 282 posts, is no longer published, but social media is full of photos and videos, and one Instagram account appears to have everything in it. The BBC asked Meta what they were going to do about it.

AI expert and lawyer Meghna Bal says what happened to Sanchi is “terrifying, but it's almost impossible to prevent.”

She can go to court and seek the right to be forgotten, and the court can order reports that she named her, but it's hard to rub all the traces from the internet.

What happened to Sanchi, she says, is something that's always happening to women whose photos and videos are circulating as revenge.

“Now it's much easier for AI, but such incidents aren't as common as we expect, or they could be underreported because of stigma or targeted people,” Bal says. And those who saw it had no incentive to report it to social media platforms or cybercrime portals, she adds.

In his complaint against Mullet, police have summoned a law section that addresses misconduct through sexual harassment, distribution of obscene material, loss of honor, counterfeiting to damage reputation and personification. If convicted, Mullah could be in prison for up to 10 years.

Others are seeking stricter laws to address such cases, which have led to recent outrage on social media.

Bar believes there are enough laws to handle such cases, but we need to consider whether there is a scope of new laws to address generative AI companies.

“But we need to remember that deepfakes aren't necessarily bad and that you can create weapons to cool free speech, so you need to carefully write the law.”

Follow BBC News India Instagram, YouTube, x and Facebook





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *