AI Deepfake Victim Woke Up From Nightmare – Rolling Stone

AI Video & Visuals


“When I was 21 months old, my grandma locked me in a 230-degree oven,” said the angelic baby with huge blue eyes and floral headband in a TikTok video. Talking in a lovely, childlike voice over the mournful melody of Dylan Matthew’s “Love Is Gone,” this baby identifies herself as Roddy, a girl who lived with her mother and grandmother in Mississippi. She calls herself Marie Floyd. She says that one day she was so hungry that she couldn’t stop crying, so her grandmother put her in the oven, which led to her death. “Follow me to let more people know my true story,” Baby says at the end of the video.

The baby in the video is of course not real. She is her AI-generated work posted on @truestorynow. The account posts videos of real-life crime victims telling their stories and has nearly 50,000 followers. Her harrowing tales are true, albeit to a degree. Her baby’s name is Royalty Marie, not Roddy Murray, and she was found stabbed to death and roasted in an oven at her grandmother’s home in Mississippi in 2018. Her grandmother, Carolyn Jones, 48, was charged with first-degree murder earlier this year. But Royalty died at 20 months instead of 21, and unlike the baby in the TikTok video, she was black, not white.

Such inaccuracies have led to AI True Crime, a subgenre of the mass truth-crime fandom that essentially reanimates murder victims (many of whom are young children) using artificial intelligence. It is natural in the grotesque world of victims. Some of the videos, which have been viewed millions of times, feature victims recounting the harrowing details of their deaths in first person. In most cases, there is no prior content warning.

“They’re very weird and creepy,” says Paul Bleakley, assistant professor of criminal justice at the University of New Haven. “It seems designed to provoke a strong emotional response as it is the surest way to get clicks and likes. increase.”

As Nostalgia Narratives, an account that posts AI videos of real-life crime victims with 175,000 followers, put it, many accounts include real images of victims in their videos as a way to “respect their families.” There is a disclaimer that the photos are not used. video captions. The account is a victim of high-profile child murders like Elisa Izquierdo, a 6-year-old girl who was murdered by her abusive mother in 1995, and 1-year-old Starr Hobson, who was murdered by her mother’s girlfriend in 2020. It’s not just telling people’s stories. But also adult murder victims like George Floyd and JFK.any account rolling stone reached out in response to a request for comment, but the fact of altering the victim’s appearance is likely due to TikTok community guidelines, which prohibit deepfake portrayals of private individuals and young people. This is a policy established by the platform in March. (A TikTok spokesperson confirmed.) rolling stone @truestorynow was removed for violating community guidelines. )

The proliferation of these AI real crime victim videos on TikTok is the latest ethical issue raised by the sheer popularity of the real crime genre in general. I love documentaries jinx and make a killer or like a podcast crime addict and my favorite murder Many critics of the genre argued that the rise of armchair detectives and crime freaks could re-traumatize victims’ loved ones, and that audiences consume grisly real-life assaults and murders as pure entertainment. question the ethical implications of .

This concern does doubly apply to videos like the one featuring loyalty. The video tells the victim’s story from the victim’s perspective and uses their names, presumably without the family’s consent, to incredibly creepy effect. “Things like this have the potential to make people who have been victimized before suffer again,” says Bleakley. “Imagine being a parent or relative to the children featured in these AI videos. When you go online, you’ll see an AI image of him with this weird shrill voice [based on] It talks about your deceased child and what happened to them in great detail. ”

Creating deepfake videos can also have thorny legal issues, Bleakley added, likening the rise of full-blown AI crime videos to the popularity of deepfake porn. While there is no federal law outlawing non-consensual deepfake images or videos, both Virginia and California ban deepfake porn, and earlier this month Rep. He proposed a bill that would make dissemination of images both criminal and civil liability.

Deepfake real crime videos are different from deepfake porn for obvious reasons, but Mr Bleakley said grieving families could blame the creators of such videos, especially if the videos were monetized. He notes that the family may be tempted to file a civil suit against them, but it would be difficult for the family to do so. Alleging defamation because the subject is dead. “It’s a very sticky, fuzzy gray area,” he says.

trend

But one thing is clear: AI technology is evolving rapidly every day, and with little or no regulation to curb its spread, the problem is, will videos like this become more popular? It’s not whether or not, but rather how bad a real marriage can get. So will crime and AI. It’s easy to imagine that a real crime creator could not only recreate the voice of a murder “victim”, but also the gory details of the crime. “This is always an issue with new technology developments,” says Bleakley. “Where do you stop?”

Updated Thursday, May 31, 2023 at 4:15 PM: This story has been updated with more information clarifying why @truestorynow was banned from TikTok.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *