The 17-year-old from Spain is being investigated by police for allegedly creating fake nude videos of female schoolmates who were intended to use AI to sell online.
Spanish police said on Sunday that they were investigating a teenager after 16 female students at a school in Valencia, southeastern Spain.
According to Guardianthe survey began last December, when female students reported social media accounts created with names that contain videos generated by AI. She later reported another account in her name. We also reported other accounts that feature websites that promote nude videos generated by AI and images for commercial purposes.
After 15 more minors filed similar complaints, Valencia Guardia civic officials suspected that the person in charge of the fake images and videos was a fellow student.
“Photos of different people from all minors appeared on this account. All of these photos had been changed from the original. This was manipulated to make the people in it appear completely naked,” Guardia Civil said in a statement. Guardian.
The officers reviewed social media activities, contacted hosting companies, and looked into websites offering AI image modification services to track suspects. Guardia Civil has confirmed that a 17-year-old boy is under investigation for allegedly corrupt minors and that a Valencia Youth Court is handling the case.
With AI technology rising rapidly over the past two years, there have been multiple cases of high school students using widely available AI apps to create Deepfake nude images of female classmates. The so-called “Nudify” app is rapidly gaining popularity and only requires one photo to generate a very realistic nude image. These tools take photos of people in their clothes and digitally replicate what they might see without clothes.
In March 2024, two teenage boys from Miami, Florida were arrested for allegedly creating deep nude images of their classmates.
However, this recent case in eastern Spain suggests that the issue is escalating, with teens now using AI to create fake images as well as potentially explicit deepfake videos. This comes after the UK Children's Commissioner (the regulator responsible for protecting child rights) called for an immediate ban on AI apps that promote “deep sexual abuse of children.”
Image credits: Header photos are licensed via deposit photos.
