Apple and Google are helping users spot apps that create deepfake nude images, according to a new study.
So-called “nudification” apps use AI to alter photos of real people to make them appear naked, insert them into porn videos, or turn them into sexually explicit chatbots. According to a report released Wednesday by the Tech Transparency Project (TTP), Apple and Google play a key role in popularizing these tools.
TTP first reported in January that both the Apple App Store and Google Play host dozens of apps designed to digitally remove clothing from women’s photos. A new study found that the platforms’ own search and advertising systems drive users to these apps and increase their visibility.
Apple and Google both have policies that prohibit apps that allow the creation of non-consensual sexual images. However, the TTP report found that not only do such apps remain available, but search tools on both platforms actively direct users to them. According to the study, Apple and Google were showing ads for the nudify app within search results and suggesting related terms through autocomplete.
bloomberg news Searching for terms like “nudification” and “undressing” in the company’s app store will reportedly give users access to software that alters photos of celebrities and others to appear nude or partially undressed. Both companies also advertise similar apps in those search results.
TTP identified 18 Nudify apps on Apple’s platform and 20 apps on Google Play. Some are sold with sexual images, while others are not explicitly promoted as such but can be used to create deepfakes. Apps identified by TTP have been downloaded 483 million times and have generated more than $122 million in lifetime revenue, according to data compiled by the mobile analytics firm. The study also found 31 nudify apps rated as suitable for minors. This is a notable finding amid a growing number of sexual deepfakes in schools.
After TTP and bloomberg news Sharing the findings of the report, Apple removed 15 apps and Google removed 7 apps.
The report comes as Minnesota lawmakers are reportedly moving toward a complete ban on AI nudity apps. In the UK, the children’s commissioner has called for an immediate ban on such apps, citing concerns that they enable “child sexual abuse through deepfakes”.
Image credits: Header photo licensed via Depositphotos.
