Google Play's new guidelines now regulate generative AI apps that offer questionable tools, such as deepfake “undressing” apps and apps that create graphic content.
The updated app store policies published on Thursday instruct generative AI apps and their developers to incorporate safeguards against objectionable content, including “content prohibited by Google Play's inappropriate content policies, content that may exploit or abuse children, and content that may deceive users or enable fraud.”
Developers must offer in-app flagging and reporting mechanisms for users who encounter inappropriate content and “rigorously test” their AI models. TechCrunch report.
Rumored ChatGPT feature in iOS 18 will reportedly be opt-in
The rules apply to apps that generate AI-generated content from “any combination of text, voice, or image prompt inputs,” including chatbots, image generators, and voice spoofing apps using generative AI. The policy doesn't apply to apps that “simply host” AI content or apps with AI “productivity tools,” such as summarization features.
Mashable Lightspeed
In May, Google announced it would downgrade AI-generated (or “synthetic”) pornography results in its search rankings in response to the growing problem of non-consensual deepfake porn. The company also banned advertising for websites that create, promote or compare deepfake porn.
The move comes after a spate of celebrity-centric deepfakes were spread on its X and Meta platforms, including a graphic ad for an AI-powered stripping app that used photos of actor Jenna Ortega as an underage girl. Google has already received thousands of complaints from victims of non-consensual sexual deepfakes, many of which were publicly disclosed. Digital Media Copyright Act (DMCA) Lawsuits against websites that feature their likeness.
AI industry insiders have repeatedly warned about the threat of misinformation and the unauthorized use of people's likenesses, including in a recent open letter written by employees of OpenAI and Google DeepMind, which noted the potential risks of “manipulation and misinformation” if AI advances continue without regulation.
Google's app store restrictions follow a White House AI directive issued to tech companies last month, which called on industry leaders to do more to stop the spread of deepfakes, and specifically called for Google to curb apps that “create, promote, monetize, or spread image-based sexual abuse.” If you've been a victim of deepfake abuse, there are steps you can take. Learn more about how to get support here.
