All over the Internet, we have seen concerns about the growth of so-called “Nudify” apps that use AI to create fake, nonconsensual, nude or sexually explicit images. Meta has long-standing rules for intimate, nonconsensual imagery, over a year ago We have updated these policies To make it even more clear that we do not allow promotions for the Nudify app or similar services. Remove the ads, It promotes these services when you notice Facebook pages and Instagram accounts that promote these services, blocks links to websites that host them so they are not accessible through the meta platform, restricts search terms such as “undressing” and “delete clothes” on Facebook and Instagram, and does not display results.
Today we share an update on our approach to tackling these apps. This includes new steps to remove them from the platform and make other companies do the same and hold the people behind them accountable.
Take legal action
We are suing Joy Timeline HK Limited, the entity behind the Crushai app. It filed a lawsuit in Hong Kong based on Joy Timeline HK Limited to prevent it from promoting the Crashai app on its meta platform.
This follows multiple attempts restricted to the Joy Timeline HK I'll avoid it We will continue to place these ads after the meta ad review process and after these ads are repeatedly removed to break the rules.
This legal action highlights both the severity of our abuse and our commitment to doing everything we can to protect our community from that. We will continue to take necessary measures, including legal action, against those who abuse these platforms.
Nudify apps across the Internet
The nudify app is advertised throughout the internet, and it is not enough to remove any apps available in the app store itself from just one platform. Now, when you delete any ads, accounts, or content that promotes these services, you will share information through other tech companies, starting with URLs that violate the app or website. Tech Coalition's Lantern Programso they can investigate and take action too. Since we began sharing this information at the end of March, we have provided over 3,800 unique URLs to participating tech companies. We already share signals with other companies about violating child safety activities, including sexttorter, which is an important continuation of that work.
Strengthen enforcement against hostile advertisers
Like other types of online harm, this is a hostile space where the people behind it (mostly financially motivated) continue to evolve their tactics to avoid detection. For example, some use benign images for advertising to avoid getting caught up in nude detection technology, while others quickly create new domain names to replace websites that they block.
Therefore, the implementation method has also evolved. For example, we have developed new technologies specifically designed to identify these types of ads, even if the ads themselves do not contain nude. Use matching technology to help you find and remove copycat ads more quickly. We have worked with external experts and our own team of experts to expand our list of safety-related terms, phrases and emojis whose systems are trained to detect within these ads.
I also applied tactics used to destroy a network of coordinated, presence-prone activities to find and remove networks of accounts that interact with these ads. Since the beginning of the year, our team of experts has been conducting a detailed investigation to publish and disrupt the four separate account networks that are attempting to run advertisements promoting these services.
Support effective laws
We welcome laws that help fight the abuse of intimate images across the Internet. Whether it's real or AI, it complements years of efforts to prevent this content from spreading online. stopcnii.org and NCMEC defeats it. That's why we're defending and working on implementing the new US Take It Down Act. This is an important bipartisan step towards fighting this type of abuse across the Internet and supporting those affected.
We also continue Supporting the law This allows parents to oversee and approve downloads for teenage apps. Not only does it protect the burden of repeated approval and age verification across countless apps used by teens, but it also helps parents to check if their teens are trying to download the Nudify app from the app store and prevent them from doing so.
