Technology giant Apple recently took action against an application on its App Store that used artificial intelligence to generate intimate images of individuals without their consent. At least three such apps were reportedly found to be offering questionable services and removed from the virtual storefront.
These apps appear to have somehow evaded the company's rigorous review process until they were brought to Apple's attention by an online publication. Within a week of receiving the warning, the Cupertino-based company unplugged the application.
The exact functionality of the app is still unclear, but the service was reportedly promoted as a tool that uses AI technology to remove clothing from regular photos and swap faces in intimate photos. Such features can clearly be abused to produce non-consensual images that undermine people's privacy and dignity.
Recently, the prevalence of deepfake technology has emerged as a major concern. Several incidents have highlighted how such algorithms can be exploited for media manipulation. Although Apple and other app market operators try to regulate them, some risky applications seem to find ways to evade oversight. This highlights the need for continued vigilance in this area.
Going forward, greater oversight may be needed to ensure that only legitimate AI tools that respect user safety and ethics are placed on virtual stores. As technology continues to advance, the responsibilities of gatekeepers must also be recalibrated to balance innovation with prevention of harm.
