Apple Tightens App Store Rules on Nonconsensual AI Images

Apple has sharpened its App Store rules for apps that can generate or spread nonconsensual intimate images, placing clearer safety duties on developers of social platforms and AI creation tools.

The updated language appears in Apple’s App Review Guidelines for user-generated content. The company now explicitly identifies nonconsensual intimate imagery as one of the risks that can arise when people create, upload or share material inside an app. It also makes clear that the category includes AI content-creation products.

Developers face a more explicit safety checklist

Under the guidelines, qualifying apps must offer a way to filter objectionable material, let users report offensive content, respond to those reports, allow abusive accounts to be blocked and publish contact information. Apple also says developers are responsible for removing material that violates the guidelines, their own terms or community standards.

The wording gives App Review a more direct basis for acting against so-called “nudify” tools that create sexualized images of real people without consent. Developers that fail to put appropriate safeguards in place, or do not fix violations after notice, can have their apps removed.

Rules also target post-approval switches

Apple has also clarified its stance on bait-and-switch behavior. An app cannot pass review with one set of features and later transform into a product offering prohibited functions. The change matters for AI services whose capabilities can be altered remotely after the original download has been approved.

The company’s legal section separately states that apps found to facilitate human trafficking or the exploitation of children can be removed from the App Store and blocked from alternative distribution. In the most serious cases, Apple says it will notify the appropriate authorities.

The revisions follow sustained scrutiny of AI tools that make sexualized deepfakes and of the marketplaces distributing them. The policy does not eliminate the need for enforcement: Apple will still have to identify violations, assess developers’ safeguards and act when products change after review. But the new language reduces ambiguity about what AI and social apps are expected to prevent before abuse spreads.