Apple has tightened its developer guidelines to ban apps that use AI to create offensive content, as well as apps that disguise themselves as regular apps to pass App Store review and later reveal nudify features.
The company updated its guidelines over the weekend with strong language around AI and user-generated content, requiring developers to include preventative measures to moderate objectionable material. In a blog post, Apple said apps hosting user-generated content must filter objectionable material, provide a way for users to report offensive content, and let users block abusive accounts.
Apple also prohibited apps containing hidden or undocumented features, including those that misrepresent their purpose during review and only reveal harmful capabilities such as “nudification” after approval—a tactic it described as bait-and-switch. The company said it will remove apps that add features not present in the version submitted for review.
The iPhone maker additionally updated its legal section to reinforce that it will bar apps promoting human trafficking and exploitation of children. Apple said that last year its review process blocked over 150,000 apps from reaching users and removed 193,000 developer accounts on account of fraud and abuse.
In July, San Francisco ordered both Apple and Google to clean up and delete nudification apps from their app stores. City Attorney David Chiu accused the companies of profiting from these apps through store fees. In April, a Tech Transparency Project report indicated that both tech giants’ stores hosted multiple nudify apps, some of which were rated as suitable for minors.